Ok, this is getting odd now...
Since I posted this I've seen two girls who were initially just certain they'd seen me before, and none too happy about it. One wouldn't go into much detail but noticed my eye color and realized I wasn't who she'd thought. The other demurred at first but later said she was relieved since the person she remembered was "not gentle... not gentle at all" and became convinced I wasn't who she'd remembered based on my behavior. Both were quite clear that their restrictions included not having their hair pulled and not being hit, which gives me a hint of what "not gentle" means.
I'm quite sure I've not seen either of those girls before (though it turns out one of my other appointments was an unintentional repeat), but it seems there's some other fat, old guy that resembles me out there who needs to quit this hobby before things turn ugly.