You are right. He should have stopped when I told him to and not asked why. I would have reacted stronger if I had not been in a professional setting and needed to keep my cool for my professional reputation and for the sanity of my husband. He saw the look on my face and came charging but by then I had defused the situation. I'm glad of that. Slapping the man or having my husband punch him would not have done me or my husband any good in that situation. Thus, I defused it and responded like I did in email when he contacted me.

But, I know, I should never have had to get to the point of saying stop because I'm married. He finally stopped when I said something along the lines of "I don't like what you're doing. Let go."