Chas,
I think you did the right thing by not saying anymore than you did. Whatever else you could have said would not have helped you or the situation any further.
This guy could be aggressive like this to everybody who looks at him, although he is probably a homophobe. I live in Thailand where there are more ladyboys and gay people than any where else on the planet and every now and then you see homophobics getting all upset over nothing when a ladyboy looks at them. regular non homophobic people make no reaction. But who really cares, it's just one of those things that happened that you don't need to worry or think about.
The fact that you have taken the time to write a detailed account of the incident on this forum means it must have really gotten to you. I'd suggest letting this incident go all together, by holding onto it you are looking for answers that just aren't there. I find when I simply make a point to
stop thinking sometimes I start to feel better about other people or incidents immediately.
John