Robert J. Ringer wrote a book, "
Winning through Intimidation" in it he describe the various subtle ways that people use to intimidate you... and take control over you...
If you read the book you will see right through those who do intimidate you... and then, these tactics would have little control over you...
However you could take some consolation in the fact that most everyone is intimidated by someone else sometimes... and one of the best way to overcome that fear is to face it... eventually you will become desensitized and will be a lot less subject to being intimidated...
Also, if you are so inclined, the Martial Arts are a great way of gaining self-confidence... after you've faced and few hundred goons who want to beat the crap out of you and you get to beat the crap out of them... very little will scare you...
Best of luck to you...
.