This was an interesting book for me to read, it's not specifically related to only first impressions. The author discusses 'thin slicing'' and how we decide what we decide:
Amazon.com: Blink: The Power of Thinking Without Thinking (9780316172325): Malcolm Gladwell: Books