Just do however you feel comfortable.
There's no need to feel nervous, they aren't going to bite.

(unless you insult/swear at them)
I usually look at mouth (and lipread) when speaking to someone.
With 2 people just look at the one that talks. With 8 people, just the one closest around that is talking to you.
Keep practicing - it will become a second nature