You could use TeamSpeak which is free and popular:
TeamSpeak - Welcome to TeamSpeak
Not sure how well it work work for what you're trying to do, since it's intended for games, but I'm pretty sure it has public non-game-related rooms.
(If you don't like that program, Wikipedia has a list of VoIP software:
Comparison of VoIP software - Wikipedia, the free encyclopedia )