Maybe you didn't give them enough notice. It's nice to do things spontaneously, but if people are busy or have made other plans it's makes it harder to get them to go.
On the other hand if this happens to you regularly you should find out why. You don't sound like a boring person. Maybe you just need to sharpen your persuasion skills.