You don't have to give to people if you can't or don't want to. It doesn't make you a bad person. Just say no. Say, "I can't right now." Don't let people you don't even know guilt trip you into supporting them or their charity. Besides, donating money is the least you can do for a charity. You could volunteer there. Spending time is better than spending money.