I have used MS Money in the past. It does everything you asked for and more. In fact it offers so much info that a newcomer can get lost in it. Just stick to the basic budget pages at first. Also most banks support downloading your statements to MS Money, very convenient.
Saving can be made easier by having a certain amount direct deposited every payday into a savings acct at a different bank, or into a 401k, IRA, or mutual fund. It goes straight from your check to the account and you end up not missing it. If you are truly saving and don't need instant access to the money you could also put that money into certificates of deposit or a low-medium risk mutual fund and get a decent rate of return that can add to your savings. It's fun to watch your money grow!
I also participate in an internet marketing program that pays me a rebate on my advertising dollars to the point that advertising my websites is not only free, but I'm
making money. My income from this grows
daily and will soon exceed my bills! Learn more at my site
60 Minute Work Week
Best wishes for success! Mike