I sit on an excercise ball and love it... and I never felt off

It's a lot of fun too, you can just bounce a bit if you are feeling like it (eg. if you just made some money off the internet

).
I would love to try the kneeling chair one day, kneeling at computer is very comfortable, but only for a certain time if you do not have something really soft under your knees.