Hi Laura!
Myself and my 2 younger sisters were homeschooled off and on throughout our childhood, and I now have a daughter of my own who is 5 so I have a little of both experiences.
I personally didn't like homeschooling at ALL and neither did my middle sister, but my youngest sister loved it. She was often sick, and worked at a different pace than everyone else, so school was really hard for her. For my and middle sister, we badly craved the social interaction that school provides and even our homeschooling group didn't cut it. I'll also tell you that as a parent you have to be extremely disciplined to homeschool, because my mom wasn't which made it an unsuccessful experiment. However I have friends who were homeschooled for ALL their grades, and their mom was very routine and success-oriented and they both turned out great!
As for the happiness part, its actually very natural that we constantly worry about our kids happiness. We take from our childhoods the things we didn't like and try not to reenact that with our kids, and we try to perpetuate the things we did learn. You are the only one that really KNOWS your kids, and you need to trust that. You WILL do what's best for them, you just maybe don't know it yet!
With my daughter, I decided that I didn't want to force her to go to church as I was forced, and as a result she WANTS to go to Sunday School, and I gladly take her when she wants to go. I also didn't want to be really strict with her, and instead I treat her like an adult. I try to socialize her as much as possible because (most) children really need socialization.
I'm sure that you are doing a great job right now, but I understand constantly putting yourself under review. We are always learning, always growing, and our children will learn and grow with us. Take care