Realize first that everything is perfect and that there is nothing to escape from. There are people who can enjoy physical soap work for your company. Simply attract those people into your business. If you enjoy encouraging others to not work long hours, find a manufacturing company that has a policy that has a set number of hours they allow employees to work that you also feel good about.
It's not possible to consciously create justifications or logical reasoning to come to terms with any issue, including leveraging others to create your business. That's an internal thing, simply accept yourself more deeply, and just keep deepening this acceptance.
And keep doing what feels right. From the sound of your post you don't seem to want to "mingle/getting-into-the-trenches" at all, so simply don't do it. Do abundant people feel the need to get down and dirty with their housekeepers once in a while? Of course not.
There are so many options. And everybodies different. What you can't currently imagine as enjoyable, someone else is enjoying immensely right now. Just think of vegans who can't imagine eating meat, or a meat eater who can't imagine someone eating vegan.
So much variety in the universe