Business actually doesn't take a lot of math. The most important parts are those case analysis / consulting / entrepreneurship classes where you find out how to make business decisions with real-life applications. Math isn't really needed for those, but business acumen/intelligence which comes mostly from experience, some from learning, and also broad/general knowledge. However, I don't know if your school has those kinds of classes -- you should ask around and check.
I think creating a startup from scratch is one of the most exciting things you can do. You have 4 years ahead of you, that's a lot of time to think up an idea and start a business with your college friends
Or you can do other things like finance, but that's mathy and dry so I doubt it's for you