Harmony,
I've totally been there. I was a Math person who had a very hard time with History and hated numerical calculations. I hated high school so much that I planned to drop out. But there's a lot of hope.
One thing you might seriously consider is going to college early. I went to (
Bard College at Simon's Rock - The Early College) after sophomore year, they typically accept people after their sophomore or junior years, instead of their senior year.
Another thing you should know is that Math changes a lot after calculus. I don't know if you've studied any Number Theory, but basically Pure Math turns conceptual and logic-based, rather than application and calculation based. It's a very, very different world, and I'd recommend making your decision after you've taken a course like Linear Algebra or Analysis.
Best of luck,
Satvik