Haha, how cool. I can definitely relate. I'm an INTJ too.
Like you, I often come across as arrogant, even though I don't mean to. And like you, I don't like enjoy group settings.
Actually, over the years, I've adjusted more to enjoy hanging out with multiple people at once, but I still do it in low doses because it drains my energy.
The best advice I can give to someone who is still learning how to "deal" with being this particular personality type is to listen more to yourself and anyone else. Haha, I trust this won't be a problem for you.
I say this because, chances are what will make you happy in life will be more than just a little bit different than what will make most happy. You have unique gifts and advantages, but you need to learn to utilize them – and this requires a certain amount of doing your own thing.
Honestly, I wouldn't worry too much about building more social skills as long as you can actually communicate with people without getting too nervous or anything. The only reason I would do that is if your job requires it or something, and if that is the case, find a job that you are naturally suited for.
Anyhow, it's good to communicate with other INTJs!