I married my high school when I was 22 and changed to his name. We divorced 11 months later (yes, that old chestnut.) and it was such a pain in the @ss to change it the first time, I just left it after our divorce. Now I'm remarried and still have my ex-husband's last name. It doesn't bother my husband and it doesn't bother me so I just keep it.
It does, however, bother a lot of other people.
They think it seems disrespectful to my new husband and soulmate. I naturally can't be defined by a name so what do I care! In essence, just do what feels natural and right to you.