First of all, you do of course need to accept yourself as you are. I know this is difficult, especially if you have experienced comments about the size.
Anyway, what I would recommend you to do, is to get the issue out in the open at the first "appropriate moment". Simply tell that you have some complexes about your size, maybe even joke about it yourself
I'm sure that the right woman will understand and it will make you feel a lot better.
RD