...and now I have to intend not to remember my dreams every so often just so I can feel like I had a full nights rest.
For the longest time I didn't remember many dreams. I sort of shut that window in my early 20's due to some bad dreams. However when I finally realized that I could be missing out on a way for my guides to be sending me messages. I decided to try and start remembering. I figured it may also help me in my visualization (not sure if it will or has yet).
My advice would be to relax and try not to force it....when it happens it happens. Just before you go to sleep (when you notice that you are very relaxed) just say to yourself,
I want to remember "one" dream. Keep this up every night until you have "one" dream. Starting with the one dream is a good starting place, unlike me who said I want to start remembering my dreams and all of a sudden was bombarded with 3 to 4 dreams a night.

That shift from not remembering to 3 or 4 each night did not make me feel very rested.
So don't sweat it....but be persistant and consistant.