Maybe when you agreed to have a break, he interpreted that as a break? like in "let's have a break for the good of our relationship". I assume if he had this idea then he basically spend the time of the break with thinking about you and how to make things better or so, while you probably used the time to focus on yourself and things which make you happy.
But it's never too late to talk clearly about things... And if he wants you so badly he probably needs the distance more than you do.
just an advise of a guy who definitely needs to be kicked in the butt in such a situation
(PS: when I was with my girl one of her cats was very affectionate to me, but I had problems making both of them happy! they became all jealous and bitchy!!!