To the OP
It really just sounds like you two are having a communication issue. Which, if you are having that from the get-go, then you should probably walk away.
Don't stress too much about doing the "right thing", you don't owe him anything. You don't even know him. I mean you didn't sleep with him the day you met him right?
