Get the pregnancy thing out of the way first. The cheap drugstore tests work just fine - don't worry that they're generic. You can get one for about 3-4 bucks. That or find the nearest Planned Parenthood or other such clinic and get a pregnancy test and get back on birth control. Those are more important worries than whether or not he'll have sex with you.
He's probably picking up on your nervousness and apprehension. Hang in there! Moving is rough no matter what.