As has been stated, slow down, take your shoes off and don't get so attached. He said he's not ready for anything serious, but then again I know people that weren't and have gone from being in a bad relationship into a great one and then have gone and got married.
So yeah, take it easy, don't scare him off, yes it's hard I went through the same thing, scared the girl, but she saw what I was doing and just told me to slow down. I did and everthing is good
Take care of yourself