Now if this was a person that you've known for ages, you felt like you were soulmates, and suddenly disapeared and hasn't called in a while, then I'd see a cause for concern.
But it was some random stranger, from a bar, for one night.
He could be under the impresion that this was a one-night-stand, or not. Just move on. I fell that if a person continues to worry about something/someone, then you may miss opportunities that may come the days ahead.