You noticed the warning sign before he even finished the sentence, and you are not sure anymore if you are reading him accurately or reading your own history onto him. Both things can be true at once. This is where you separate them.
Stay with the facts of what happened, then notice the story your body began telling around them. Your honesty helps this reflection see whether you are responding to a pattern in the relationship or protecting yourself from an old one.