New Guy…Old Activity?

Been talking to someone for 3.5 months. He recently mentioned how I remind him of his good friend that he’s had for years and how he would never introduce us. I asked why, he said “you’re both tough” I let it slide. I’m tough but I’m a grown woman who knows how to conduct herself. He then says he introduced her to his ex-wife (while he and his wife were married) and they got into a mini argument. I ask some more questions and he says she’s the woman he lost his virginity to at 18. Then he mentions how she’s only been jealous once when her sister flirted with him. Then he mentions how they don’t speak anymore, but she texted him last week. They haven’t spoken over the phone in 3 years. Am I wrong to feel something is off? First, I don’t like being compared to anyone. Especially someone who is very different from me. Second, why mention the last time she was jealous? We are 2 hours away from eachother and that was already something I was having a hard time with.
We have not been intimate, because I am not ready. We have met once in person, and while he asked if we could share a hotel room, I was adamant and said no. I’m supposed to go there for 2 days, made it clear this won’t be sexual then either, and he’s ok with that.
The other day he cut me off mid sentence to take “an emergency call,” at 1230am.
Thoughts?