Critical comments about my appearance?

I personally think I'm a great catch. Not to sound big-headed, but I'm attentive, honest, and have a lot to offer in potential relationships. I consider myself average looking and have a larger stature. Today, a guy I am dating told me that previous to our relationship, he was sleeping with a girl that was "probably" twice as hot as me, but that he likes me better. (She went a little crazy when he decided to end his relationship with her to be closer to me.) Obviously, he was trying to prove to me how much he likes me by saying this, but I am also insulted that he'd said/thought that because he's seen us both in the and he had the nerve to say that she was more attractive. I'm feeling insecure now and don't feel like continuing the relationship. I was just wondering if guys generally do rate women they're sleeping with like this? I honestly have not had many ual partners, but I cannot compare the men I've slept with each other because they were all very different...