Three men by the time you're 25 is not a lot.
BUT
Even if it was 30, or 300 men, it's not his place to judge you. And you say he's been with 100 women, so he's obviously one of those idiots with double standards (he feels free to indulge in sex but judges women for doing the same).
Keep in mind that when you're choosing whether to value an opinion, you have to first consider the source. The source, in this case, is totally sexist.
Verdict = He's a tool, don't pay him any mind.