What to do in this situation?

The best thing to do would be to ignore the situation and him. However, thats easier said than done. This is obviously bothering you. It really does seem like this guy was just looking for , and by asking him to talk about it, you risk embarring yourself and giving him the upper hand. The age old saying is true "The best way to get over someone, is to get under someone else". So my advice is to find a y new guy.