Are these signs he's only in it to get sex?

I don't know 100% about the sex part (though it's likely), but if I were you I would be more concerned about the fact that this relationship is really bad. You guys aren't communicating, and he seems like he doesn't care about you. I suggest you break it off, or talk to him about it at least.