Is he becoming withdrawn?

I would hold off on asking for sex for a while and try to figure out what's bothering him. It's not wrong for you to want sex, but he obviously is going through something and that should be addressed first.