Would you be upset about no with spouse? What would you do?

Without getting frustrated, have a real heart to heart with him about how this is making you feel. Even though he's on meds, your feelings are important too. Maybe see if you can come up with a compromise where he could maybe satisfy you even if he can't have . is a very important part of a relationship so it's important that you guys talk about it and work it out.