Yes, be sober with your woman... it's only fair lol. Also, drugs can interfere with your reproductive system, hormones, and overall health so I'd say logically yes you should both probably sober up if you're trying to have children. You're gonna have to anyway! Good luck!
Drugs and alcohol may not interfere with the quantity but will the quality.
Basically, you may still have a high sperm count but your swimmers may not be so strong........
(I hear anyway )