It would most definitely weaken your roll quite a bit. I don't think it's dangerous but I wouldn't try it personally. I also wouldn't stop taking your medication for a couple of reasons. First, it sounds like you genuinely need it atm. You should never just stop taking APs or psych drugs cold turkey even for a few weeks. Depending on your individual biochemistry you could experience significant withdrawal. APs also mess with the way that your body regulates heat. When you are in withdrawal, it would be very easy to overheat on something like LSD or MDMA, I know because I almost overheated on LSD one time when I stopped taking my meds and was still in withdrawal.
I have been off of my medication for a while now, since January, and I still struggle with being hot all of the time and my withdrawal has lasted about a year and it's still kicking because I tapered too fast. If you get off of it, you need to do it slowly. Don't ever just stop taking psych drugs, you can do a lot of damage to yourself as I learned the hard way. So be careful with psych drugs and empathogens and psychedelics. Some mood stabilizers and ADs would be dangerous to mix so always do your research.