I was in the same situation 7 years ago. I couldn't take any drug without panic attacks. In my situation though, I started to get panic attacks even without drugs.
The solution? Not simple! I got tons of medicines, got through 3 years of psychotherapy and I didn't use any recreational drugs for 6 whole years. One may ask why I started to use drugs again after finally recovering (well, almost), but I now know I used drugs very irresponsibly 10 years ago, just bombing my brain with drugs every weekend (sometimes more often). I am now very aware of my psyche and how my mind works. It was sad I had to endure very much mental pain for many ears, but it paid out eventually.
Take a break from all recreational drugs. It doesn't necessarily have to be 6 years like in my case, but do it! It's not necessarily an easy decision to take, but always put your mental health first. Know your mind before starting to mess with it.
Also, if you have the patience, try meditation. Meditation is the best "medicine" for me to battle anxiety nowadays, and I'm 99% free of panic attacks nowadays. Learning breathing techniques which calms your mind are very helpful, also in daily life. But you have to stop and think about your life. Prescription drugs may also help. Go see a psychiatrist. Acknowledge your weakness, it is the key to build yourself up again.
Seroquel doesn't help with panic attacks. Try SSRI's or benzos. Benzo's do get you hooked though, like in my case, but they have been a lifesaver.