I get panic attacks when I smoke too much weed, and also I did when I just started smoking weed... In total in my 5 or so years of smoking I've only had maybe 5 severe episodes though... and maybe a few other minor ones.
Benzos are a good recommendation and obviously will kill any panic attack dead.
Honestly though maybe you just are smoking really good shit, and like me, you're sensitive to panic attacks with weed.
So first, try smoking less.
If you want, try smoking in different settings, especially like by yourself or with certain best friends. Or even something like laying down alone after smoking. Weed has tryptamine-like effects and so you to some extent can likely 'work' with the drug. By this I mean if you experiement in many different settings, essentially what can happen is you can 'grow closer' with the plant.
An example of this: Since I have tried weed orally, I developed a completely new relationship with the plant because the oral effects profile was so different and relaxing for me, while still being more powerful than the smoked high. Because of my couple oral experiences with weed, I feel that I am less prone to anxiety from smoking it. So this is another suggestion... trying it orally, that is. It needs proper preparation though, so if you do this, research it first (Look up the official bluelight firecracker thread for an easy one gram weed recipe to get you very high orally). Be careful though, doing it orally could send you into an even worse panic attack, just because the drug is so powerful this way. Just offering any suggestions I think could possibly help.