Me too.
I think weed can definitely be incredibly powerful and psychedelic. Like you, my tolerance is pretty ridiculous, but I find 3-4 days off resets it to some degree. Two weeks and it gets back to 'normal' effects though this is short-lived (and I quite like pot just being a before bed gentle sedating blanket of sleep things). But I think this is why most users don't consider weed to be very powerful even though most people recount very dramatic and full on first time cannabis experiences. For some reason, weed is used a lot more frequently than we would other trippy drugs, so most users have a tolerance. When you are tolerant, its a very different drug, very mild and relatively devoid of psychedelia, something you can do constantly and anywhere- but I remember my first time and it would have been explicitly clear to anyone who looked at or spoke to me that I was off my face. Unlike many other drugs, I've found tolerance can't really be overcome through smoking, though oral doses are quite effective.
One of the more intense panic attacks I ever experienced came from two semi-large bong hits. I hadn't smoked for around 3 months (this was about 15 years ago iirc) and decided to smoke a bit with my then-GF, and it absolutely terrified me. Thought loops, CEV's, racing thoughts and heartbeat- I became convinced I had loss access to my memory of peoples faces as my GF started to look quite different- and then she began wondering if I was dying or turning into a monster or some stupid nonsense. I will never forget how distant sober reality appeared to me as I realised the very specific damage that this weed had done to my brain. :D Always did make me hyper suggestible and paranoid. Sometimes enjoyable in how stupid that shit could go.