I've experienced something similar to this lack of psilocin tolerance. When i was cultivating fungi, I'd often trip 5-7/7 days a week for up to a month at a time, but I was also eating fungi by the unmeasured handful. If my dehydrator was full at the time, I'd often just harvest a monotub and eat every single fresh mushroom right there without even weighing them. LSD created only a very slight tolerance to psilocin over this period, and ayahuasca amplified psilocin dramatically. This was before I had access to psilacetin (which is what's typically used in mushroom chocolates), so I'll just be speaking on the use of fungi here.
Others around me who used psilocin every other day found insane tolerance build-up, whereas I was using daily and found almost none. What ended up happening though was that psilocin's effects became much less profound feeling and it became more like a psychedelic stimulant, reminding me nowadays (with more diverse RC experience) of things like 2C-B, or a brief take on DOB/DOC if that makes sense. I was compulsively jacking off a ton, I would be up for days straight hacking/coding and working out like an absolute maniac. It also led to me becoming way more prone to violence, whereas normally walking past a homeless guy who calls me a faggot I'd just spit on him or stomp on him a bit, during this phase I was somewhat routinely engaging in long and somewhat tortuous fights (might be closer to assault tbh as I never lost in these situations) when people would say shit that set me off. I was living in a city with an enormous population of mentally ill homeless people at that time, and a ton of violence in my area.
The kind of "I got home late because I was sprinting after a homeless man (who I very likely just hallucinated calling me a name threatening me) with my knife out, intending on gutting him like a fish" events in my life almost exclusively occurred in this "mushroom gremlin" phase of my life. this phase occurred because I was growing mushrooms, often pulling ounces at a time per tub, but I didn't sell a single drug and despite my roommates often eating ~1-2 ounces per week, it was still nothing in comparison to the amount I was consuming. Psilocin, DOx compounds, methamphetamine and ephedrine are the only drugs I've ever used that turn me into an absolute fucking menace in combat situations.
@chris_p I've found psychedelic use not to have any downsides when in binges for some people, but it does for others, and I've rarely found any commonalities between the demographics that benefit from it or not.