I'm a little too lazy now to get sources but I think it was in the 60s that they ran studies that showed that most people could not distinguish mescalin LSD and psilocin's qualitative effects from each other. But then again, the average person may not have programmed him/herself to differentiate between the subtleties of different psychedelics. Trippers in a way 'specialize' themselves that way perhaps.
Yet, how we color the experiences with our expectations may technically illusory but it can still make a change. For example mescalin is a lot more visionary for me with hardly any mindfuck, mushrooms give me a lot of mindfuck and emotional rollercoaster, LSD is more stimulating and not stoning like mushrooms are for a lot of people including apparently you and me.
It's hard asking others whether interest you might have to explore other psychedelics besides mushrooms is valid. On the one hand, mushrooms are very all-round well covered psychedelics that should be able to facilitate a lot of experiences for different goals - like therapy, divination, recreation, philosophizing and more. But I'd still say that every psychedelic has unique tendencies and it can be worthwhile to learn how your body and mind react... what different kinds of body highs different psychedelics can produce. I'd say by experimenting more you would increase your chance of special / characteristic experiences even more than psychedelic experiences with one substance can already vary.
Body high? LSD feels very cerebral for me but the buzz is less deeply euphoric than that of mushrooms for me. The quality of LSD for me is ability to stay rational up to a further point, and the mental clarity whereas mushrooms tend to give a much more dreamy, blurry trip.
Ultimately it's up to you whether you find the promises and potential upsides worth the cost / risk / etc.