I hear benzos are really bad to get dependent on in the first place then you have to bare in mind that some of the best psychedelic experiences happen when you are at the mercy of the trip so taking aspects of it away whether intentional or not can diminish the trip greatly which can render the whole experience void of any of the significant feelings and experiences that come along with tripping in the first place. The thing is, benzos are used to reduce a psychedelic experience so you already taking them for your own personal reasons doesn't make a difference as to whether they will affect your trip because they simply will affect your experience whether it's completely or greatly or even moderately.
You are best either finding a way to come off benzos in the first place as they are dangerous to mess around with when you just come off cold turkey or don't take psychedelics at all because from what I've read and the evidence suggesting benzos as trip killers just makes me think that you taking psychedelics will be pointless. If you can swap your medication then at least you will have less dangers coming off them depending on which ones you take. If you need them then take them, it's not worth endangering your health just to trip not unless your Aldous Huxley on your last breath.
Be safe