Then it's not HPPD, HPPD is a disorder which by definition means it is 'that' bad.
Lots of people diagnose themselves with HPPD, serotonin syndrome, seizures and other things while there may be only little or no reason for it. I'm sure I have done it myself in the past, we're usually a breed looking for answers and bound to misunderstand or misinterpret. I think this is a classic case of 'medical student syndrome' i.e. medical students are quite prone to misdiagnosing themselves with lots of things they write about. I guess hypochondria is in a way associated with it. Anyway in periods when I tripped a lot I also saw worm-hole like things and fractals appear when staring at a wall. Don't mean to diss you at all, this is just something in general I have noticed across the board and others as well.
I am considering absorbing the following question in the FAQ: 'help, I think I have HPPD or serotonin syndrome, etc?!'
But this is not even really the topic at hand so apologies.
About a risk assessment: that is actually very hard. And not for us to decide. Unfortunately the most that can be said is that some things like pre-existing anxiety or depression issues are red flags or no-no's when it comes to psychedelic use. It could be manageable, it could even be resolved and approached therapeutically... but when taken in an unprofessional setting and without guidance one should not assume the spontaneous therapeutic benefits from psychedelics.
Instead, the character of the mind should be expected to be amplified so everything you experience now you should experience the same only significantly stronger. Breakthroughs would allow you to overcome parts of this, but as a basic rule I suggest you prepare for and accept the possible worst consequences which are that pseudo-HPPD becomes real HPPD, mood problems or instability could escalate, etc. Which is why it is always said only trip when you are feeling well.
Of course there are people who go against this advice and take the chance anyway. We're here to minimize harm but in doing so respect the choices everyone has for themselves.
What I am against however, is the premise that this kind of question can be answered with some kind of certainty. Discussing this may clarify a number of possible outcomes but not the chances of these things happening. Always keep that in mind.