Try Rhodiola ande L-Theanine
Most of what I was going to say here has already been covered.
SSRI's are good for people for really need them to function on a daily basis, but they are way overprescribed to patients who don't really need them. From your description above, it doesn't sound like you really need to be going on an SSRI.
I am coming off Paxil for my second time right now and it's fucking miserable to withdrawal from this crap. Not everyone gets severe WD symptoms from going off the crap, but if you're one of the 'lucky' ones that does, it really sucks. Brain zaps, insomnia, nausea, muscle cramps, and rebound anxiety that's worse than before you started. Anyway, Over a period of a month, I've tapered down to 12.5mg every other day. I'll wait a few weeks for this to stabilize and then I'm completely stopping again.
I was prescribed it for anxiety/panic attacks. While it has helped with the anxiety, it's completely fucked up my sex life, makes me emotionally flat/blunt to everything, actually makes my insomnia worse, etc. I am definitely not myself and I don't like the way it makes me feel. It has also completely zapped my motivation/drive both at work and trying to get things accomplished in my personal life. I just don't care anymore. Not good.
Some thing things not mentioned above that work quite well for moderate anxiety, stress, anger, etc are Rhodiola Rosea and L-Theanine. I have used both of these to great success. Neither of them give 'drug like effects' that you can feel, but you can definitely tell they are doing something. However, the Rhodiola will cause excessive stimulation if taken in large doses and will aggrevate insomnia if taken too close to bedtime. Take two doses of Rhodiola/day (early morning/afternoon) and 100-200mg of Theanine 'as needed' for anxiety. Just make sure you get quality stuff and I think you'll notice a difference. The thenanine isn't drug like in it's effects, but it will help induce a relaxed state without sedating you. I will be back on both of these myself as soon as I'm off the Paxil. I took these before for a while after going off Paxil and was fine for well over 6 months. Then I started having physical problems with swallowing (throat damage due to acid reflux) and had to go back on the Paxil since I needed something stronger to blunt the anxiety until it healed some.
As mentioned above, we don't know the long term effects of SSRI's or many of the tryptamine/phenethylamine psychedelics. Not sure how relevant it is or not, but I never suffered from anxiety/panic attacks before I started using these types of psychedelics regularly. Even though I've stopped for over a year, I still have minor issues. I'm suspicious that one or more of these psychedelics may have some long-term effects on the serotonin receptors (perhaps damaging them or downregulating them to endogenous serotonin), resulting in the tendency for prolonged anxiety, etc.
Not trying to start a controversy here, but I doubt using these tryptamines/phenethylamines regularly on a long term basis can be good for the serotonin system either. I was (abusing) them on average twice weekly for a little over a year before I started having anxiety issues/panic attacks that required SSRIs to function normally. I was certainly using them too often, but I do think they have some role in precipitating my anxiety issues. Now that I've been 'psychedelic-free' for a little over a year and my throat is healing, I think I'm ready to come off the SSRIs completely again and see if things are back to normal. The SSRIs can be good drugs when they are really needed, but are handed out way too often to people who don't need to be screwing with their brain chemistry.
Just my two cents. Good luck and be well.
-gp