I'd like to chime in as I have a life-long very severe anxiety disorder, I've been in "remission" from a five year stint of active IV heroin abuse for the last decade, I too drank daily* (but only at night and weekends, fwiw) over a twenty year period but never had a serious drinking problem. I stopped drinking about two years ago, entirely on my own b/c I recognized that alcohol was exacerbating my anxiety. I did not drink when I used dope, see last paragraph* for important HR info regarding why I did not do that, and why I urge others to not mix them either.
The thing with anxiety disorders and drinking is that when one first takes up self-medicating with alcohol it seems like the panacea one's been looking for and that all will be fine emotionally/socially when one can drink. Problem solved, right? Maybe... for a few weeks, months maybe even years. But in that time if the person watches closely they'll see that their anxiety is often worse when they aren't able to drink - when their blood alcohol level drops they feel rebound anxiety that is worse than their 'baseline' anxiety. Compounding this is that alcohol diminishes one's ability to judge it's effects on oneself. So it is very much possible to get into a cycle of trying to drink one's way out of experiencing severe anxiety - but one simply may not be able to do so and one can become boxed in and can't function without alcohol - even if they're not an alcoholic per se. Thankfully as this was happening to me I realized it and decided to try to stop drinking. It took some effort as drinking was a deeply ingrained habit I'd formed, but after six months or so I was able to simply not even think about it, or if I did I'd recall how bad I'd feel each AM when I was "sober" and that would put me off the idea.
A few years ago, when I was about age 40, I was still drinking b/w two and six beers a day. When I would wake up in the AM the intensity of my generalized anxiety was obviously in direct proportion to how much I drank the prior evening. It also affected the quality of my sleep. I stopped drinking over a period of about six months and noticed a very big improvement in my general anxiety level. Panic attacks also slowed in frequency. The effect is dramatic enough that I cannot be prodded into drinking, I do not crave it and I now avoid it.
An anxiety reducing substance like a benzo is best used to get anxiety under control while you engage in therapy to learn to reduce your anxiety while you reduce the amount of benzo you take - ideally. That's a lot of hard work, I've been at it for seven years and I'm slowly reducing my clonazepam as I learn to deal with my anxiety through behavior modification and cognitive techniques for assimilating my anxiety so that it isn't my mortal enemy, but something I can learn to reduce and live with when it does flare up.
*I know this is stated all over the board here, but it cannot be said enough, imo: I didn't drink when I was slamming dope, so subtract several years in the middle of those twenty years of daily drinking and substitute dope instead. I subscribe to, and "sell" subscriptions to, the 'don't mix alcohol with opiates' program b/c close friends of mine who drank and slammed dope have passed away from the combination. Choose one or the other please, if you use both don't mix them. And adding in a benzo is a great way to flirt with death. My only Ods were the few occasions where I did mix benzos and dope, once with a single beer – a night I almost did not survive (and I had tolerance to all three substances at the time!)
Best wishes to you in your attempts to get a a handle on your anxiety. It is a terrible condition for many of us.