I'm experiencing a similar misfortune at present, albeit less-pronounced than yours(round about 5-10 units per day, depending for about 2 months. 4 units per day for 6 months prior to that).
I'd say hold off for as long as you can before your next drink.
How long have you been taking the xanax for? I'd say cut your current usage IN HALF at this point.
The fact that you've made it this far and are comfortable means it's working itself out (or rather YOU are working IT out).
The problem of course will be boredom and inactivity at this point, so you may want to either busy yourself with something manageable and time-consuming, physical activity or excerpter, reading, anything to keep your mind off the drudgery of sobriety.
Do you enjoy cannabis? This would be recommendation if you absolutely NEED a substance to pass the time.
When quitting, I personally find that 1 bowl of good cannabis eliminates my need for alcohol 75%.
One bowl, one shot or beer = 4 shots or 4 beers for time consumption.
Also eat heartily and healthily, if you can muster the strength to. This is one of the main problems I've faced since being anxious leaves me with little to know appetite. Stay hydrated as well. Ice water and sports drinks help me immensely.
Try melatonin for sleep.
Good luck.