I tapered down off a similiar dose of valium daily (around 60mg), after taking it daily for about 5 weeks. My taper was pretty brutal, with 5mg reductions every 3 days, and 2mg reductions once I got below 10mg. But I jumped staright down to only doing 30mg a day. below 30mg I started to notice the withdrawal symptoms quite acutely.
It took me about 3 weeks to taper off properly. after stopping completely the symptoms were only really bad for two days and quickly got better.
I would see another specialist. to be honest, I think over two years would do more harm than good.