ALWAYS TAPER BENZODIAZEPINES.
Bam, said it, now you heed it.
A good way to do it is to take small increments off every 2 weeks. If you have tabs of 5mg then break those in 4 pieces each and 1.25mg will be your increment. This is best. If you have a 10mg pill, you can only break it in 4, then 2.5mg is your increment.
BUT YOU MUST TAPER.
If you suddenly quit you may get severe withdrawal featuring convulsions, and that withdrawal can last MANY months. Even if you promptly go back to the full 10 it still might take weeks of being sick to stabilize. So dont quit at once, taper.