If you don't need them for anxiety it's best not to fuck with benzos or if you do make sure you put a week or two in between uses. Benzo withdrawal can kill so it's really one of the worst drugs to play around with.
Everyone is gonna build tolerance differently, it's dependent on too many factors to say for sure. Some of the biggest factors are, quantity used in milligrams, length of time using them, and the length of time you give yourself between uses. If you keep your quantity to under 1-2mg, keep your length of time using no more than 1 day in a row, and give yourself large breaks you'll have the best chance of avoiding physical addiction besides absolute abstinence.