I can see what you're saying, but Flunitrazepam, Midazolam, Triazolam & Temazepam cause severe short term memory loss and are generally used in very high doses causing complete blackouts for date rape situations, which is why they are commonly used as date rape drugs, although I know in studies it has been proven that Temazepam and Midazolam are the most commonly used - probably due to their higher availability through prescriptions/street access (although in some places in the US Flunitrazepam is quite available on the street).
If they are not used regularly, then the short term memory loss will pass after about 1-3 weeks at most. But if you don't use those type of Benzos regularly, you won't suffer with memory loss for 5-6 months.
Ultimately I do agree with you, but if not used regularly, they won't affect your memory on a long term basis. However people who use Flunitrazepam, Midazolam, Triazolam, Nitrazepam and Lorazepam (or Z-drugs such as Zolpidem and Eszopiclone) and even lower potency Benzos such as Diazepam, Clonazepam or Alprazolam on a regular basis are going to fuck your memory up for a VERY long time if not permenantly. I learned that lesson the hard way as my short term and long term memory are severely debilitated after previous usage stated above, and I've never used Triazolam, Midazolam, Flunitrazepam, Temazepam or Lormetazepam - I think the most hypnotic/amnesic I've ever used are Zolpidem & Nitrazepam! Though I'm sure I'd be in an even worse predicament if I had!
Just my two cents.