they dont just go by how the drug affects your brain, they take into consideration addiction potential, drain on society etc etc, the effects of the drug and so on
if someone was off their face on ket wandering the streets at night it would be pretty damn dangerous even though the drug itself is a damn sight safer than alcohol