Generally, but this isn't the product of their use in a vacuum. Alcohol and nicotine are legal. Weed is not a hard drug for those whom are ~25 or older, and otherwise doesn't have near the incidence of abuse and addiction that other drugs do. Psychedelics follow the same route as weed, with possibly a less neurotoxic effect when younger (perhaps just due to the relative infrequency of use). MDMA though can be very hard on the brain if not used in the proper setting and/or if used with other drugs, but it has very little potential for addiction.
Opioids very easily invite addiction, like tobacco, but are illegal to use for this purpose (barring ORT and some other rare cricumstances). Benzos are legal for psychiatric use but can create a heavy dependency with very little use. Bottom line is that abuse of both/either classes will lead to levels of consumption that doctors will not sanction, as they are way past medical doses. But with alcohol, no one's setting a limit. And tobacco.
The cost in money and in functionality becomes way too large to bear when addicted to benzos/opioids. Mostly with opioids, people losing all trust of family and all function saving looking for the next fix. With benzos, one cna be titrated down in a hospital setting. But with addiction the dose raises ever higher in these cases. People either learn to quit/get on replacement therapy, or they pass on. They think they're immortal or that they have it under control, whereas they've lost all control and are being demanded upon by their brain, now under control of the substance.
Ketamine addiction can cost one their liver. Even in these cases, the addiction can be so bad that they keep using. I recall Freud still smoking cigars after a lump of cancer cost him most of his jaw.