I think people freak out about smoking weed too much, if you're near a pretty busy place (where cops do NOT frequent) you're probably cool smoking a joint, a blunt, or even a bowl because its easier to cap it and hide it. But in my hood you really can't because there's always cops cruising around trying to fuck with people and search them. I always smoke on the city steps, my house, or this abandoned building which we'd probably get pinned with B&E if we got caught.
Normal people probably won't bother you, the only times I smoke walking around is at like 7:00 AM when walking to school, nobody says shit to me besides if I see a friend who wants to hit my weed.