It certainly doesn't help, no.
Think of it as modern-day Meth in a way. You see a skinny guy with picked scabs all over, that's blinky and twitchy? Odds are he's on Meth. MOST of the time, they go through life with people just sorta backinga way from them, but when they encounter police, they know they need to not be in the line of sight.
MbW, same thing. Most people just see a twitchy guy and assume "He's on something" but won't call the cops as long as you're in middle class or lower areas. If the cops *do* show up, however, or you go where they are, then you're gonna be flagged, quickly. On teh other hand, if you live in the Barrens, hang out with gangers, attend dive bars, and generally only mingle with the undesirable parts of society, you'll be fine.