On page 51 of Runner's Companion, it talks about people being enthralled with dryads "even when, objectively, the dryad is aesthetically unremarkable." So a troll with average (high for a troll) Charisma would definitely get the fluff benefits of glamour - maybe people would be likelier to describe him as "vibrant" or something rather than "graceful", but they would definitely feel the effect of the quality.