That depends very much on how your attribute got impaired in the first place.
Drug side or after effects take as long as the drugs original duration
Decrease attribute takes as long as the spell is sustained
Nerve strike takes one hour to heal 1 point
Burn out from drug takes as long as you need to raise it back with karma
And I'm sure there are many more ways to lose an attribute point...