Okay, reality check time. Speaking as someone who has actually studied the realities of violence, the rules as written work just fine. You may not want to hear it, but without the physicality to back it up, skill can only do so much when knuckles start flying.
In Real Life an Agility 6 individual, someone who, looking at the stat ratings, is Multiple-Olympic-Gold-Medal level in reflexes and coordination, with Unarmed Combat at 1, got in a couple school-yard brawls, would be able to keep up with a doddering old man (Agility 1), who is a Grand Master martial artist (UC 6). However, in a more realistic scenario of Agil 4 UC 1 vs Agil 2 UC 6, the Grand Master has a clear edge.