Yeah, armor should have roll effects
If someone swings with a D10 and someone defends with a D6, but have say, a well-made chain hauberk, then their defense would go up by 4 (or something, again, an example), then if the sword is made for piercing armor of this kind, it would add +2 and depending on their skill (already evidenced by what D# they use, they would inevitably win. It would force people to actually train and have value to armor.
It's better than just straight rolling, which leads to arguments and power gaming and is no better to simply fighting without rolls.