Well as Jamo says they are in the way of being a better swordsman with quite a few extra benefits, although they do have a few drawbacks as well. Dwarfs start with 4 HP more, 5 more Stamina, 2 more Counter Atk, +1/1 more Defenses, 2 more Resistance, Hills Knowledge They can gain Immunity to poison starting at level 8. Down sides are they do not start off with Parry although they can start getting it at level 2 and above (+2 upto 6 times) and do not gain access to forced march until level 9
The other great thing are their Guards, Dwarven Clan, that you can hire for hill provinces. These are good especially for Provinces with ore deposits of Iron/Marble/Mithril as they give +5/10/15 Gold which goes towards their upkeep which is 15. The defenders contain a Catapult, 2 Ballista and 8 Dwarfs which have an avg lvl of 5/9/12 which is quite good.