Of note, I believe that if you add a new 1st level character to your party, the rest of your party will start earning more XP, because the game follows the 3rd edition rule of basing XP on average party level. This also means that if you choose not to level someone up when able, you will get more XP than if you did gain the level.
Whether you consider this fair is up to you. Personally, I blame the ruleset; there's no bug in the game to exploit, but the underlying game mechanics are flawed.
3.5e is a bit more sensible in that the game bases XP on each individual character's level. There's also supposed to be a rule that prevents you from being able to gain more XP than you should, but it is not actually implemented in this game or any other Bioware/Black Isle AD&D game. (It is implemented in Temple of Elemental Evil, where the rule helps mitigate this sort of exploit, and in the SSI Gold Box games, where (IMO) it does more harm than good since you can only level up in specific locations.)