My character is frquently exhausted and fatigued. He is not oer his weight allowance, has no spells or potions affecting him.
Guide me where to look to fix this issue

You may want to check party encumbrance level as well, as it affects fatigue. When a character could become fatigued, he would make a fortitude save against it, so increase your CON and fortitude to avoid getting this condition.