are you taxing them hard?
is there a enermy near by who may be pocking them into it?
is your overall empire stable? i.e, 1-3 not in the -
are you fighting a war?
best options - in order;
sue for peace
get your empire stable by killing a goat or whatever... at least +1
grab a blessing that builds man power or at least something which makes people happy
put a leader in the area that has good civic and tell him to grow man power
bring in trade if you can... any town with a port should have at least one ship in the port... also a good way to give jobs to excess character
arrange the people into better places i.e, lots of slaves = build another farm for them & lots of farms but no slaves = move some in from the other areas... don't waist money on troops you don't need yet, put it into making things better
don't build a fort however don't remove a fort until the area is 100 happy... at that point you may rip it down but don't leave a big area unguarded near a boarder or the ai will come calling