Banished. Yes, there is some idle worker issues. They may just be 'resting', but I'm not totally certain. Sometimes the idlers will decide to do some work on their own. If you have farmers (and who doesn't) they will idle most/all of winter, so try re-assigning them to different jobs while there is snow on the ground. Do this also for jobs that hit their max production until the amount in storage drops.
My only other real annoyance, is that when picking up resources, they have to take them to a storage area first, even though there might be a job site that needs it on the way and would be faster to drop there.