I started as "Wanderer" and set up an outpost near the town.

Where can I grow any food?
I tried the green fruits, but they have only 8% success.

Do I need to try something like wheat?

Which town / biome?

If its desert, then cactus is a good bet if you have enough water.