Grombart: Can you actually defeat a pack of wolves or a band of orcs WITHOUT backjumping? O_o
Once you get powerful enough, definitely. Getting better weapons and armour will help, but upgrading the critical hit and damage boost passive skills is crucial. I've reached a point where I can literally kill packs of wolves with a few wide sweeps and take on a half-dozen orcs by randomly slashing and fireballing whoever is closest without too much concern for my safety.
One crucial thing when fighting bandits and humanoids is to eliminate archers first--even if you take a lot of melee damage while doing so--since they can do a ton of damage to you from a long distance (especially if there are multiple archers). Archers typically run away when you chase them but you can throw a fireball or whatnot to temporarily stun them. Once you get within range and start unleashing a sequence of blows they can't move any more and will go down quickly (especially since they seem to have weaker armour than the rest). The same goes for magic users, if they have any; they deal heavy damage but go down very quickly.
Also bear in mind that you can outrun seemingly all enemies in the game, so if you're in trouble you can pull away from your pursuers for a moment to heal up or whatnot (especially crucial if you're using healing spells, which require you to be temporarily stationary).
EDIT: if you favour magic over melee it's a bit more complicated. As a magic user you need to track down booster cards (Mana Saver etc.), but each trader has only a couple and enemies and containers drop them very rarely (I have dozens and dozens of spell cards from containers and enemies but only got a couple of boosters that way). You will also want to buy up all the cards for your chosen spells--some of which will randomly drop as loot--and stack them to make the spell as powerful as possible. It's better to cast a few powerful spell attacks to take down your foes rather than casting multiple weak ones, even if you have enough mana to spam them repeatedly (although having a large mana pool is of course very useful). Similarly, at high levels the healing spell is almost worthless unless you stack some boosters or upgrades with it.