Is there any possibility to chance companions without having to travel back to the tavern?
I just met Grobnar and I'm forced to take him with me, but I would prefer Quara instead.

This would be great, my character is a Bard (human) and she doesn't need Gronar + he's too slow...

Whether it is a good or a bad idea, I can't say. But the authors are trying to tell a specific story about each of your characters. In the few times that they require you to have a particular hench with you it means you are about to see some content that pertains to that character. And there are probably dialogs with that character that will refer to it (that won't make any sense if the character hasn't been exposed to the content).

I'd recommend that you just go with it. It never lasts for very long, anyway.

With Grobnar, it sure seems like it lasts forever.

You do realize that after you meet Grobnar, right before you exit that zone, you get the party roster to switch out party members, right? And that you could also use the "rs kr_roster_edit" cheat to swap out party members at any given time?

"rs kr_roster_edit" That's exactly what I searched for, thank you very much.

Could've just looked up console commands for the game.

Edit: You could also use "rs ga_party_limit(13)" to increase the party size so you can take everybody along.