Didn't pay attention during character creation and the game chose default female voice for my male character. Is there any way to fix this immersion breaker?

no your best option is to roll up another character

you would need to edit the game save which Larian Studios doesn't like so the various 3rd party mod tools are more likely to bugger than fix