I get that you can only have 1 healing potion on the belt at any one time, but I think since Diablo came out in 1996, the potion slot has automatically been replenished.

But not in this game?

not in this game, no.
But you won't need any potions soon enough, so that's a minor thing.