Simply remove the libogg file from the "lib" folder where Little Inferno is installed. As long as you have a newer version of libogg installed (and why wouldn't you?) the game will use that instead of the old broken one.

Especially useful since ALSA is all but outmoded these days.

In my case it gives another result (and does not launch):
./LittleInferno.bin.x86: error while loading shared libraries: libcurl.so.4: cannot open shared object file: No such file or directory

On my 64bit distribution, I added those packages :
apt install libcurl4:i386 libopenal1:i386 pipewire-alsa:i386

Then the game is launching without messing with lib folder inside game files.

By the way, hope to see the new Little Inferno Ho Ho Holiday expansion on GOG, maybe with a 64 bit version ?