I read about fixing the resolution to be full screen and all, but is there a way to remove the black box that surrounds the actual gameplay?

Edit:With Nvidia Cpanel.

Try going to Display->Adjust desktop size and position. There should be a section that reads
2. When using a resolution lower than my display's native resolution
Set the option to either "Use NVIDIA scaling" or "Use NVIDIA scaling with fixed-aspect ratio".
You may need to change something in the dosbox configuration file as well, but I think this should be enough.

This doesn't seem to change it.
Can you only run this in 800x600? , if it goes full screen, I get large black borders with a small scaled game or running it in windowed mode the size never changes just w/o the borders, has anyone been able to run these at full screen without the black borders?

Attached is the game in windows mode, but in full screen mode, the image never gets bigger, just creates the black border.

In the Nvidia control panel, look for options related to scaling. I think they're called "flat panel scaling options" or something similar. It looks like you currently have scaling disabled. Turn it on. There will be a few options, but I recommend using the one that says "preserve aspect ratio". That way the game will have black bars on the sides instead of being stretched out horizontally which looks really weird. It should still fill the entire vertical space of your monitor though.

There is a chance that you can do this using your actual monitor's settings instead, but usually it's done through the Nvidia (or AMD) control panel.

It might also be worth looking at the unofficial patches, which are discussed in sticky threads. I've never used them, but they might let you increase the game's resolution.

Using the monitor to do the scaling fixed it, thanks for the input.