Berzerk2002: That could be a problem with the Thumbnail Cache on WIndows not updating correctly. I had this issue a couple times too some time ago. After cleaning the cache and restarting Windows it was usually working again.
Cleaned the cache, and even reinstalled the game, no change. Looking in the game folder it would appear that those icon files were just not included in the download itself. I could check if the stand alone installer versions include it but I just don't feel like downloading a game for the 3rd time today.