It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussionGOGcli GUI ... frontend downloader and validator(188 posts)(188 posts)
(188 posts)
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
This is my favourite topic
Posted March 20, 2021
Here's a full list of other names (game titles) that I have been having an issue with. The ones in bold are the problem ones. I have been using my new TAG button and process to help me keep track.

NOTE - I only need to manually remove the full entry that contains each bold title. And then I use my fixed GUI to reinstate the proper version of that bold title entry. I am not removing the full entries where game titles don't fit inside another, only the entries that contain multiple games in them.

2021-03-20 10:13:28 : Tagged = American Conquest - Fight Back
2021-03-20 10:13:33 : Tagged = American Conquest
2021-03-20 10:14:02 : Tagged = AquaNox 2: Revelation
2021-03-20 10:14:07 : Tagged = AquaNox
2021-03-20 10:14:20 : Tagged = ArcaniA: Fall of Setarrif
2021-03-20 10:14:24 : Tagged = ArcaniA
2021-03-20 10:14:39 : Tagged = Army Men II
2021-03-20 10:14:43 : Tagged = Army Men RTS
2021-03-20 10:14:47 : Tagged = Army Men: Toys In Space
2021-03-20 10:14:51 : Tagged = Army Men: World War
2021-03-20 10:14:55 : Tagged = Army Men
2021-03-20 10:16:00 : Tagged = BioShock™ 2 Remastered
2021-03-20 10:16:04 : Tagged = BioShock™ Remastered
2021-03-20 10:16:08 : Tagged = BioShock™
2021-03-20 10:16:31 : Tagged = Blitzkrieg 2 - Fall of the Reich
2021-03-20 10:16:35 : Tagged = Blitzkrieg 2 - Liberation
2021-03-20 10:16:39 : Tagged = Blitzkrieg 2
2021-03-20 10:16:48 : Tagged = Blitzkrieg: Burning Horizon - Rolling Thunder - Iron Division
2021-03-20 10:16:52 : Tagged = Blitzkrieg
2021-03-20 10:17:12 : Tagged = Breach & Clear: DEADline Rebirth
2021-03-20 10:17:16 : Tagged = Breach & Clear
2021-03-20 10:17:42 : Tagged = Butcher Demo
2021-03-20 10:17:46 : Tagged = Butcher
2021-03-20 10:17:56 : Tagged = Call of Juarez
2021-03-20 10:18:01 : Tagged = Call of Juarez: Gunslinger
2021-03-20 10:18:05 : Tagged = Call of Juarez: Bound in Blood
2021-03-20 10:19:15 : Tagged = Cultures 2
2021-03-20 10:19:19 : Tagged = Cultures: 8th Wonder of the World
2021-03-20 10:19:23 : Tagged = Cultures: Northland
2021-03-20 10:19:27 : Tagged = Cultures
2021-03-20 10:19:59 : Tagged = Deadly Dozen Pacific Theater
2021-03-20 10:20:03 : Tagged = Deadly Dozen
2021-03-20 10:20:14 : Tagged = Death to Spies: Moment of Truth
2021-03-20 10:20:18 : Tagged = Death to Spies
2021-03-20 10:20:31 : Tagged = Delta Force 2
2021-03-20 10:20:35 : Tagged = Delta Force Xtreme
2021-03-20 10:20:38 : Tagged = Delta Force: Black Hawk Down Platinum Pack
2021-03-20 10:20:42 : Tagged = Delta Force: Land Warrior
2021-03-20 10:20:46 : Tagged = Delta Force: Task Force Dagger
2021-03-20 10:20:50 : Tagged = Delta Force
2021-03-20 10:21:00 : Tagged = Deponia 2: Chaos on Deponia
2021-03-20 10:21:03 : Tagged = Deponia 3: Goodbye Deponia
2021-03-20 10:21:07 : Tagged = Deponia 4: Deponia Doomsday
2021-03-20 10:21:12 : Tagged = Deponia
2021-03-20 10:21:19 : Tagged = Descent 2
2021-03-20 10:21:23 : Tagged = Descent 3 + Mercenary
2021-03-20 10:21:27 : Tagged = Descent: Freespace Battle Pack
2021-03-20 10:21:31 : Tagged = Descent
2021-03-20 10:22:07 : Tagged = Dex Demo
2021-03-20 10:22:11 : Tagged = Dex
2021-03-20 10:23:07 : Tagged = Dungeon Siege II
2021-03-20 10:23:11 : Tagged = Dungeon Siege III
2021-03-20 10:23:15 : Tagged = Dungeon Siege
2021-03-20 10:24:15 : Tagged = Eisenwald: Blood of November
2021-03-20 10:24:20 : Tagged = Ember
2021-03-20 10:24:44 : Tagged = Etherlords 2
2021-03-20 10:24:48 : Tagged = Etherlords
2021-03-20 10:26:30 : Tagged = Fallout 2
2021-03-20 10:26:34 : Tagged = Fallout 3: Game of the Year Edition
2021-03-20 10:26:38 : Tagged = Fallout Tactics
2021-03-20 10:26:42 : Tagged = Fallout: New Vegas Ultimate Edition
2021-03-20 10:26:46 : Tagged = Fallout
2021-03-20 10:27:12 : Tagged = Far Cry® 2: Fortune's Edition
2021-03-20 10:27:17 : Tagged = Far Cry®
2021-03-20 10:27:27 : Tagged = Fantasy General II: Prologue
2021-03-20 10:27:31 : Tagged = Fantasy General
2021-03-20 10:27:43 : Tagged = Figment: Creed Valley Demo
2021-03-20 10:27:47 : Tagged = Figment
2021-03-20 10:27:59 : Tagged = FlatOut 2
2021-03-20 10:28:03 : Tagged = FlatOut
2021-03-20 10:28:25 : Tagged = Freedom Force vs. the 3rd Reich
2021-03-20 10:28:30 : Tagged = Freedom Force
2021-03-20 10:29:04 : Tagged = Full Spectrum Warrior: Ten Hammers
2021-03-20 10:29:09 : Tagged = Full Spectrum Warrior
2021-03-20 10:29:54 : Tagged = Gothic 2 Gold Edition
2021-03-20 10:29:57 : Tagged = Gothic 3: Forsaken Gods Enhanced Edition
2021-03-20 10:30:01 : Tagged = Gothic 3
2021-03-20 10:30:04 : Tagged = Gothic
2021-03-20 10:30:48 : Tagged = Hello Neighbor Alpha Version
2021-03-20 10:30:53 : Tagged = Hello Neighbor
2021-03-20 10:31:25 : Tagged = Heroes of Might and Magic®
2021-03-20 10:31:31 : Tagged = Heroes of Might and Magic® 2: Gold
2021-03-20 10:31:35 : Tagged = Heroes of Might and Magic® 3: Complete
2021-03-20 10:31:39 : Tagged = Heroes of Might and Magic® 4: Complete
2021-03-20 10:32:18 : Tagged = Hotline Miami 2: Wrong Number - Digital Comics
2021-03-20 10:32:22 : Tagged = Hotline Miami
I am in the process of fixing these both manually and with my fixed GUI, now available at GitHub as v1.1.

A lot of manifest entries for me to correct, but luckily I hadn't gone much past Hotline Miami retrieving them with my new MANIFEST ALL feature. I am tempted to just wipe all entries out and start again, but I am checking each as I go just to be sure I have covered everything with my fixes. I've made it as far as Deadly Dozen with my manifest fixes so far.
Post edited March 20, 2021 by Timboli
Posted March 20, 2021
HOT OFF THE PRESS - GOGcli GUI v1.1 has been released.

Download - https://github.com/Twombs/GOGcli-GUI/releases/tag/v1.1

Further Information - https://github.com/Twombs/GOGcli-GUI

It contains important BUGFIXES and some new features and improvements.

EDIT - Hopefully I will get around to updating the Tutorial for the new features in the next day or so.
Post edited March 20, 2021 by Timboli
Posted March 20, 2021
avatar
Timboli: HOT OFF THE PRESS - GOGcli GUI v1.1 has been released.

Download - https://github.com/Twombs/GOGcli-GUI/releases/tag/v1.1

Further Information - https://github.com/Twombs/GOGcli-GUI

It contains important BUGFIXES and some new features and improvements.

EDIT - Hopefully I will get around to updating the Tutorial for the new features in the next day or so.
I'll grab 1.1 tomorrow and delete the manifest. Start fresh. I'll give you a heads up if I run into issues. Thanks again for the work.
Posted March 20, 2021
avatar
TerriblePurpose: Tried DLing a couple games last night and got FAILED errors on all files.

Batman:Arkham Origins, which I believe has a Seasons Pass named similarly, and Battle Chasers: Nightwar. The latter doesn't have anything that would seemingly cause an issue but there's a placeholder in my library for Battle Chasers: Nightwar with an additional name tag. This was a placeholder that was added when I redeemed a group of games gifted by GOG to the 6 of us that went to Poland about 4 years ago.
Alas I was wrong and do not have Battle Chasers: Nightwar, I just have Chaser. So could not test that.

I do have Batman:Arkham Origins with the Seasons Pass, but it is all one entry on my list, as Batman:Arkham Origins.

Not wanting to download the huge files, I just downloaded the two small EXE files and they downloaded okay. You said they all failed for you. See my attached screenshot.

Your Log record for those downloads should show where the failures occurred. Did they download okay, but fail the MD5 check?

P.S. Not sure entirely how the placeholder situation works, but in my experience you get separate library (title) entries for combined games.
Attachments:
batman.png (36 Kb)
Posted March 21, 2021
I've done another update to GOGcli GUI, but not a release, as a new feature I've added is not yet fully implemented.

This new feature involves comparison checking between existing files in a game folder with those in the manifest, and vice-a-versa.

At the moment, only the COMPARE ONE GAME code has been completed and implemented. The COMPARE ALL GAMES alternative is not yet coded.

Basically, I have given the 'CHECK or GET GAMES LIST' button two right-click menu options.

COMPARE ONE GAME
COMPARE ALL GAMES

And when selected, the button text changes to one of those, and the resulting process enabled for use.

Basically this is a simple quick comparison check, that doesn't do validation checking (MD5, Zip) of files, but does check existence and file size. So if your manifest is up-to-date for the selected game, it provides information that may help you work out whether you are missing an update (installer, patch, etc) ... or whether you may need to do further validation checking to be completely sure (same file size isn't a guarantee of being exactly the same). Sub-folders of the game folder are automatically checked as well. Beyond any obvious update change, this feature also advises where a change may have occurred (i.e. something removed or added).

If you want to use this new feature before the next release, then please feel free to download the current EXE file and overwrite your existing one with it.

EXE Download - https://github.com/Twombs/GOGcli-GUI/blob/main/GOGcli GUI.exe

Screenshot 1 - Tutor_26.png

Screenshot 2 - Tutor_27.png

Screenshot 3 - Tutor_28.png

You get a simple dialog result, and the same detail can be found in the Log file. I may improve this, as no doubt I will need to when processing all games, which will probably require some kind of tabled report.
Post edited March 21, 2021 by Timboli
Posted March 22, 2021
GOGcli GUI v1.2 has been released.

WARNING - I have not yet tested v0.10.0 of gogcli.exe with the GOGcli GUI. It is possible latest changes to manifest query and returned entries, due to dealing with duplicates, may have broken my code. I will look into this shortly. I advise sticking to v0.9.0 of gogcli.exe until I give the all clear or provide a GUI update, if needed.

Download - https://github.com/Twombs/GOGcli-GUI/releases/tag/v1.2

Further Information - https://github.com/Twombs/GOGcli-GUI

It contains a nice new comparison feature, improvements and some minor bugfixes.

Still haven't gotten around to updating the Tutorial for the new features, but hopefully soon.

Notes about the new comparison feature
There is no browsing for this, unlike for Validate, other than browsing to set your main game folder.
For the comparing process to work, you need to be using either the game Title or Slug for each game's folder name.
The process is currently set to abort at the first non-existent game folder if you are using the COMPARE ALL GAMES option. In a future update, I will probably make that optional, as well as add some other settings.

At the moment you get a simple dialog report, with the same essential detail in the Log file, when doing the COMPARE ONE GAME option. However, with the COMPARE ALL GAMES option, you get a full report in a file called 'Comparisons.txt', which is displayed in another 'Manifest Comparison Report' GUI, while also producing a minimal report in the Log file.

That GUI is a standalone program called 'Report.exe', and can be run independently of GOGcli GUI or through the 'Comparison Report' right-click menu option of the 'Games' list. Being independent means it can be used as a useful guide.

The report shows basic columns, which can be sorted by clicking on each column header.
The first 3 columns should be self evident, and perhaps even the last, Date, which is the date the file was checked.
Manifest column means the file can be found in the manifest, yes or no.
Folder column means the file exists in the game folder or a sub-folder of that, yes or no.
Size column will either show 'pass' or 'fail' if file and size exist in the manifest for the file, or if missing either a 'no' (if file exists in manifest, but not size) or NA (not applicable, neither file or size are in the manifest).

To be a bit more helpful, if a file exists in the manifest, but not in the game folder, that row is colored red. This probably indicates you are missing an update or patch etc for that game.

I am thinking of adding at least one more row color, probably orange, to indicate a mismatch with size.

Aside from special row color, the row color alternates per game, repeatedly using two standard colors.

You can stop and restart (continue) the COMPARE ALL GAMES option between games, by checking the provided STOP checkbox, which appears under the COMPARE button when the process starts. You can set which game to start at.

See the screenshots via links on the Release notes.
Post edited March 22, 2021 by Timboli
Posted March 23, 2021
I've now had a look at the Help commands for gogcli.exe v0.10.0 and all appears to be okay and GOGcli GUI (after a little fix) should not be impacted by recent changes.

I also specifically checked out one game, doing a generate and replace of an existing game manifest entry, and then downloaded all files, and nothing was amiss.

-----------------------------------------------------------------------------------

GOGcli GUI v1.3 has been released.

Download - https://github.com/Twombs/GOGcli-GUI/releases/tag/v1.3

Further Information - https://github.com/Twombs/GOGcli-GUI

It contains improvements to the comparison feature, as well as to gogcli.exe version checking.

And still haven't gotten around to updating the Tutorial for the new features, but hopefully soon.

Notes about the improvements
The compare process for 'COMPARE ALL GAMES' has had some improvements. Missing game folders can now be optionally ignored and skipped over, same for missing manifest entries, and both of those can optionally be (recorded) reported on. The 'Manifest Comparison Report' GUI (Report.exe) has been updated to support the new row colors and reporting.

The 'Games' list now has an additional right-click menu option for the Compare process, called 'Comparison Settings', which gives access to 8 comparison settings, and they control the compare process and reporting.
Ignore Missing Folders
Report Missing Folders
Ignore Missing Manifest Entry
Report Missing Manifest Entry
Missing Files (RED)
Wrong Size (ORANGE)
No Size (YELLOW)
No Manifest Entry (AQUA)

One of the added benefits of doing a fairly quick Comparison process, is the reveal of missing manifest entries, if you have the required 'Ignore' and 'Report' options enabled to allow that.

The compare options are a great companion to the validate ones, if run before validate, potentially saving a lot of time and reducing what you need to validate.

The version checking of 'gogcli.exe' has been updated to include recognition for v0.9.0 and v0.10.0, and includes an improvement in regard to any unrecognized version, presenting the user with a WARNING query etc.

Updated the 'Language' key to now also be a 'Languages' key, to support 'gogcli.exe v0.10.0'.
Post edited March 23, 2021 by Timboli
Posted March 23, 2021
avatar
Timboli: I've now had a look at the Help commands for gogcli.exe v0.10.0 and all appears to be okay and GOGcli GUI should not be impacted by recent changes.

...

The version checking of 'gogcli.exe' has been updated to include recognition for v0.9.0 and v0.10.0, and includes an improvement in regard to any unrecognized version, presenting the user with a WARNING query etc.
The format of the manifest changed. The language for a manifest's game is now plural and an array. Not sure how it will impact your tool, but you probably want to double-check that just to be sure.

Otherwise, there is a migration command to migrate manifests from 0.9.0 to 0.10.0, but since you don't use the manifest after the initial generation, that might be of limited use to you.

You probably mostly want to watch out when you initially parse the manifest.
Post edited March 23, 2021 by Magnitus
Posted March 23, 2021
avatar
Magnitus: You probably mostly want to watch out when you initially parse the manifest.
Having had a look at your changes, it doesn't seem to me that my GUI is impacted.

When I parse or extract a manifest, my code is really only concerned with the "Id": line, which it splits on.

Beyond that, I am just reading entries that relate to title, filename, size, MD5, download URL and maybe a couple more, but from a quick search of my code, I don't see .... bugger, I just realized I searched with "Languages": and not "Language":

Damn it, back soon.

EDIT
A quick check, and phew it seems I am just reading the 'Language' value from the manifest entry and storing it, but not actually using it for anything at this point. So no impact, other than a missing stored entry if using gogcli.exe v0.10.0. I am now looking into doing a fix for storing 'Languages' as well though.

EDIT 2
All fixed, re-uploading v1.3 shortly. DONE ... see two posts back.
Post edited March 23, 2021 by Timboli
Posted March 23, 2021
avatar
Timboli: ...
Yes, I changed it from "Language" to "Languages" (to reflect the new plural form of the value), but that's an easy fix.

The more challenging fix is that it is now an array instead of a string.

Previously, each file had a single language tag. However, someone rightly pointed out to me that GOG will list the exact same file several times under many languages.

At that point, I could either accept the inefficiency of having the same file several time, for each language, or compress the near identical entries into one, but then that also meant compressing all the language tags into one, hence it becoming an array instead of a string.
Post edited March 23, 2021 by Magnitus
Posted March 23, 2021
avatar
Timboli: EDIT 2
All fixed, re-uploading v1.3 shortly. DONE ... see two posts back.
Haven't had a chance to do any updating or testing over the last few days. Apologies for not getting on that when I said I would. Had a few separate issues ongoing with both computers and life in general.

I'll see about grabbing 1.3 and the latest gogcli as well. Going to install on my gaming rig as my other PC has been completely borked by, I believe, one of MS's latest updates. Going to have to reinstall the OS.

I'll update as I can and let you know if I find any issues.

Cheers, once again, for your continuing work on this (to both you and Magnitus)
Posted March 23, 2021
avatar
TerriblePurpose: Haven't had a chance to do any updating or testing over the last few days. Apologies for not getting on that when I said I would. Had a few separate issues ongoing with both computers and life in general.

I'll see about grabbing 1.3 and the latest gogcli as well. Going to install on my gaming rig as my other PC has been completely borked by, I believe, one of MS's latest updates. Going to have to reinstall the OS.

I'll update as I can and let you know if I find any issues.

Cheers, once again, for your continuing work on this (to both you and Magnitus)
No worries, no hurry.

----------------------------------------------------------------------

As it turns out, with some heavy use of my GUI in the last few hours, I discovered a few bugs, one that crashed the program. I have fixed them all, but not done a full release yet. Please grab the latest EXE file and overwrite your existing (v1.3) one.

Download the EXE - GOGcli GUI.exe

Bugfix Details - Latest Changes.txt

This is mostly a bugfix update, but also an improvement to the 'Game Files Selector' window usage.

P.S. Make sure to install v1.3 first, as another required EXE file exists in the zip file.
Post edited March 23, 2021 by Timboli
Posted March 24, 2021
GOGcli GUI v1.4 has been released.

Download - https://github.com/Twombs/GOGcli-GUI/releases/tag/v1.4

Further Information - https://github.com/Twombs/GOGcli-GUI

This update has the IMPORTANT BUGFIXES mentioned earlier, plus some nice improvements.

Notes about duplicate file names
As you can see in the following screenshot, only one of the four games shown, displays EXTRA game files. In all 4 cases the games have the same bunch of EXTRA files.

gogcli_selector_12.png

The four games are actually 4 chapters of the same game (Wallace & Gromit's Grand Adventure), but GOG lists them as separate games in your library.

In all cases that I am aware, and certainly in this one, all those extra game files are just duplicates across the four chapters, so no point downloading each more than once.

I've now changed my GUI to exclude duplicates specifically, based on file name. It was doing so originally, but just overwriting previous same name entries when building the DOWNLOAD LIST. Now a file name is checked for, and if existing on the list, skipped.

I may look into this issue further, but my current method seems the right approach. However, if ever in doubt, then just download such games individually, and not with the DOWNLOAD LIST option. Or do that first, and then do the missed ones afterward, individually per game.
Post edited March 24, 2021 by Timboli
Posted March 26, 2021
Huston we have a problem ... or rather, I do .... or my GUI specifically ... as is.

There's always something.

Anyway, I have belatedly realized that a change of file name doesn't mean a file isn't downloading or non existent.

So now I see and get the relevance of the 'url-path-info' command.

I did not occur to me, to remember that the file URL is just a placeholder, until just now when I discovered an issue.

/downloads/tasomachi_behind_the_twilight_demo/en1installer0
does not necessarily stand for
setup_tasomachi_behind_the_twilight_-_demo_1.00_(64bit)_(45601).exe
even though in my manifest, they are linked together.
The URL can also stand for an updated version of that file
setup_tasomachi_behind_the_twilight_-_demo_1.01_(64bit)_(45796).exe
Note the change from 1.00 to 1.01 and (45601) to (45796).

This meant, that my GUI downloaded the latest file, but because it did not match the file name on record in my manifest, couldn't detect it while it was downloading or discover it upon completion .... OOPS.

So yes I had a dumb moment, back when I first coded things, and did not realize the implication.

That means I now have to do a check of each file ... or just make manifest entry replacement mandatory when downloading. Of course, anyone with that last option enabled on the SETUP window, would not get this problem.

------------------------------------------------

Here's what happened, that made me realize this issue.

A couple of days ago, I grabbed 13 demos from GOG to my GOG library.
At the time, as usual, I downloaded them virtually straight away ... or at least I thought I did.
Today I realized I'd only done the first 10 of the 13.
So today I downloaded the last 3 ... or tried to.

I had my games folder window open, so I could see there was a file downloading, but my GUI wasn't reporting anything, and when the process finished it said it could not find the file. Yet I could see a file and it wasn't zero bytes.

Even though GOG only released the game (demo) a few days ago, it had an update already, and that is what my GUI downloaded, but because the file name was now slightly different, my GUI could not detect it.

The first thing I did, was replace the manifest entry for that game and try again. And it now worked just fine.

What surprised me though, was that a file had actually downloaded first time around, until I recalled the URL was just a placeholder ... gawd what a dummy. As Homer Simpson would say - Doh!

Anyway, that means I need to add a fix to GOGcli GUI for this issue, to cater for it.

My apologies if anyone was bitten by this ... though it can be avoided by enabling that option I mentioned.

Normally I would use that option, if the manifest entry for a game I was about to download, had been added or updated a while ago. However I wasn't expecting a file name change after just a few days, so I did not do that, and the issue mentioned above, bit me.

-------------------------------------------------------

While that first file I downloaded, did not have its size checked or have an MD5 (checksum) check, you can still do those things independently .... once you have done a manifest update for that game entry. So obviously no need to re-download any such file.
Post edited March 26, 2021 by Timboli
Posted March 26, 2021
avatar
Timboli: GOGcli GUI v1.4 has been released.
Hey, just a heads up. I'm using this version and having no issues with multiple DLs, but there may be a problem with titles with the '&' character in the name. Twice so far I've had the app report unable to retrieve info (or files, I can't recall the exact wording). Both titles had this character in the name

first one was Beyond Good & Evil
other was Breach & Clear

I'll test a third one as well.

On a side note, I don't seem to be getting the DL speed with your app that I do either through the browser or through Galaxy. I have a fiber connection, and via Galaxy I'm getting up to 70+ Mbs/sec DL speeds.

GOGcli GUI seems to consistently be far slower than 10 Mbs (Currently DLing through it and it's reporting 4.6 Mbs/sec) Any ideas with that?

Cheers.
Pages:
1
2
3
4
5
6
7
8
9
10
11
12
13
This is my favourite topic
Community
General discussionGOGcli GUI ... frontend downloader and validator(188 posts)(188 posts)
(188 posts)