It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Hi

A while ago (say a year or so - I haven't bought that many games in the meantime) I was able to paste URLs for game files which I wanted to download into my NAS download service and let NAS do the work overnight on my not-so-fast Net connection.

That is: I browsed to the list of my GoG games in Firefox, clicked the file I wanted, started download to my laptop, then clicked Copy download link and pasted that link into NAS' DL service. Then I canceled Firefox's download and moved to another file.

My NAS neatly queued all those URLs and downloaded files one by one without the need to keep my poor laptop running throughout the night.

Alas this doesn't seem to work any more. (Same change of protocols due to Galaxy perhaps?)
Does anyone know a workaround for this?

Please don't suggest to just use GoG downloader, 'cause that won't run directly on my NAS so I'd still have to leave my laptop running all the time. (NAS is running some customized Linux version that I can only access via web interface. So even if there perchance exists a Linux version of downloader, I can't install it on the NAS. It's auto-download service does support HTTP, FTP and torrent protocols though - I just give it an URL and it does the rest itself.)

It's interesting that NAS' dl-service still decodes the filename correctly from the URL and queues it, but the actual download never starts. So it shouldn't be a firewall or session-ID/cookie problem IMO.
No posts in this topic were marked as the solution yet. If you can help, add your reply
avatar
JJack: Hi

A while ago (say a year or so - I haven't bought that many games in the meantime) I was able to paste URLs for game files which I wanted to download into my NAS download service and let NAS do the work overnight on my not-so-fast Net connection.

That is: I browsed to the list of my GoG games in Firefox, clicked the file I wanted, started download to my laptop, then clicked Copy download link and pasted that link into NAS' DL service. Then I canceled Firefox's download and moved to another file.

My NAS neatly queued all those URLs and downloaded files one by one without the need to keep my poor laptop running throughout the night.

Alas this doesn't seem to work any more. (Same change of protocols due to Galaxy perhaps?)
Does anyone know a workaround for this?

Please don't suggest to just use GoG downloader, 'cause that won't run directly on my NAS so I'd still have to leave my laptop running all the time. (NAS is running some customized Linux version that I can only access via web interface. So even if there perchance exists a Linux version of downloader, I can't install it on the NAS. It's auto-download service does support HTTP, FTP and torrent protocols though - I just give it an URL and it does the rest itself.)

It's interesting that NAS' dl-service still decodes the filename correctly from the URL and queues it, but the actual download never starts. So it shouldn't be a firewall or session-ID/cookie problem IMO.
I am a bit confused by this. How would your NAS device be authorised to download files from the GOG server, have you logged in on that machine? I haven't looked in to how they handle the authentication, but I know they recently introduced a new "security" feature based on cookies, so if you have that setup it may impact. To be honest though, unless your downloading a vast amount of games, or you only have dial connection, it shouldn't take overnight to download a few games. I can download Dying Light in an hour or so.
avatar
nightcraw1er.488: To be honest though, unless your downloading a vast amount of games, or you only have dial connection, it shouldn't take overnight to download a few games. I can download Dying Light in an hour or so.
Most first-world cities don't even come close to providing the 6MB/s of downstream you're suggesting here.
avatar
nightcraw1er.488: To be honest though, unless your downloading a vast amount of games, or you only have dial connection, it shouldn't take overnight to download a few games. I can download Dying Light in an hour or so.
avatar
a4plz: Most first-world cities don't even come close to providing the 6MB/s of downstream you're suggesting here.
Really, I am stuck out in the middle of nowhere, cant get a phone signal, but still manage to download 6 files at the same time, at anything between 500-1.0mbs (to be fair I do pay more than most for the net though). Even if you say 2 hours, its not that much for the largest game on this site. Most games are less than 1gb and many are far less than that.
That makes your post above quite hard to believe... I don't see how 500-1.0MB/s would let you download Dying Light (a 22GB game) in less than an hour.

I digress though; I only wanted to point out that downloading multiple games at once is generally a multi-hour process.
avatar
JJack:
You can use cliget. It provides an url which you can use with curl or wget. I assume the nas supports some sort of wget.
avatar
nightcraw1er.488: Really, I am stuck out in the middle of nowhere, cant get a phone signal, but still manage to download 6 files at the same time, at anything between 500-1.0mbs (to be fair I do pay more than most for the net though). Even if you say 2 hours, its not that much for the largest game on this site. Most games are less than 1gb and many are far less than that.
Regardless of whether it takes all night or two hours, he's looking to run the download on his NAS so he can shut his laptop off and go to bed.

Frankly, I'm surprised it ever worked for you, without somehow first authenticating on the NAS.
I don't have a good solution for you at hand, but I can help explain the nature of the problem from a technical perspective.

If you wanted to download the installer for, for example, Duke Nukem, then you'd click on a link and your browser would send a request to GOG's web server https://www.gog.com/downlink/duke_nukem/en1installer1 (with your login cookie).

GOG's server would see this link, check if your login is valid and you own the game, and then GOG's server would contact their CDN's server to ask for a download link to be created. The CDN would generate and send GOG a link looking something like this: Now that GOG has a download URL it finally responds to your browser's request with an "HTTP 302 (Found)" response telling your browser that the file can be found at the CDN's download URL.

Your browser then uses this URL to ask the CDN for a the file, and the download commences.

The complication is that the download URLs you get are temporary, and last only for a few minutes before they disappear, so you need to make sure that your NAS device starts downloading right away. If the downloads go on a queue and only start later then they probably won't work at all.
avatar
JJack: I am a bit confused by this. How would your NAS device be authorised to download files from the GOG server, have you logged in on that machine? I haven't looked in to how they handle the authentication, but I know they recently introduced a new "security" feature based on cookies, so if you have that setup it may impact. To be honest though, unless your downloading a vast amount of games, or you only have dial connection, it shouldn't take overnight to download a few games. I can download Dying Light in an hour or so.
I haven't studied the details of GoG's authentication and security, so I assume that some authentication data was passed back to the GoG server in the HTTP GET request (there's quite a lot encoded data in the URL params - after the question mark). Be as it may, it used to work back then.

But if they changed it so that some data is passed via cookies, then of course it wouldn't work any more. :(

As of the bandwidth: right now I'm downloading X3 Terran War (8GB) for about two hours already and it's at about 2G done. Remaining time estimation keeps jumping from 5 to 9 hours.

Sometimes I manage to dl 2 or even 3G per hour, but usually not. It's not connection to my ISP that's the bottleneck but my ISP's intl. connection, I think...

So, the games over 10G are a real pain to download. Still if NAS is guzzling them down slowly but surely it doesn't pain me half as much as having to let the laptop running overnight (and sometimes a better part of the next day too).

Anyway, that cliget thing looks promising. I'll give it a try.
Thanks for the suggestion.

If anyone has some other idea, I'd appreciate it as well.
avatar
Barefoot_Monkey: I don't have a good solution for you at hand, but I can help explain the nature of the problem from a technical perspective.

If you wanted to download the installer for, for example, Duke Nukem, then you'd click on a link and your browser would send a request to GOG's web server https://www.gog.com/downlink/duke_nukem/en1installer1 (with your login cookie).

GOG's server would see this link, check if your login is valid and you own the game, and then GOG's server would contact their CDN's server to ask for a download link to be created. The CDN would generate and send GOG a link looking something like this:
avatar
Barefoot_Monkey: Now that GOG has a download URL it finally responds to your browser's request with an "HTTP 302 (Found)" response telling your browser that the file can be found at the CDN's download URL.

Your browser then uses this URL to ask the CDN for a the file, and the download commences.

The complication is that the download URLs you get are temporary, and last only for a few minutes before they disappear, so you need to make sure that your NAS device starts downloading right away. If the downloads go on a queue and only start later then they probably won't work at all.
Sorry I didn't see your answer while I was writing my previous reply.

Yes, exactly as you said: that temporary URL ...?hexhexhexhexhexhex&fileExtForIe=.exe probably worked because the server had done the authentication already and didn't check cookies or whatever again for the next HTTP GET.

As of the timeout, I believe my NAS sent the request as soon as I copied the URL but interrupted the transfer after it checked that the URL was valid. Then when the first file was downloaded, the second file wasn't requested completely anew but as a resumed file transfer. (Just guessing here.)

However, now it doesn't work any more - not even for the first file, which the NAS requests in the matter of seconds after the Firefox (as much as it takes me top copy/paste the URL). So, something else must've changed... :(
Post edited April 26, 2016 by JJack
avatar
nightcraw1er.488: Really, I am stuck out in the middle of nowhere, cant get a phone signal, but still manage to download 6 files at the same time, at anything between 500-1.0mbs (to be fair I do pay more than most for the net though). Even if you say 2 hours, its not that much for the largest game on this site. Most games are less than 1gb and many are far less than that.
avatar
hummer010: Regardless of whether it takes all night or two hours, he's looking to run the download on his NAS so he can shut his laptop off and go to bed.

Frankly, I'm surprised it ever worked for you, without somehow first authenticating on the NAS.
Well, that was the jist of my post before I got sidetracked with the download speed thing.
avatar
a4plz: That makes your post above quite hard to believe... I don't see how 500-1.0MB/s would let you download Dying Light (a 22GB game) in less than an hour.

I digress though; I only wanted to point out that downloading multiple games at once is generally a multi-hour process.
As I said, it can download 6 parts at the same time, and no I don't have the exact timings to hand, it may be an hour, it might be two, the point was it doesn't take all night. Seriously though this wasn't the main part of my post.
Post edited April 26, 2016 by nightcraw1er.488
https://www.gog.com/forum/general/lgogdownloader_gogdownloader_for_linux

LGOGDownloader is probably what you want. This is a command line tool that downloads GOG games. You have to supply your login details once by using the --login switch which generates a log in cookie.

I periodically get it to just `--download all`.
Post edited April 26, 2016 by TheJoe
avatar
nightcraw1er.488: As I said, it can download 6 parts at the same time, and no I don't have the exact timings to hand, it may be an hour, it might be two, the point was it doesn't take all night. Seriously though this wasn't the main part of my post.
Sorry if we insist on that part, but a stable 0.5-1.0MB/s speed would mean 6-12 hours for a 22GB game, so the download could well take all night. Also, a dialup connection doesn't even reach 100 kbit/s.

If you download 4 parts at the same time, each speed will decrease, unless you have like a 2-4+ MB/s line, like a very good 20Mbit ADSL or more.

TL;DR: your line is better than you think and your speed is not common in the world.
Post edited April 26, 2016 by phaolo
avatar
JJack:
avatar
blotunga: You can use cliget. It provides an url which you can use with curl or wget. I assume the nas supports some sort of wget.
I checked all the NAS' services and documentation and it seems it doesn't support neither wget nor curl. :(

avatar
TheJoe: https://www.gog.com/forum/general/lgogdownloader_gogdownloader_for_linux

LGOGDownloader is probably what you want. This is a command line tool that downloads GOG games. You have to supply your login details once by using the --login switch which generates a log in cookie.

I periodically get it to just `--download all`.
If I could get command line access to the NAS I suppose I could install that package. Unfortunately I can only use web interface for it...

However, I discovered that I can install pyLoad as an additional package.

Now, I don't know a thing about pyLoad - other than it is meant to download from protected servers, requiring logging in. There is a ton of pyLoad plugins available for different services, alas I found none for GoG...

If I knew any Python I could write my own plugin I suppose, alas I don't.
If anyone here can at least give me some hint how to make such plug-in for it, I think I can learn enough Python to muddle up something though...

I'm sure it would be useful to anyone interested in using pyLoad for GoG downloads.
What do you think?
Re-format the NAS and install OpenMediaVault on it. Then you have root shell and webinterface. And its fully Debian.
avatar
JJack: snip
So, yeah. I'd get a better OS for your NAS to be honest. You want command line access, get a NAS OS (like FreeNAS or the aforementioned OpenMediaVault or something else - bearing in mind that FreeNAS is BSD) and see if you can get SSH installed on it or some such.

You're extremely limited without it.

It should be quite possible to install a new OS on your NAS without affecting the data on the drives. Just mount them in the new OS!

Failing that, you could potentially mount your NAS over NFS or something and run lgogdownloader on a client machine targeting the mount.