mrkgnao: I have obviously been unclear.
The log is a text file.
There is no app, no database, no buttons, no nothing.
Just a text file that is emailed to me by MaGog after every run (i.e. every 6 hours).
And that text file is currently 3-3.5 MB in size per run (i.e. about 30,000 to 35,000 lines).
I'm a simple cat with simple tastes.
The only tool I use to go through the log is vim (vi improved).
ssokolow: Ahh. I assumed you were putting it all into whatever database you use to back MaGog search and then generating reports from that.
Does the code which generates the e-mail report have a structured enough view of the data to sort by game ID and then add/remove status so each dump would be ordered like this?
Game 1, removed file A.zip
Game 1, added file B.zip
Game 2, removed file A.exe
Game 2, removed file B.exe
Game 2, added file C.exe
...
MaGog doesn't have a database, unless you consider a Perl hash table a form of database.
As for the log file, it is 99% debug information that tells me what MaGog has been doing at every step of its ~65 minute run --- scanning the catalogue, scanning the game pages, scanning the downloadable files, scanning the wiki, checking regional prices, checking regional titles, etc. (very useful for a quick recovery every time GOG changes its formats and breaks something in MaGog, or when MaGog itself has a bug).
The remaining 1% are changes, errors and warnings (all identified by the famous "NOTE!") sparsely interspersed among the debug lines.
Changing the chronological order of lines within the log will make it more difficult to identify breakage when it occurs, hence my hesitancy to sort anything in the file.
I usually copy notes from the log (one or more at a time) in the order I come across them in the log, but I very often paste them in a different order (one that I consider more useful to the readers of that specific post), so my workflow already has "natural" on-the-fly reordering as part of the copy-paste operation. I just need to also reorder the REMOVED and ADDED lines. Zero effort.