Discussion of the download / upload tools

[halvar]

Originally Posted by Denaniel

I tried that, using vef-imagerescue 1.26, but the csv file only lists the imagebam and imagebox links. It ignores all other imagehost links.

Ah, right, I forgot it only recognizes imgbox and imagebam. As a last resort you could do a full text search for the link in the downloaded html files. For example Notepad++ has a 'find in files' option (https://notepad-plus-plus.org/).

I am afraid you have to switch to forum-backup. Wait for the release 0.0.3, it will contain a thread report that lists all image links of a thread.
And I already added the thread id when logging unsupported hosts...

[Denaniel]

Originally Posted by halvar

I am afraid you have to switch to forum-backup. Wait for the release 0.0.3...

I got what I needed using forum-backup 0.0.2 "create-report.bat" which listed all of the image links in each thread, even the unsupported image hosters.

[halvar]

Originally Posted by effCup

vef-imagerescue can generate a listing of threads that are within an input forum. Can similar functionality be added to forum-backup? Either, similar to before: a) generate a file listing that can later be used as an input for the app., or: b) simply feed the app. with the forum id, and it then processes all the threads found within that forum?

Such functionality would be particularly valuable for the model id request section where there's lots of small threads.

I am opting for a), the simple list. This gives more flexibility.
I am using LibreOffice Calc to manage my thread list. Sometimes I want to change the page from value, which is a manual process. And if I you do not want to process all threads, you just put a # at the beginning of the line.

https://git.teknik.io/halvar/forum-backup/issues/24

[halvar]

I would like to parse and store the post date. I think the date format is the same for everyone, but I am not really sure. It could depend on system settings or browser language.

Does it look same to you?



My parse pattern is like this:

MM-dd-yyyy, hh:mm a

The parse pattern will be configurable. But if it is something fancy like '32 minutes ago' or 'a couple of hours ago', a simple configurable pattern will not suffice.

Just hit the thanks button if it is the same for you, reply if otherwise.

Thanks
halvar

[40plus]

I believe the date format is the same for everyone and is USA (because a number of very respected members from that region could not cope with DD/MM). However, there is an option for members to change the time display to any time zone they choose. Assuming the script/code parses what is actually displayed then it will not be the same for everyone (ie two people could run the script and get different results depending on their settings).

Regards

40+

[effCup]

Personally I would prefer: yyyy-mm-dd hh:mm AM as then there'd be no room for confusion, but vef/vBulletin determines that I must instead use: mm-dd-yyyy, hh:mm AM

See vef Control Panel -> Edit Options -> Date & Time Options
where time zone can be set & daylight savings time applied.

[halvar]

Originally Posted by 40plus

However, there is an option for members to change the time display to any time zone they choose. Assuming the script/code parses what is actually displayed then it will not be the same for everyone (ie two people could run the script and get different results depending on their settings).

Thanks for the hint. The different value for different users would not bother me. The important thing is that the parsing works.

The date is merely used as information. And to determine if the backup of a thread should be started. The longer the time since the last post, the longer the time to wait before backing it up.

[halvar]

get it here: https://1fichier.com/?vssj7pbs3p

howto install and use is documented here: https://git.teknik.io/halvar/forum-backup/wiki/Howto
release notes are here: https://git.teknik.io/halvar/forum-b...i/ReleaseNotes
additional documentation is here: https://git.teknik.io/halvar/forum-backup/wiki

Highlight in this version is the simple web console.

It looks just like the fist html page I made 20 years ago, but it works

Please backup your data (storage folder) before upgrading!

[halvar]

get it here: https://1fichier.com/?c5idd5kqmb

This version fixes a nasty bug concerning some ghost posts:
If a ghost post is encountered at the beginning of a page the page is downloaded in an infinite loop.
Thanks to Denaniel for pointing this out.

howto install and use is documented here: https://git.teknik.io/halvar/forum-backup/wiki/Howto
release notes are here: https://git.teknik.io/halvar/forum-b...i/ReleaseNotes
additional documentation is here: https://git.teknik.io/halvar/forum-backup/wiki

Please backup your data (storage folder) before upgrading!

[halvar]

get it here: https://1fichier.com/?s76xzf0ry6

I moved the project to gitlab:
(removed offline link)

How It Works: (removed offline link)
Howto: (removed offline link)
ReleaseNotes: (removed offline link)


Major Changes:

• forum backup always starts the web console
• the csv file for thread configuration is no longer used. Threads are configured in the database and can be added using the web console (see [Howto]).
• progress bar is improved
• local page file names and image folders are created with shorter names:

  t[thread-id]-p[pageno].html for html files
  t[thread-id]-p[pageno]-post-[postcount]-[postnr] for post folders.
  

As always: Please backup your data (storage folder) before upgrading!

Update 04-01.2018: current documentation can be found here.