Discussion of the download / upload tools

[halvar]

Originally Posted by deezer

May I ask you something which is probably only a point in the MIR-section.
Sometimes galleries, which are not posted elsewhere at VEF are direct linked in a MIR-post without a thumbnail-preview. In a V 1.9 the tool didn't download this galleries.
Does it download such direct linked galleries in V 1.14 or V 1.16?

Currently not, only image links containing thumbnails are fetched.
Let me think about for a while. We could download all links to imagebam and imgbox...

Do you have an example or two?

[temptester666]

Thank you for your good work, halvar!

I don't know if it's just me, but about one-quarter of my ImageRescue downloads are getting corrupted, like "Picture A" below.

However, if I download the same link by entering it manually in my browser, I get an uncorrupted version, like "Picture B."

Photo A: Photo B:

Has anybody seen something similar and been able to fix it?

This problem is happening on a new Ubuntu operating system that was just installed today (fresh!) on a recently manufactured computer. It's true across versions of ImageRescue.

The only modifications to the default operating system are:

• Updates and upgrades (multiple iterations until finished)
• Downloaded vef-imagerescue-1.14
• Installed Java runtime environment

Is the Java installation the likely culprit? I installed it this way:

sudo apt install default-jre

Anyone have any thoughts? Other than the large number of corrupted images, imagerescue seems to run perfectly.

Thanks for any help - if I get it working, I'd be very pleased to lend a hand with the backup.

[halvar]

Originally Posted by temptester666

I don't know if it's just me, but about one-quarter of my ImageRescue downloads are getting corrupted, like "Picture A" below.

However, if I download the same link by entering it manually in my browser, I get an uncorrupted version, like "Picture B."

I have not seen this yet. I browse through downloaded files regularly, although I cannot check every file. Do you have SEVERE log entries for the affected files? If data is only retrieved partially there should be an error message.

The java version should not be the problem. I use a rather old java version from oracle on ubuntu 16.04. In my experience java versions are very compatible, they only behave differently in extremely rare cases.

Could you please delete a thread folder, try the thread again and send me the log?
What kind of computer do you have? A very fast one?

[Al Gebra]

Originally Posted by temptester666

Has anybody seen something similar (...) ?

Yes, I have - a few months ago. Whenever I used ImageHost Grabber three to five pics of that post were corrupted on my harddisk. When I tried to grab these very posts a day later, all pics were OK. My conclusion was that it was just a temporary glitch or had something to with the browser cache.

Originally Posted by beutelwolf

I have seen that sort of thing myself before. Not quite sure what precisely causes it, but I suspect that one download partially failed at some time, and the partial failure was at some level (not necessarily your computer) cached as "this is the picture". As long as the cache is not cleared that corrupt result will be repeated.

Accessing the thing via a proxy may circumvent the problem.

That's why I think this issue is not associated with halvar's tool. Clear your cache before retrying to downoad.

[deezer]

Originally Posted by halvar

Currently not, only image links containing thumbnails are fetched.
Let me think about for a while. We could download all links to imagebam and imgbox...

Do you have an example or two?

It is a rare thing, so I had to search a while. Here is a post, where effCup only
linked to the gallery, without posting thumbs. I've re-hosted them yesterday to
pixhost, but the link of effie is still there:
http://vintage-erotica-forum.com/showpost.php?p=1058737

[Al Gebra]

Originally Posted by halvar

• Added a report feature. It creates a csv file containing information on the downloaded items. It can be useful to check for correctness of downloads. The report only processes local files, it does not download anything. To start it press the button "Create report...". Creating the report may take some time, depending on the amount of files you have in your storage. (...)

I admit that my request is not 1st priority, but maybe it can be granted with just a little effort. Is it possible to implement an option in vef-imagerescue that allows to download only a limited number of pages in a certain thread, say page 15 to 34?

A similar option is possible in ImageHost Grabber (Aktuellen Tread saugen ~ download current thread [or the like in English]). When you use that option the tool asks for the first page to d/l and then the last page. It even works with the individual "Number of Posts to Show Per Page" I have chosen in my VEF Control Panel (= 10 posts).

[Al Gebra]

Originally Posted by Pavlov49

I have downloaded and unpacked the zip, extracted all content.
But double-clicking the .jar does NOT start the downloader, but asks for an App to open/extract the content:

Is Java (German version here) installed on your PC? See excellent how-to here.

Originally Posted by Pavlov49

Have sent BCFC_1982, and halvar a PM already, but maybe some other members can help to relief them from answering such silly questions.

Glad to be of help.

[halvar]

Originally Posted by deezer

It is a rare thing, so I had to search a while. Here is a post, where effCup only
linked to the gallery, without posting thumbs. I've re-hosted them yesterday to
pixhost, but the link of effie is still there:
http://vintage-erotica-forum.com/showpost.php?p=1058737

If you mean the link to the gallery: It is not that easy. I would have to check:

• is a linked page an image page or album page
• if it is an album find zip if available or parse page to get images

Parsing the page would add another level of indirection. I'm sorry, I don't think I can do this.

[halvar]

Originally Posted by Pavlov49

Have sent BCFC_1982, and halvar a PM already, but maybe some other members can help to relief them from answering such silly questions.

Sorry, I didn't get back to you because BCFC_1982 already replied. Do you still have the problems?

[halvar]

Originally Posted by Al Gebra

I admit that my request is not 1st priority, but maybe it can be granted with just a little effort. Is it possible to implement an option in vef-imagerescue that allows to download only a limited number of pages in a certain thread, say page 15 to 34?

A similar option is possible in ImageHost Grabber (Aktuellen Tread saugen ~ download current thread [or the like in English]). When you use that option the tool asks for the first page to d/l and then the last page. It even works with the individual "Number of Posts to Show Per Page" I have chosen in my VEF Control Panel (= 10 posts).

I already added a filter to process only posts from a specified user. It is not officially released yet, andw is doing beta testing. So I can add another filter.

But beware: If you specify a filter in th GUI and later run the command line on the same thread the command line will not filter.