Vintage Erotica Forums

Vintage Erotica Forums (http://vintage-erotica-forum.com/index.php)
-   Image Hosts (http://vintage-erotica-forum.com/forumdisplay.php?f=88)
-   -   Discussion of the download / upload tools (http://vintage-erotica-forum.com/showthread.php?t=333326)

halvar June 16th, 2017 04:31 PM

Quote:

Originally Posted by deezer (Post 4069925)
May I ask you something which is probably only a point in the MIR-section.
Sometimes galleries, which are not posted elsewhere at VEF are direct linked in a MIR-post without a thumbnail-preview. In a V 1.9 the tool didn't download this galleries.
Does it download such direct linked galleries in V 1.14 or V 1.16?

Currently not, only image links containing thumbnails are fetched.
Let me think about for a while. We could download all links to imagebam and imgbox...

Do you have an example or two?

temptester666 June 16th, 2017 06:39 PM

Thank you for your good work, halvar!

I don't know if it's just me, but about one-quarter of my ImageRescue downloads are getting corrupted, like "Picture A" below.

However, if I download the same link by entering it manually in my browser, I get an uncorrupted version, like "Picture B."

Photo A: http://www.hotflick.net/u/n/FrNLQveU...WApCfmTzrd.jpg Photo B: http://www.hotflick.net/u/n/FrNLQveU...0XapLtwVUi.jpg

Has anybody seen something similar and been able to fix it?

This problem is happening on a new Ubuntu operating system that was just installed today (fresh!) on a recently manufactured computer. It's true across versions of ImageRescue.

The only modifications to the default operating system are:
  • Updates and upgrades (multiple iterations until finished)
  • Downloaded vef-imagerescue-1.14
  • Installed Java runtime environment
Is the Java installation the likely culprit? I installed it this way:
Code:

sudo apt install default-jre
Anyone have any thoughts? Other than the large number of corrupted images, imagerescue seems to run perfectly.

Thanks for any help - if I get it working, I'd be very pleased to lend a hand with the backup.

halvar June 16th, 2017 08:14 PM

Quote:

Originally Posted by temptester666 (Post 4070054)
I don't know if it's just me, but about one-quarter of my ImageRescue downloads are getting corrupted, like "Picture A" below.

However, if I download the same link by entering it manually in my browser, I get an uncorrupted version, like "Picture B."

I have not seen this yet. I browse through downloaded files regularly, although I cannot check every file. Do you have SEVERE log entries for the affected files? If data is only retrieved partially there should be an error message.

The java version should not be the problem. I use a rather old java version from oracle on ubuntu 16.04. In my experience java versions are very compatible, they only behave differently in extremely rare cases.

Could you please delete a thread folder, try the thread again and send me the log?
What kind of computer do you have? A very fast one?

Al Gebra June 16th, 2017 08:45 PM

Quote:

Originally Posted by temptester666 (Post 4070054)
Has anybody seen something similar (...) ?

Yes, I have - a few months ago. Whenever I used ImageHost Grabber three to five pics of that post were corrupted on my harddisk. When I tried to grab these very posts a day later, all pics were OK. My conclusion was that it was just a temporary glitch or had something to with the browser cache.

Quote:

Originally Posted by beutelwolf (Post 3744189)
I have seen that sort of thing myself before. Not quite sure what precisely causes it, but I suspect that one download partially failed at some time, and the partial failure was at some level (not necessarily your computer) cached as "this is the picture". As long as the cache is not cleared that corrupt result will be repeated.

Accessing the thing via a proxy may circumvent the problem.

That's why I think this issue is not associated with halvar's tool. Clear your cache before retrying to downoad.

deezer June 16th, 2017 09:48 PM

Quote:

Originally Posted by halvar (Post 4069957)
Currently not, only image links containing thumbnails are fetched.
Let me think about for a while. We could download all links to imagebam and imgbox...

Do you have an example or two?


It is a rare thing, so I had to search a while. Here is a post, where effCup only
linked to the gallery, without posting thumbs. I've re-hosted them yesterday to
pixhost, but the link of effie is still there:
http://vintage-erotica-forum.com/showpost.php?p=1058737

Al Gebra June 16th, 2017 10:54 PM

Request to halvar
 
Quote:

Originally Posted by halvar (Post 4069883)
  • Added a report feature. It creates a csv file containing information on the downloaded items. It can be useful to check for correctness of downloads. The report only processes local files, it does not download anything. To start it press the button "Create report...". Creating the report may take some time, depending on the amount of files you have in your storage. (...)

:thumbsup:

I admit that my request is not 1st priority, but maybe it can be granted with just a little effort. Is it possible to implement an option in vef-imagerescue that allows to download only a limited number of pages in a certain thread, say page 15 to 34?

A similar option is possible in ImageHost Grabber (Aktuellen Tread saugen ~ download current thread [or the like in English]). When you use that option the tool asks for the first page to d/l and then the last page. It even works with the individual "Number of Posts to Show Per Page" I have chosen in my VEF Control Panel (= 10 posts).

Al Gebra June 16th, 2017 11:03 PM

Quote:

Originally Posted by Pavlov49 (Post 4069819)
I have downloaded and unpacked the zip, extracted all content.
But double-clicking the .jar does NOT start the downloader, but asks for an App to open/extract the content:

Is Java (German version here) installed on your PC? See excellent how-to here.

Quote:

Originally Posted by Pavlov49 (Post 4069819)
Have sent BCFC_1982, and halvar a PM already, but maybe some other members can help to relief them from answering such silly questions.

Glad to be of help.

halvar June 17th, 2017 03:45 AM

Quote:

Originally Posted by deezer (Post 4070185)
It is a rare thing, so I had to search a while. Here is a post, where effCup only
linked to the gallery, without posting thumbs. I've re-hosted them yesterday to
pixhost, but the link of effie is still there:
http://vintage-erotica-forum.com/showpost.php?p=1058737

If you mean the link to the gallery: It is not that easy. I would have to check:
  • is a linked page an image page or album page
  • if it is an album find zip if available or parse page to get images
Parsing the page would add another level of indirection. I'm sorry, I don't think I can do this.

halvar June 17th, 2017 03:49 AM

Quote:

Originally Posted by Pavlov49 (Post 4069819)

Have sent BCFC_1982, and halvar a PM already, but maybe some other members can help to relief them from answering such silly questions.

Sorry, I didn't get back to you because BCFC_1982 already replied. Do you still have the problems?

halvar June 17th, 2017 04:00 AM

Quote:

Originally Posted by Al Gebra (Post 4070219)
:thumbsup:

I admit that my request is not 1st priority, but maybe it can be granted with just a little effort. Is it possible to implement an option in vef-imagerescue that allows to download only a limited number of pages in a certain thread, say page 15 to 34?

A similar option is possible in ImageHost Grabber (Aktuellen Tread saugen ~ download current thread [or the like in English]). When you use that option the tool asks for the first page to d/l and then the last page. It even works with the individual "Number of Posts to Show Per Page" I have chosen in my VEF Control Panel (= 10 posts).

I already added a filter to process only posts from a specified user. It is not officially released yet, andw is doing beta testing. So I can add another filter.

But beware: If you specify a filter in th GUI and later run the command line on the same thread the command line will not filter.


All times are GMT. The time now is 06:58 AM.



vBulletin Optimisation provided by vB Optimise v2.6.1 (Pro) - vBulletin Mods & Addons Copyright © 2024 DragonByte Technologies Ltd.