Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!
vintage erotica forum vintage erotica forum vintage erotica forum
vintage erotica forum
Home
Go Back   Vintage Erotica Forums > Information & Help Forum > Help Section > Image Hosts
Best Porn Sites Live Sex Register FAQ Members List Calendar Mark Forums Read

Notices

Reply
 
Thread Tools Display Modes
Old June 14th, 2017, 04:31 PM   #11
halvar
Blocked!
 
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+
Default

Quote:
Originally Posted by BCFC_1982 View Post
When are they​ retried hal? Straight away or does it go off and do other images before returning?
At the end of the thread, so there should be some time before the retry.

You can force a retry any time:
  • delete the files starting with a dot (e.g. '.bf729c239643231') and size 0 (zero bytes)
  • start the thread again
  • BUT DO NOT DELETE dot-files with a size > 0. They mark already downloaded images.
halvar is offline   Reply With Quote
Old June 14th, 2017, 05:01 PM   #12
effCup
Vintage Idiot
 
effCup's Avatar
 
Join Date: Feb 2012
Location: History
Posts: 22,114
Thanks: 226,535
Thanked 355,883 Times in 21,609 Posts
effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+effCup 1000000+
Default

Quote:
Originally Posted by halvar View Post
  • BUT DO NOT DELETE dot-files with a size > 0. They mark already downloaded images.
Yes, or I think images that were tried but failed to download?--i.e. dead images.

In my second folder/post, I have dot-files with size > 0 but some of them do not correspond with downloaded images.

bvhc0011.jpg & bvhc0013.jpg downloaded OK.

bvhc0012.jpg did not download--it's a dead image.

but one of the dot-files corresponds to bvhc0012.jpg (I look inside the file & that's its text value).

Hmm, correction: your tool stopped part-way through downloading the images from this post.

bvhc0019.jpg was the last image successfully downloaded. There are 25 images in that post but I only have 20 dot-files.

Maybe unrelated: One of the images in the post imagebam has "forgotten its filename". So one of your dot-files has the text value:

34074677?AWSAccessKeyId=1K3S7Z90W9SH1PAJ9702&Expir es=1497536878&Signature=X9wwP9xS4GY8pfcQOJ6isyBl0P o=

I have seen this months before with manual or Image Host Grabber downloads of some files on imagebam--i.e. sometimes some images have long names like that, & include "AWSAccessKeyId=" & "Signature=" in them.

Hmmm, but testing with IHG I find that in this case that link with the "forgotten" filename is also a dead image, rather than a download-able image file. So maybe that is all irrelevant.

Still, something about that post seemed to stop your tool part-way.

edit: now trying 1.11, and it is downloading additional images from that thread. The previous post now has the correct number of dot-files: 25. Unfortunately, the tool seems to have once again stopped part-way through the very next post. There are only 6 dot-files where there should be 10.

I re-started your 1.11 tool and it completed that post--10 dot-files & 9 images because 1 is dead--but then on the next post stopped part-way through once again.

Last edited by effCup; June 14th, 2017 at 05:24 PM..
effCup is offline   Reply With Quote
The Following 10 Users Say Thank You to effCup For This Useful Post:
Old June 14th, 2017, 05:23 PM   #13
halvar
Blocked!
 
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+
Default

Quote:
Originally Posted by effCup View Post
1) very minor suggestion, maybe too cosmetic to even bother?: you create a folder for the thread & inside that folders for posts with images to save.

I made the mistake of first testing your tool (1.10) on a thread with a very long title, so I've got post folders each with very long titles inside the thread folder with a very long title, i.e.:
I intended to limit the name to 20 characters - and forgot. I will do this in the next version.
This could be a problem with Windows because it has a maximum length of file paths.

Quote:
Originally Posted by effCup View Post
The post folders only need: thread id, page, then post id.

Strictly, the post folders really only need the post id, as that is canonical on vef, but the thread id & page are perhaps helpful/reassuring for "humans"?
Yes, this is intended for humans

Quote:
Originally Posted by effCup View Post
2) a more serious problem: it seems to have found only 2 posts in that entire thread with imagebam or imgbox images?

p=576111, p=636725.

but there are posts immediately below that second post that also have imagebam images, for example p=636727, but they have not had their images saved?

I do not think I accidentally "stopped" your tool from completing its task--it got all 312 pages, but seemingly stopped with just 2 posts with images.

I tried to re-run the tool on the same thread but no change/additions.
I cannot reproduce this yet. I tried Thread 33256 on Windows (1.10) and Linux (1.11). Both seem to work.
But I stopped after some images. I understood it didn't work at all.
I am currently running the whole thread and have to wait until it reaches one of the failed posts.
halvar is offline   Reply With Quote
Old June 14th, 2017, 05:35 PM   #14
Denaniel
Administrator
 
Denaniel's Avatar
 
Join Date: Dec 2006
Location: Rocinante Ops Deck
Posts: 13,863
Thanks: 114,481
Thanked 424,595 Times in 13,402 Posts
Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+
Default

Quote:
Originally Posted by effCup View Post
post folder:
t33256-p15-###_Marlon's_'Don't_know_where_else_to_put_them'_s mall_vintage_sets_Vintage_Erotica_Talk-post-146-576111

The post folders only need: thread id, page, then post id.

Strictly, the post folders really only need the post id, as that is canonical on vef, but the thread id & page are perhaps helpful/reassuring for "humans"?
The postcount# (= 146, in your example above) is helpful in addition to the post id# (= 576111 above) because then the post folders will be listed alpha-numerically in the same order as the posts appear in the current thread. It's also helpful when checking whether imagebam/imagebox images you found in a specific post were actually downloaded. It's true that the postcount# may change after posts are moved/deleted, but they are useful at the time of downloading.

One possible solution would be to limit the thread title portion of the folder names to a max number of characters, say 20 or 25. Update: I see halvar already addressed this in previous post.
__________________

Please PM me if any of my links are dead.

Don't post your thanks, hit the "Thanks" button!



To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.

Last edited by Denaniel; June 14th, 2017 at 07:11 PM.. Reason: added note
Denaniel is offline   Reply With Quote
The Following 13 Users Say Thank You to Denaniel For This Useful Post:
Old June 14th, 2017, 06:12 PM   #15
halvar
Blocked!
 
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+
Default

SEVERE Log messages show images that could not be downloaded. This could be because of femporary reasons (netwok etc.) or the hoster has really lost the image.

Code:
2017-06-14 18:52:59 SEVERE: download:  http://78.imagebam.com/download/ftg0a66O-7twITFUWT1bOw/19719/197184910/kt11328.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:52:59 SEVERE: download:  http://17.imagebam.com/download/3i5qlcmSV7dFRLEDRIGeFA/19719/197184942/kt11330.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:06 SEVERE: download:  http://78.imagebam.com/download/42dqxCEDsJYqqmyIkjlNYg/19719/197185054/kt11369.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:14 SEVERE: download:  http://17.imagebam.com/download/_v6LwLFXxJp5NglZP5dayg/19870/198693061/kt02047.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:27 SEVERE: download:  http://17.imagebam.com/download/fLRv7TaeK5RssK48rwbUIA/19870/198693167/kt02106.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:27 SEVERE: download:  http://17.imagebam.com/download/1AreG0gksK5MLYXtVF6e_w/19870/198693174/kt02107.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:38 SEVERE: download:  http://17.imagebam.com/download/O7T5tki7qroHnYRrHnDOzQ/19870/198693297/kt02234.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:53 SEVERE: download:  https://i.imgbox.com/aauWfI0a.jpg failed HTTP/1.1 404 Not Found
2017-06-14 18:53:56 SEVERE: download:  https://i.imgbox.com/aadqexi8.jpg failed HTTP/1.1 404 Not Found
I checked some of the error images: The Image html page can sometimes be downloaded, but not the included image.

In these cases the dot file is larger than 0 bytes, since the filename could be determined.

I will implement a check that walks through the whole storage folder and reports or deletes 0 byte files and dot files without corresponding image. Two new Buttons: One for reporting, one for deleting.
halvar is offline   Reply With Quote
Old June 14th, 2017, 07:16 PM   #16
Denaniel
Administrator
 
Denaniel's Avatar
 
Join Date: Dec 2006
Location: Rocinante Ops Deck
Posts: 13,863
Thanks: 114,481
Thanked 424,595 Times in 13,402 Posts
Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+
Default

I ran a somewhat long thread (32 pages) a second time, using the newer vef-imagerescue 1.11, and I noticed that it paused for a long time (minutes?) before its said FINISHED. This is presumably when it was double-checking the files that did not download the first time through. After the long pause, it downloaded an additional 12 files, so the double checking was worthwhile.

Just ran another pic-heavy thread for the 2nd run, this time with version 1.11, and after the big pause, it's downloading many images as duplicates of those already downloaded successfully the first time. Also, the "last modified" dates shown by Windows are not correct; they are dated two or three days ago though I just downloaded them minutes ago. And no, the files were not updated in the posts a few days ago either.

Thread is here:
http://vintage-erotica-forum.com/t65...-database.html

Update: New version 1.12 takes care of this problem. It turns out, I was looking in the original folders, and version 1.11 was creating new folders (explained in the bugfix for 1.12), so the dupes were actually created by an older version, which is why I thought the date of the files was wrong. Hopefully the duping won't happen with the updated version.

__________________

Please PM me if any of my links are dead.

Don't post your thanks, hit the "Thanks" button!



To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.

Last edited by Denaniel; June 14th, 2017 at 10:53 PM.. Reason: added note
Denaniel is offline   Reply With Quote
The Following 11 Users Say Thank You to Denaniel For This Useful Post:
Old June 14th, 2017, 08:29 PM   #17
BCFC_1982
Fiona Cooper Enthusiast
 
BCFC_1982's Avatar
 
Join Date: Mar 2014
Location: England
Posts: 6,546
Thanks: 109,011
Thanked 106,955 Times in 6,822 Posts
BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+BCFC_1982 500000+
Default

Instructions based on Windows 10 OS.

Install:
Java Runtime Version 8, current version: Version 8 Update 131
https://www.java.com/en/download/

Download the tool:
http://vintage-erotica-forum.com/sho...71&postcount=8

Extract using WinZip or similar extracting program to drive of choice, I extracted mine to this path:
C:\vef-imagerescue-1.11

Double Click the Jar file in the vef-imagerescue-1 11 folder.

This launches the tool.

Click the "storage" button, select a folder where you want to save the images to.

Add your VEF UserName and Password in the equivalent boxes.

In thread name box, paste the thread number.

e.g. to rip for this link:
Code:
http://vintage-erotica-forum.com/t11082-nikita-gross.html
use 11082

Click start, and it should start downloading any image from imagebam and imgbox. Each folder relates to the post count and post number.

Hopefully this helps you guys, any questions ask and we'll try to answer them as best as possible.

Thanks to halvar for this great tool and his efforts
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.


PM me in relation to anything Fiona Cooper
BCFC_1982 is offline   Reply With Quote
The Following 17 Users Say Thank You to BCFC_1982 For This Useful Post:
Old June 14th, 2017, 09:00 PM   #18
Denaniel
Administrator
 
Denaniel's Avatar
 
Join Date: Dec 2006
Location: Rocinante Ops Deck
Posts: 13,863
Thanks: 114,481
Thanked 424,595 Times in 13,402 Posts
Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+Denaniel 1000000+
Default vef-imagerescue can download what *appear* to be dead images

Quote:
Originally Posted by effCup View Post
Maybe unrelated: One of the images in the post imagebam has "forgotten its filename". So one of your dot-files has the text value:

34074677?AWSAccessKeyId=1K3S7Z90W9SH1PAJ9702&Expir es=1497536878&Signature=X9wwP9xS4GY8pfcQOJ6isyBl0P o=

I have seen this months before with manual or Image Host Grabber downloads of some files on imagebam--i.e. sometimes some images have long names like that, & include "AWSAccessKeyId=" & "Signature=" in them.

Hmmm, but testing with IHG I find that in this case that link with the "forgotten" filename is also a dead image, rather than a download-able image file. So maybe that is all irrelevant.
Discovered another interesting and useful thing about the vef-imagerescue tool.

As effCup mentioned in an earlier post (quoted above), sometimes the file name cannot be found, and the file is downloaded as a partial name with no file extension.

I found a few of these files with no extension, and they all had gibberish file names ending in an equals sign: =



When I changed the file name, replacing the equals sign with the extension .jpg, I was able to open and view the image in Windows Photo Viewer.

The surprise was, although the thumbnail link in the original post linked to a dead image, and Image Host Grabber failed to download it, the imagerescue tool was able to download the full size image!

Below are the imagebam thumb (left) and a thumb for my reup to imagezilla. Click on them and see what you get.


original imagebam thumb (left), new imagezilla thumb (reupped today)

This is good news for those of us trying to archive these vulnerable images, but it also means we have to be careful not to delete thumbnail links that we think are dead, before processing the thread with the imagerescue tool.
__________________

Please PM me if any of my links are dead.

Don't post your thanks, hit the "Thanks" button!



To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
...
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
Denaniel is offline   Reply With Quote
The Following 16 Users Say Thank You to Denaniel For This Useful Post:
Old June 14th, 2017, 09:18 PM   #19
halvar
Blocked!
 
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+halvar 100000+
Default version 1.12 of imagerescue released

version 1.12 is available here https://1fichier.com/?wyr08iqlrg

changes since 1.11
  • fixed bug: repeated processing of a thread to a folder with 'old -p1- naming' like 't10580-p1-vto-mags-pussy' produces additional folders for the last page of the thread like 't10580-p1-p1-vto-mags-pussy'
  • fixed bug: when an image page can be downloaded but not the image itself the filename is written in the dot file nonetheless
  • long thread names are now cut to a maximum of 50 characters
halvar is offline   Reply With Quote
Old June 14th, 2017, 09:24 PM   #20
rotobott
Veteran Member
 
rotobott's Avatar
 
Join Date: Jun 2008
Posts: 32,049
Thanks: 174,580
Thanked 633,177 Times in 31,368 Posts
rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+rotobott 2500000+
Default

So where is this jar file, I open folders and get more folders.

As you can guess I'm a computer illiterate, big time
rotobott is offline   Reply With Quote
The Following 11 Users Say Thank You to rotobott For This Useful Post:
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump




All times are GMT. The time now is 06:24 AM.






vBulletin Optimisation provided by vB Optimise v2.6.1 (Pro) - vBulletin Mods & Addons Copyright © 2024 DragonByte Technologies Ltd.