June 14th, 2017, 02:26 AM | #1 |
Beloved Sister
Mistress of Mayhem Join Date: Jan 2007
Location: The Great Gig In the Sky
Posts: 6,668
Thanks: 64,911
Thanked 127,587 Times in 6,475 Posts
|
Discussion of the download / upload tools
Please use this thread for technical discussion or problems with software being used.
__________________
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. |
The Following 31 Users Say Thank You to Jenny48549 For This Useful Post: | 40plus, Al Gebra, andw, ballyhoo, BCFC_1982, BondJmsBond, Clark Kent, deezer, Denaniel, effCup, Estreeter, G-Type, Gazsu8107, Grey Wolf, halvar, haVEFun here, jomama, Joszka, lagerlout, MohNom, palo5, PoloMintGuy, Protos33, retroanalyst, The Pie Man, Siroga, trailmaster, Trip, Wendigo, xsmartx, yukonlyc |
|
June 14th, 2017, 04:41 AM | #2 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Bug Reports vef-imagerescue 1.10
I got several bug reports for vef_imagerescue v 1.10:
If the thread title contains special characters the download folder cannot be created. Like quotation marks. I will create a fix after I get back from work. Downloading of thumbnails will also be removed in the next version. They are not necessary and this speeds up the whole process. Thanks to the bug reporters for supplying failed threads. This makes reproducing, fixing and testing a lot easier. |
June 14th, 2017, 10:23 AM | #3 |
Fiona Cooper Enthusiast
Join Date: Mar 2014
Location: England
Posts: 6,545
Thanks: 109,012
Thanked 106,995 Times in 6,821 Posts
|
Hal, messaged you yesterday about the slight inconsistent nature of downloads, sometimes it worked, sometimes it didn't, like the example where 107 files were downloaded by v1.9 and 108 by v1.7.
Not sure if you could possibly look at parsing the threads possibly twice, just to make sure images are definitely downloaded. It may have been a server issue on their end the first time it attempted to download it, but given time from not accessing the page and possibly on the second pass it may grab an image it failed to download the first time? I don't know how workable this is, because I assume you create the .xxxxxx file to say you've attempted to download the image from that page, and I'm sorry I don't have concrete evidence to help pinpoint the issue. It could just be pot luck whether it gets the image first time or not It's a flipping really great tool. You have my highest level of respect here for your time and patience. I'm running it on 4 or 5 threads at a time, could that be an issue? Cheers.
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. PM me in relation to anything Fiona Cooper |
The Following 16 Users Say Thank You to BCFC_1982 For This Useful Post: | andw, deezer, Denaniel, effCup, halvar, jomama, Joszka, MohNom, palo5, PoloMintGuy, Protos33, The Pie Man, trailmaster, Wendigo, yukonlyc |
June 14th, 2017, 01:02 PM | #4 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
Would you please check if there are empty (zero bytes) .xxxxxxx in the folder where images are missing? If a download succeeds the file should contain the images file name. Deleting the empty file and re-running the thread should retry to download the missing files. I could add a rescan-feature that lools for zero byte files and retries them. But this would take some time to implement and test. This should not be a problem, but it could be that imagebam throttles parallel requests coming from the same ip address. |
|
June 14th, 2017, 01:10 PM | #5 |
Fiona Cooper Enthusiast
Join Date: Mar 2014
Location: England
Posts: 6,545
Thanks: 109,012
Thanked 106,995 Times in 6,821 Posts
|
I'll check it out mate when I get home thanks as always.
In this case I think the images are from imgbox I'll get back to you in around 4 hours or so
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. PM me in relation to anything Fiona Cooper |
June 14th, 2017, 01:19 PM | #6 | |
Super Moderator
Join Date: Mar 2009
Posts: 3,870
Thanks: 1,043,099
Thanked 52,360 Times in 3,827 Posts
|
Quote:
It may just be perception but I think both have slowed noticeably since their announcements. However version 1.9 is working well for me. |
|
June 14th, 2017, 01:22 PM | #7 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,143
Thanks: 226,791
Thanked 357,041 Times in 21,638 Posts
|
Just linking to halvar's vef-imagerescue 1.10 tool, so it's readily available/visible here for anyone who wants to use it.
Quote:
|
|
June 14th, 2017, 03:12 PM | #8 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
vef-imagerescue 1.11 is available
download it here: https://1fichier.com/?6ui0ayo9ki
changes since 1.10 * Fixed Bug: Threads with special characters in the name could not be downloaded * Failed image downloads are retried once * Thumbnails are no more downloaded Usage: Code:
java -jar vef-imagerescue-1.11.jar 115584 username password Code:
java -jar vef-imagerescue-1.11.jar project to teknik.io: https://git.teknik.io/halvar/vef-imagerescue |
June 14th, 2017, 03:13 PM | #9 |
Fiona Cooper Enthusiast
Join Date: Mar 2014
Location: England
Posts: 6,545
Thanks: 109,012
Thanked 106,995 Times in 6,821 Posts
|
When are they retried hal? Straight away or does it go off and do other images before returning?
Cheers
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. PM me in relation to anything Fiona Cooper |
June 14th, 2017, 03:26 PM | #10 |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,143
Thanks: 226,791
Thanked 357,041 Times in 21,638 Posts
|
@halvar: fantastic tool.
1) very minor suggestion, maybe too cosmetic to even bother?: you create a folder for the thread & inside that folders for posts with images to save. I made the mistake of first testing your tool (1.10) on a thread with a very long title, so I've got post folders each with very long titles inside the thread folder with a very long title, i.e.: thread folder: t33256-###_Marlon's_'Don't_know_where_else_to_put_them'_s mall_vintage_sets_Vintage_Erotica_Talk post folder: t33256-p15-###_Marlon's_'Don't_know_where_else_to_put_them'_s mall_vintage_sets_Vintage_Erotica_Talk-post-146-576111 The post folders only need: thread id, page, then post id. Strictly, the post folders really only need the post id, as that is canonical on vef, but the thread id & page are perhaps helpful/reassuring for "humans"? When re-upping one can simply "visit" post ids: Code:
http://vintage-erotica-forum.com/showthread.php?p=NNNNN 2) a more serious problem: it seems to have found only 2 posts in that entire thread with imagebam or imgbox images? p=576111, p=636725. but there are posts immediately below that second post that also have imagebam images, for example p=636727, but they have not had their images saved? I do not think I accidentally "stopped" your tool from completing its task--it got all 312 pages, but seemingly stopped with just 2 posts with images. I tried to re-run the tool on the same thread but no change/additions. |
|
|