June 15th, 2017, 12:49 PM | #31 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
Now that I think of it I could number the images in the order they appear in the post. I think on 1st of July we will have a perfect tool.... I am currently planning
|
|
June 15th, 2017, 01:09 PM | #32 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,136
Thanks: 226,724
Thanked 356,767 Times in 21,631 Posts
|
Quote:
In the page source from imgbox, there is only one location where the image filename is stored, in the "title" attribute: Code:
<div class="image-container"> <img alt="Xnrwelb8" class="image-content" id="img" onclick="rs()" src="https://i.imgbox.com/XNRWELb8.jpg" title="639m.jpg" /> </div> |
|
June 15th, 2017, 01:55 PM | #33 |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,136
Thanks: 226,724
Thanked 356,767 Times in 21,631 Posts
|
I hesitate to suggest this but: one improvement for halvar's tool would be multi-threading the downloads like image host grabber & similar, e.g. max. 5 images at once. At present when a single image is "sticky" it halts all the downloads.
Just floating the idea. Do not think/try if it would delay other stuff. Last edited by effCup; June 15th, 2017 at 03:29 PM.. Reason: typo. |
June 15th, 2017, 01:56 PM | #34 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
new version of vef-imagerescue (1.14) : imgbox filenames are now preserved
Quote:
I created a new Version 1.14: https://1fichier.com/?mnvu0sfpwq
|
|
June 15th, 2017, 02:06 PM | #35 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
I thought of putting single download-jobs in a queue and then have multiple threads process them parallel. I have implemented this kind of stuff in business-applications and it is not that hard to implement. But nonetheless tricky. Given the restricted amount of time I opted for the more safe, single threaded route. I use the command line version and create scripts that download thread after thread. So I can run it unattended over night. |
|
June 15th, 2017, 02:27 PM | #36 |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,136
Thanks: 226,724
Thanked 356,767 Times in 21,631 Posts
|
Yes. Multi-threading would also make it more difficult to manually find which images are being "sticky" and so need browser-viewing to "un-sticky" them. Suggestion withdrawn.
edit: maybe commenting too early but 1.14 seems perhaps more resilient re. downloading "sticky" images? Could be server loads/time of day, etc. /shrug/ Seems smoother; gets stuck but more often than before also un-sticks without needing intervention of a stop & restart. Last edited by effCup; June 15th, 2017 at 02:39 PM.. |
June 15th, 2017, 02:32 PM | #37 |
Fiona Cooper Enthusiast
Join Date: Mar 2014
Location: England
Posts: 6,545
Thanks: 109,012
Thanked 106,991 Times in 6,821 Posts
|
Great stuff again hal. Is there a limit to the number of threads the new tool can process?
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. PM me in relation to anything Fiona Cooper |
June 15th, 2017, 02:51 PM | #38 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
I was thinking about a larger input field, but feared that somebody might enter hundreds of threads. That could and should work, but I am not really sure. I think you should be safe with 10 thread ids, but it may also depend on the thread size. An alternative is to use the command line. Just create a batch file (or shell script if you have a real operating system ) with subsequent calls. Simple but it works. This also processes one after another and restarts the program ever time. So memory leaks are not an issue. e.g Code:
java -jar vef-imagerescue-1.14.jar 197832 user password java -jar vef-imagerescue-1.14.jar 6702 user password java -jar vef-imagerescue-1.14.jar 2690 user password java -jar vef-imagerescue-1.14.jar 9853 user password ... |
|
June 15th, 2017, 02:55 PM | #39 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
Stop and Restart shouldn't really help. Best let it finish first and then restart once. |
|
June 15th, 2017, 06:06 PM | #40 |
Fiona Cooper Enthusiast
Join Date: Mar 2014
Location: England
Posts: 6,545
Thanks: 109,012
Thanked 106,991 Times in 6,821 Posts
|
Hi hal - great stuff again
Just a report mate: Thread: 260294 2017-06-15 18:29:55 INFO: image-page: http://vintage-erotica-forum.com/sho...ghlight=farrah 2017-06-15 18:29:56 SEVERE: Error downloading 'http://vintage-erotica-forum.com/showthread.php?t=22941&highlight=farrah' 2017-06-15 18:29:56 SEVERE: Illegal char <?> at index 143: C:\vef-imagerescue-1.14\storage\t260294-Teazer_Magazine_Magazine_Scans\t260294-p1-Teazer_Magazine_Magazine_Scans-post-5-3137119\.showthread.php?t=22941&highlight=farrah It seems to be picking up the thread link contained in the post?
__________________
All my later posts (2017+) have 3% recovery records in the RAR files
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts. PM me in relation to anything Fiona Cooper |
|
|