Quote:
Now that I think of it I could number the images in the order they appear in the post. I think on 1st of July we will have a perfect tool.... I am currently planning
|
Quote:
In the page source from imgbox, there is only one location where the image filename is stored, in the "title" attribute: Code:
<div class="image-container"> |
I hesitate to suggest this but: one improvement for halvar's tool would be multi-threading the downloads like image host grabber & similar, e.g. max. 5 images at once. At present when a single image is "sticky" it halts all the downloads.
Just floating the idea. Do not think/try if it would delay other stuff. |
new version of vef-imagerescue (1.14) : imgbox filenames are now preserved
Quote:
I created a new Version 1.14: https://1fichier.com/?mnvu0sfpwq
|
Quote:
I thought of putting single download-jobs in a queue and then have multiple threads process them parallel. I have implemented this kind of stuff in business-applications and it is not that hard to implement. But nonetheless tricky. Given the restricted amount of time I opted for the more safe, single threaded route. I use the command line version and create scripts that download thread after thread. So I can run it unattended over night. |
Yes. Multi-threading would also make it more difficult to manually find which images are being "sticky" and so need browser-viewing to "un-sticky" them.;) Suggestion withdrawn.:)
edit: maybe commenting too early but 1.14 seems perhaps more resilient re. downloading "sticky" images? Could be server loads/time of day, etc. /shrug/ Seems smoother; gets stuck but more often than before also un-sticks without needing intervention of a stop & restart. :cool::thumbsup: |
Great stuff again hal. Is there a limit to the number of threads the new tool can process?
|
Quote:
I was thinking about a larger input field, but feared that somebody might enter hundreds of threads. That could and should work, but I am not really sure. I think you should be safe with 10 thread ids, but it may also depend on the thread size. An alternative is to use the command line. Just create a batch file (or shell script if you have a real operating system ;) ) with subsequent calls. Simple but it works. This also processes one after another and restarts the program ever time. So memory leaks are not an issue. e.g Code:
java -jar vef-imagerescue-1.14.jar 197832 user password |
Quote:
Stop and Restart shouldn't really help. Best let it finish first and then restart once. |
Hi hal - great stuff again :)
Just a report mate: Thread: 260294 2017-06-15 18:29:55 INFO: image-page: http://vintage-erotica-forum.com/sho...ghlight=farrah 2017-06-15 18:29:56 SEVERE: Error downloading 'http://vintage-erotica-forum.com/showthread.php?t=22941&highlight=farrah' 2017-06-15 18:29:56 SEVERE: Illegal char <?> at index 143: C:\vef-imagerescue-1.14\storage\t260294-Teazer_Magazine_Magazine_Scans\t260294-p1-Teazer_Magazine_Magazine_Scans-post-5-3137119\.showthread.php?t=22941&highlight=farrah It seems to be picking up the thread link contained in the post? Quote:
|
All times are GMT. The time now is 09:02 PM. |
vBulletin Optimisation provided by
vB Optimise v2.6.1 (Pro) -
vBulletin Mods & Addons Copyright © 2024 DragonByte Technologies Ltd.