June 17th, 2017, 04:20 AM | #71 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,129
Thanks: 226,701
Thanked 356,679 Times in 21,624 Posts
|
Quote:
|
|
June 17th, 2017, 04:25 AM | #72 | ||
Junior Member
Join Date: Jul 2009
Location: Permanent temporality
Posts: 6
Thanks: 26
Thanked 49 Times in 6 Posts
|
Thanks, halvar. As you asked, I deleted the thread folder from the first run and ran the tool on the same thread again. This was for Caroline Laurie's thread (t=628), which I chose for testing because it is very short.
Again, a significant percentage of files were corrupted. On the file we are using as an example, Pres12024.jpg, here is the most recent result: In addition, here's a new observation: Caroline Laurie's thread is short, and has only 9 posts. But, on both this run and the earlier run, the tool skipped posts 1-5 and captured posts 6-9. Here is the partial list of posts captured, both times: Code:
$ ls ./t628-Caroline_Laurie_Classic_Pornstars/ t628-p1-Caroline_Laurie_Classic_Pornstars.html t628-p1-Caroline_Laurie_Classic_Pornstars-post-6-1987433 t628-p1-Caroline_Laurie_Classic_Pornstars-post-7-2282935 t628-p1-Caroline_Laurie_Classic_Pornstars-post-8-3178094 t628-p1-Caroline_Laurie_Classic_Pornstars-post-9-3983329 Quote:
Code:
$ grep Pres12024 vef-imagerescue.log.0 2017-##-## 10:##:## INFO: download: http://117.imagebam.com/download/bXeKK5UqKyEVHUZwhuzMwA/53993/539926047/Pres12024.jpg to storage/t628-Caroline_Laurie_Classic_Pornstars/t628-p1-Caroline_Laurie_Classic_Pornstars-post-9-3983329/Pres12024.jpg 2017-##-## 20:##:## INFO: download: http://117.imagebam.com/download/bXeKK5UqKyEVHUZwhuzMwA/53993/539926047/Pres12024.jpg to storage/t628-Caroline_Laurie_Classic_Pornstars/t628-p1-Caroline_Laurie_Classic_Pornstars-post-9-3983329/Pres12024.jpg Code:
sudo apt install default-jre Quote:
The computer is a year old, and is very average. Moderately priced, has a reasonable 8G of RAM, isn't super fast but isn't super slow. Average new machine from a major manufacturer. And finally, I had this happen in 1.14 and 1.16, both. And I am still assuming it's my environment and not the programmer's fault! Thanks again for all your hard work, halvar. |
||
June 17th, 2017, 04:28 AM | #73 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,129
Thanks: 226,701
Thanked 356,679 Times in 21,624 Posts
|
Quote:
Other hosts are not (this month) going belly up. |
|
The Following 11 Users Say Thank You to effCup For This Useful Post: |
June 17th, 2017, 05:44 AM | #74 |
Junior Member
Join Date: Jul 2009
Location: Permanent temporality
Posts: 6
Thanks: 26
Thanked 49 Times in 6 Posts
|
Effie is absolutely right about the mistake I made here.
Is there a way to strike-through comments on VEF? Last edited by temptester666; June 17th, 2017 at 05:45 AM.. Reason: Sorry for the bump. |
June 17th, 2017, 06:13 AM | #75 |
Former Staff
Join Date: Sep 2009
Posts: 16,579
Thanks: 452,836
Thanked 222,657 Times in 16,567 Posts
|
|
June 17th, 2017, 06:15 AM | #76 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
version 1.18 of imagerescue released
get it here: https://1fichier.com/?b6kgv3l0nf
Changes to 1.16 (1.17 is skipped)
But beware: If you specify a filter in th GUI and later run the command line on the same thread the command line will not filter and all pages and posts will be processed. BCFC_1982 has written a short howto: |
June 17th, 2017, 10:32 AM | #77 | |
Sunny Mod
Join Date: Jan 2016
Posts: 5,511
Thanks: 48,469
Thanked 53,317 Times in 5,482 Posts
|
Quote:
Thanks for checking, and as effie mentioned above, it's really not a thing that's quite important.
__________________
. |
|
June 17th, 2017, 10:33 AM | #78 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,129
Thanks: 226,701
Thanked 356,679 Times in 21,624 Posts
|
Quote:
A question: does the "stop" button stop both workers? The reason I ask: difficult to be sure quite this early, but maybe some different behaviour? In particular: when I (once again) encounter "sticky" images and pull the old "trick" of stopping tool, loading in browser, and restarting tool. Previously when I did that, the tool would start again, find the end of the thread, find the already processed local files, eventually return to the "sticky" image and with any luck it might un-stick for me, & progress. With 1.18: after pressing re-start, the tool seems to progress through only to where it finds the end of the thread. I do not see it progressing through the already processed local files, etc. Only if I quit the tool and re-run it can I get it to go past the end of the thread stage & into checking the already processed local files, then finally only the remaining (sticky+) images. ---- Hmm, and now, testing with two threads, I get this error msg: 2017-06-17 22:31:30 INFO: 2 threads specified: [239942, 236884] 2017-06-17 22:31:34 SEVERE: process page from must be a numeric value The fields for process pages have not been altered, i.e. they're still 1 & 100000. If I remove the second thread id the tool processes as before. This time I left it "alone" and although it seemed to get stuck a few times, it also unstuck itself. Last edited by effCup; June 17th, 2017 at 12:04 PM.. Reason: + |
|
June 17th, 2017, 01:05 PM | #79 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
vef-imagerescue 1.19 is available bugfix multiple threads ids
Quote:
The checks intended for the page-from and page-up- to fields (numeric without spaces) are applied to the thread list where spaces are allowed. Thus preventing the download of more than one thread. I fixed this in version 1.19: https://1fichier.com/?us1qj6ncpk another change in 1.19: an additional check is done after an image download: If the number of downloaded bytes does not match the size the server initially communicated the download fails and is retried later. This could help analyze the problems temptester666 had. I downloaded over a thousand of files using this check and it has not kicked in yet. Concerning Multi-Threading (parallel workers): Both workers should stop if you hit the stop button. But they do not stop immediately. The stop button sets a stop signal and the worker check the stop signal in their loop. They stop the loop if the signal is set. So it may take a few seconds until they get the message. I'm not really happy with this stopping and starting. There should be a Toggle-Button which makes the current state clearly visible. The retries at the end are not multi-threaded. |
|
June 17th, 2017, 02:36 PM | #80 |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,129
Thanks: 226,701
Thanked 356,679 Times in 21,624 Posts
|
1.19 is really good.
First sighting of any Java errors? Code:
2017-06-18 02:30:02 INFO: 2 threads specified: [271651, 271445] 2017-06-18 02:30:02 INFO: Starting Thread: 271651 2017-06-18 02:30:04 INFO: HTTP/1.1 200 OK 2017-06-18 02:30:04 INFO: IDstack cookie found. Successfully logged in to VEF 2017-06-18 02:30:04 INFO: Download first thread page: http://vintage-erotica-forum.com/t271651-p1-x.html 2017-06-18 02:30:05 INFO: HTTP/1.1 200 OK 2017-06-18 02:30:05 INFO: Thread name: Mystery_Followup_Exciting_17_cover_dark_haired_gi 2017-06-18 02:30:05 INFO: Download forum page: http://vintage-erotica-forum.com/t271651-p1-x.html to D:\saved from vef\t271651-Mystery_Followup_Exciting_17_cover_dark_haired_gi\t271651-p1-Mystery_Followup_Exciting_17_cover_dark_haired_gi.html 2017-06-18 02:30:07 INFO: End of Thread reached - no next page link found - 2017-06-18 02:30:07 SEVERE: Index: 0, Size: 0 java.lang.IndexOutOfBoundsException: Index: 0, Size: 0 at java.util.ArrayList.rangeCheck(Unknown Source) at java.util.ArrayList.get(Unknown Source) at vef.imgrescue.ImageLinkProcessor.lambda$getPosts$9(ImageLinkProcessor.java:149) at java.util.stream.Collectors.lambda$toMap$58(Unknown Source) at java.util.stream.ReduceOps$3ReducingSink.accept(Unknown Source) at java.util.stream.ReferencePipeline$2$1.accept(Unknown Source) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(Unknown Source) at java.util.stream.AbstractPipeline.copyInto(Unknown Source) at java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source) at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source) at java.util.stream.AbstractPipeline.evaluate(Unknown Source) at java.util.stream.ReferencePipeline.collect(Unknown Source) at vef.imgrescue.ImageLinkProcessor.getPosts(ImageLinkProcessor.java:146) at vef.imgrescue.ImageLinkProcessor.processForumPages(ImageLinkProcessor.java:39) at vef.imgrescue.VEFImageRescue.start(VEFImageRescue.java:100) at vef.imgrescue.Gui.lambda$null$6(Gui.java:248) at java.lang.Thread.run(Unknown Source) I quit the app. & ran it again on the same two threads, & this time no complaints or problems. |
Thread Tools | |
Display Modes | |
|
|