Also:
Code:
2017-06-18 03:38:19 INFO: image-page: [ForkJoinPool-1-worker-0] http://www.imagebam.com/image/18faf0214326512 NB, I'm posting these errors for halvar not because they're necessarily very serious or frequent (they're not); just because he might be interested. |
Quote:
This happens when the post nr cannot be determined. I am looking for the link to report a post '..report.php?p=nnn' to extract the post number. If the link is not found - bam! It may be that the html file was corrupt. Because when you retry the last html-page is downloaded again. So it works the scond time. Fetching information from arbitrary portions of the html is error prone. Sometimes a page is rendered differently just because the user has different settings and the thing breaks. Given more time one would select the elements to get the information from more carefully. If this happens again, please send me the html files before you retry. |
Quote:
Quote:
|
Hmm, only noticed later that the "top" of that log snippet was missing/cropped. I'd simply copied all & pasted from the gui window. Let me know if you want to see more/the top/start of that instance, as I should be able to retrieve it from your log file?
---- edit: Hmm. Running the tool on this thread, it has stalled at this point: Code:
2017-06-18 04:10:45 INFO: 2 threads specified: [279125, 276115] If I look in the storage folder, the second image has been processed (as a thumb, because it's a dead image). This was not a re-run over a partially-completed thread. Maybe it's just a coincidence, but I'd have thought the tool wouldn't stop at a point where it (seems it) should have already finished with that url/image file. I'd expect (& have often seen) it instead stopping/pausing at the next thumb-link/url that has yet to be processed. This thread should be "finished",:confused: but the tool has not moved on to the second thread in the queue--there's no folder been created for it. (only now) Stopping the tool & re-starting it it does finish with that thread & move on to process the next one in the queue. |
Quote:
If a download stalls you see the 'image-page...' but not the 'downloaded to'. How long do you usually wait before you act? I would give it at least 30 seconds. Usually it should be done in a second, but it sometimes just take longer. The timestamps in the log show how long it usually takes (time between 'image-page' and 'downloaded to'. The word RETRY in the log statement means that this is a retry for a previously failed attempt. It could be that retries take longer than normal requests because of the reason of the fail. The log is cropped in the because only the last part is relevant. If you want to check for a longer time period you can use the files. The log files are limited to a total of 50MB. |
I warmly recommend to use halvar's tool. It's working great. :thumbsup:
Not only for downloading and saving, but also for organize the work in a section!:cool: Working in the MIR-section there are a thousands of threads, most of them very short. But we must be sure to get them all. effCup compiled a list of the threads using halvar's tool. Copying 20 threads-numbers, paste them into the tool and let it do the work. :cool: With the list effCup created, the work is absolutely well organized. :) If I'm done with a batch I note this in the list, so nobody else will download this threads, which avoids double work. I have downloaded now 85 threads of the ordinary queries and the tool (v1.16) works very fine. Only once I faced minor problem. When the tool finished with a batch, I take a quick look into the log, if a error occured. If so, I check the thread manually again, but it happened only once until now. I will store the threads in batches of around 500 MB at a filehost. The re-hosting and editing of each thread can be done also after 30.06.2017! But saving must be done before end of June. The best thing is, while the tool is running I can work in the box and re-host the images and edit posts. I strongly suggest, to use this tool. Not only for downloading, but also for organize the work in a section with the thread-generator! The work in MIR is now organized, like effCup here and here and Al Gebra here suggested. And it's going extremely well. |
Quote:
On this occasion I noticed that many links to my pics I just recently uploaded to ImageBam are already dead, example (see also my following posts there). Only the thumbs (preview pics) are still visible/available. And vef-imagerescue-1.19 saved these at least. |
Quote:
Code:
2017-06-18 17:20:01 INFO: 2 threads specified: [268142, 268227] The html tags seem "whole", but you're right, the report button(s) are missing from that page's source. the post no. appears in several places (in a complete page, I mean), I think all buttons: reply buttons showpost buttons report buttons (what you're currently using) edit buttons Sorry, I haven't really studied the html structure.:o |
Quote:
In cases of wrong username/password this error should not occur. If a login fails you should see log text like this and the process is aborted. Code:
2017-06-18 09:35:48 INFO: Starting Thread: 718 I could change it to get the post number from the other links you mentioned. But I only want to do only really necessary changes now to avoid introducing new bugs. And besides I do not know if you really get the pages if you are not logged in. |
Don't know, if you saw this problem yet:
An error occured with this post: http://vintage-erotica-forum.com/showpost.php?p=3711213 Code:
2017-06-18 12:41:03 SCHWERWIEGEND: Error downloading 'http://www.imagebam.com/gallery/cpnazhtdpdpc3lht4u54c0icw6f3rp54' Code:
[URL=http://www.imagebam.com/gallery/cpnazhtdpdpc3lht4u54c0icw6f3rp54][IMG]http://thumbnails116.imagebam.com/49580/eb8796495795513.jpg[/IMG][/URL] But I assume, this isn't a bug in the tool. It's more a very similar situation as with direct linked galleries, which we yet discussed here. Btw, the tool saved properly the image which is linked in the signature of Gladys Allova. :D http://thumbnails117.imagebam.com/52...b521632488.jpg |
All times are GMT. The time now is 08:40 AM. |
vBulletin Optimisation provided by
vB Optimise v2.6.1 (Pro) -
vBulletin Mods & Addons Copyright © 2024 DragonByte Technologies Ltd.