Also:
& as before, closing the app. & re-running on that thread encountered no errors & finished the thread.:)

NB, I'm posting these errors for halvar not because they're necessarily very serious or frequent (they're not); just because he might be interested.

I have seen this once and deezer reported the same.

This happens when the post nr cannot be determined. I am looking for the link to report a post '..report.php?p=nnn' to extract the post number. If the link is not found - bam!

It may be that the html file was corrupt. Because when you retry the last html-page is downloaded again. So it works the scond time.
Fetching information from arbitrary portions of the html is error prone. Sometimes a page is rendered differently just because the user has different settings and the thing breaks. Given more time one would select the elements to get the information from more carefully.

If this happens again, please send me the html files before you retry.

This is really curious, I never thought this could happen. In this case the log text cannot be written in the log field because there is not text. There should always be text or at least an empty string. I will add a check to prevent this.

Thanks for the reports, they help to improve the tool. We should think about setting up a bug tracker. The

Hmm, only noticed later that the "top" of that log snippet was missing/cropped. I'd simply copied all & pasted from the gui window. Let me know if you want to see more/the top/start of that instance, as I should be able to retrieve it from your log file?

----

edit: Hmm. Running the tool on this thread, it has stalled at this point:
That last line is the url of the second quoted image in that thread's first post.

If I look in the storage folder, the second image has been processed (as a thumb, because it's a dead image). This was not a re-run over a partially-completed thread.

Maybe it's just a coincidence, but I'd have thought the tool wouldn't stop at a point where it (seems it) should have already finished with that url/image file.

I'd expect (& have often seen) it instead stopping/pausing at the next thumb-link/url that has yet to be processed.

This thread should be "finished",:confused: but the tool has not moved on to the second thread in the queue--there's no folder been created for it.

(only now) Stopping the tool & re-starting it it does finish with that thread & move on to process the next one in the queue.

There are two server calls between the first log statements 'image-page...' and 'downloaded ... to ...
If a download stalls you see the 'image-page...' but not the 'downloaded to'. How long do you usually wait before you act? I would give it at least 30 seconds. Usually it should be done in a second, but it sometimes just take longer. The timestamps in the log show how long it usually takes (time between 'image-page' and 'downloaded to'.

The word RETRY in the log statement means that this is a retry for a previously failed attempt. It could be that retries take longer than normal requests because of the reason of the fail.

The log is cropped in the because only the last part is relevant. If you want to check for a longer time period you can use the files. The log files are limited to a total of 50MB.

I warmly recommend to use halvar's tool. It's working great. :thumbsup:

Not only for downloading and saving, but also for organize the work in a section!:cool:

Working in the MIR-section there are a thousands of threads, most of them very short. But we must be sure to get them all.
effCup compiled a list of the threads using halvar's tool. Copying 20 threads-numbers, paste them into the tool and let it do the work. :cool:

With the list effCup created, the work is absolutely well organized. :)
If I'm done with a batch I note this in the list, so nobody else will download this threads, which avoids double work.

I have downloaded now 85 threads of the ordinary queries and the tool (v1.16) works very fine.
Only once I faced minor problem.

When the tool finished with a batch, I take a quick look into the log, if a error occured.
If so, I check the thread manually again, but it happened only once until now.

I will store the threads in batches of around 500 MB at a filehost.
The re-hosting and editing of each thread can be done also after 30.06.2017!
But saving must be done before end of June.

The best thing is, while the tool is running I can work in the box and re-host the images and edit posts.

I strongly suggest, to use this tool. Not only for downloading, but also for organize the work in a section with the thread-generator!

The work in MIR is now organized, like effCup here and here and Al Gebra here suggested. And it's going extremely well.

I just tested vef-imagerescue-1.19, and it did what I requested, thanks halvar! :thumbsup:

On this occasion I noticed that many links to my pics I just recently uploaded to ImageBam are already dead, example (see also my following posts there). Only the thumbs (preview pics) are still visible/available. And vef-imagerescue-1.19 saved these at least.

Saved files/folder output here, before any re-starts.

The html tags seem "whole", but you're right, the report button(s) are missing from that page's source.

the post no. appears in several places (in a complete page, I mean), I think all buttons:

reply buttons
showpost buttons
report buttons (what you're currently using)
edit buttons

Sorry, I haven't really studied the html structure.:o

Thanks for the file. It seems that the login failed or got lost. The file contains text 'Register on the forum now ...' that is shown if you are not logged in. And if are not logged in you cannot report posts so the report post links are missing.

In cases of wrong username/password this error should not occur.
If a login fails you should see log text like this and the process is aborted.
But it can also be that the login is lost after it initially succeeded. The login is kept in a session cookie. Sometimes these cookies get lost. This could be for various reasons and also happens sometimes in browsers.

I could change it to get the post number from the other links you mentioned. But I only want to do only really necessary changes now to avoid introducing new bugs. And besides I do not know if you really get the pages if you are not logged in.

Don't know, if you saw this problem yet:

An error occured with this post:
http://vintage-erotica-forum.com/showpost.php?p=3711213

The poster set a thumbnail, which directs not to the full image, but to an imagebam gallery:-)

I will dl the gallery now with IHG. If you need the html-file, please let me know.

But I assume, this isn't a bug in the tool. It's more a very similar situation as with direct linked galleries, which we yet discussed here.


Btw, the tool saved properly the image which is linked in the signature of Gladys Allova. :D

http://thumbnails117.imagebam.com/52...b521632488.jpg