June 21st, 2017, 05:28 AM | #131 | ||
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
Now that I am writing this: I could compare the files. Either a quick compare of the file size (exact number of bytes) or do a complete comparison byte for byte. To get rid of the duplicates you already have: There are free tools out there that search for duplicate files. Filter the result for thumb_*_1.* and delete them. Quote:
You could look into the threads download folder to see how many pages are left with no existing page folder. The new version is slower due to increased timeouts. (30 seconds instead of 20) |
||
June 21st, 2017, 05:37 AM | #132 | ||
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
Quote:
|
||
June 21st, 2017, 06:20 AM | #133 |
Sunny Mod
Join Date: Jan 2016
Posts: 5,523
Thanks: 48,654
Thanked 53,449 Times in 5,494 Posts
|
Thanks a lot for implementing the thumbnail-download for images which gets a timeout.
About the duplication: better get the thumb twice, then nothing. I will dl the new version and give it a try. Thanks a lot for all your effort and for creating this great tool!
__________________
. |
The Following 16 Users Say Thank You to deezer For This Useful Post: |
June 21st, 2017, 10:32 AM | #134 |
Sunny Mod
Join Date: Jan 2016
Posts: 5,523
Thanks: 48,654
Thanked 53,449 Times in 5,494 Posts
|
I tested now 1.23 and it works great.
I get all the images and the thumbs when there is an timeout.
__________________
. |
The Following 12 Users Say Thank You to deezer For This Useful Post: |
June 21st, 2017, 02:00 PM | #135 | |
Member
Join Date: Feb 2012
Posts: 15
Thanks: 589
Thanked 132 Times in 14 Posts
|
Quote:
About all of the timeouts/undownloadable pictures people seem to be getting when using the tool: You are totally at the "mercy" of the web servers that imagbam/imagebox run and how loaded they are at the moment of download. A web server might start serving a request and then gets starved for resources of one type or the other and simply abort the request. Or one might not be able to connect to the server full stop to begin with (that would be the connect-timeout mentioned above). I can very well imagine that problem to get worse as the end of june comes near as a) increasing numbers of people start downloading their files before they vanish, b) reliability is probably not foremost on the mind of the imagebam/box team right now, with employees looking for other jobs and routine maintanance on the backburner (in ten days all this will be moot anyway). Last edited by testuser4711; June 21st, 2017 at 02:16 PM.. Reason: additional info about timeouts |
|
June 21st, 2017, 02:22 PM | #136 |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,143
Thanks: 226,789
Thanked 357,029 Times in 21,638 Posts
|
imgbox is currently unresponsive--thanks to deezer for analysis/spotting nature of problem.
Running halvar's tool over threads with imgbox links in them I think will produce "empty" dot files, i.e. containing no image filenames, so file size = 0. You could simply decide to try them again later. One way to "discover" where such files might lie is: on windows, use cmd to cd to the directory in which you've saved the folders output by halvar's tool, then run this (all one line): Code:
forfiles /m .* /s /C "cmd /c if @fsize EQU 0 echo @path" > output.txt edit: ha! Just after that imgbox seems to be back up & running. Hmm, & the above also finds dot files of zero size that correspond to missing -bam files as well, which is less helpful. Last edited by effCup; June 21st, 2017 at 03:55 PM.. |
June 21st, 2017, 03:39 PM | #137 |
Super Moderator
Join Date: Mar 2009
Posts: 3,870
Thanks: 1,043,050
Thanked 52,360 Times in 3,827 Posts
|
I've solved the difficulty experienced with the threaded versions of vef-image-rescue by moving from an "older" amd x4 computer to testing on a "newer" intel i5 computer (both win-7 64bit). Armed with that information I've "borrowed" an intel-based server and it's running four v1.23 cmd prompts at the moment......approx 1000 pages to go so hoping imagbam doesn't get flaky like imgbox.
|
June 21st, 2017, 08:50 PM | #138 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
threadId, threadTitle, pageNr, postCount, postNr, poster, thumbnailURL, imageUrl, imageFileName, imagefile size imagefilename and imagefilesize are 'n/a' and -1 for failed downloads, e.g. Code:
3164;Loni_Sanders_Classic_Pornstars;17;166;1481827;Curtis23;http://thumbnails39.imagebam.com/12068/857a3b120672517.jpg;http://www.imagebam.com/image/857a3b120672517;gfb42646.jpg;27399 3164;Loni_Sanders_Classic_Pornstars;17;166;1481827;Curtis23;http://thumbnails40.imagebam.com/12068/b63e56120672520.jpg;http://www.imagebam.com/image/b63e56120672520;n/a;-1 |
|
June 21st, 2017, 09:52 PM | #139 | |
Sunny Mod
Join Date: Jan 2016
Posts: 5,523
Thanks: 48,654
Thanked 53,449 Times in 5,494 Posts
|
Quote:
I tried the report on a small batch that I downloaded and get an quick overview what is missing. "n/a and -1" is also reported, if the image-download failed, even you saved the thumb, correct? In my test, at least most times the thumbnail is saved for the reported (n/a; -1) files except one gallery where the images are deleted by the uploader.
__________________
. |
|
The Following 14 Users Say Thank You to deezer For This Useful Post: |
June 22nd, 2017, 04:54 AM | #140 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
|
|
|