June 22nd, 2017, 06:22 AM | #141 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
version 1.24 of imagerescue released
https://1fichier.com/?g7rl5vpbd7
changes to 1.23: bugfix: thumbnails are not downloaded twice (thumb_xxx.jpg and thumb_xxx_1.jpg) |
June 23rd, 2017, 10:18 AM | #142 |
Sunny Mod
Join Date: Jan 2016
Posts: 5,525
Thanks: 48,677
Thanked 53,467 Times in 5,496 Posts
|
One minor remark: I always check the csv-report after downloading a batch, for the images with "n/a; -1".
Only once, the tool missed the dl of an image, which I could grabb manually. But now I've seen following: There is a file-name given in the report and a file-size "0". The tool saved an image with a file size 0, but not the thumb, which is available. The image isn't available for dl. This post: http://vintage-erotica-forum.com/showpost.php?p=3293177 Code:
289896;solved_Monique_ATK_Super_wow_busty_blonde_unknown;1;1;3293177;bannator;http://thumbnails106.imagebam.com/41247/da03fa412465077.jpg;http://www.imagebam.com/image/da03fa412465077;superb-big-boobs-in-a-picture-jpg980.jpg;0 So I will check in the future the file-size "0" in the reports, to dl the thumb manually.
__________________
. |
June 23rd, 2017, 06:27 PM | #143 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
The error detection is not 100% reliable, but should be more than 99.9%. There are many things in networking that can go wrong and sometimes something goes wrong without an error message. So there still could be corrupt files with a size > 0. I thought about decoding each downloaded file to make sure the files are valid, but that would slow things down. I regularly browse through many of the files and have not encountered a corrupt file. |
|
June 23rd, 2017, 09:40 PM | #144 | |
Sunny Mod
Join Date: Jan 2016
Posts: 5,525
Thanks: 48,677
Thanked 53,467 Times in 5,496 Posts
|
Quote:
I only wanted to bring this to your attention. At the moment I completely rely at your tool. Downloading, making the report and checking the -1 or 0 files. Btw, I've seen this "0" file only once. But I'm absolutely happy with the tool as it is now!
__________________
. |
|
June 25th, 2017, 04:37 PM | #145 |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
vef-imagerescue 1.26 is available
https://1fichier.com/?6kam44b708
This release contains two functions to fix issues with old downloads (before 1.7 and before 1.15). The download functionality remains unchanged. Fix missing imgbox filenames for downloads before version 1.15 (released on 06-16-2017): Imgbox downloads were not set to the original filename. The filename was the cryptic hash (e.g. VAESDLAd). This fix scans through the whole storage folder and checks images downloaded from imgbox if they are still named after the hash. If that is the case, the imgbox web page for the image is fetched and the original filename is extracted. The image file is renamed and the new filename is written to the dot-file. To start this process press the button "Fix Imgbox file names" on the second tab. Add the postnumber to post folders (e.g. rename tnnn-...-post-1 to tnnn-...-post-1-nnnn) for downloads before version 1.7 (released on 06-11-2017): Local html files in the storage are scanned for posts. Post count and post number are extracted. If the corresponding post folder's name does not contain the post number, the post folder is renamed. This process does not download anything, it only works on local files. The post number might be necessary for a possible (half-) automatic post update tool. To start this process press the button "postnr for folders before 1.7" on the second tab. If you have a large storage folder these processes take a long time. I recommend temporarily moving the affected thread folders in another storage folder and moving them back afterwards. |
July 1st, 2017, 12:42 PM | #146 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
I am currently rebuilding the tool from scratch. It will support most of the hosters. The new version will hopefully be easier to use. I intend to distribute a Java Runtime Environment and a batch file with it. So you do not need to install Java. The basic principle will stay the same. It will work per forum thread and save the files in the same directory structure. But there will be no GUI, only command line and configuration files. I am running it nightly on my NAS using cron so there is no GUI. Maybe the scrap files will be replaced with an embedded database. I am still thinking about it. As long as you have the scrap files the data can be imported to the database. And a database could make it more manageable if you have more than a million files. Maybe the next version can be released next next weekend. |
|
July 1st, 2017, 08:52 PM | #147 | |
Blocked!
Join Date: Jan 2008
Location: HH
Posts: 1,963
Thanks: 115,040
Thanked 32,801 Times in 1,955 Posts
|
Quote:
one file for general configuration values, e.g. Code:
baseurl=http://vintage-erotica-forum.com username=<your vef username> password=<your vef password> storagepath=<your path where you store your downloads, like 'c:/vef/storage'> Code:
12345 6789 33333 The general idea is to define a list of threads that you like and then start the backup periodically to get new posts. Problems and limitations
|
|
July 2nd, 2017, 01:55 PM | #148 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,143
Thanks: 226,791
Thanked 357,042 Times in 21,638 Posts
|
Quote:
Z:\_Pix\VEF-Rescue\ t3146-Ginger_Lynn_Classic_Pornstars\ p4-post-34-249738\ .... or some such?96458_676211_354be8a7724_122_699lo.jpg |
|
July 2nd, 2017, 02:47 PM | #149 |
Sunny Mod
Join Date: Jan 2016
Posts: 5,525
Thanks: 48,677
Thanked 53,467 Times in 5,496 Posts
|
Is there a need for the pagenr. ("p4") and the post nr. ("post-34")?
Pagenr. depends on the settings. Page nr. and post nr. can change if other posts gets moved/deleted. Wouldn't it be sufficient to have the postID ("p249738"), which doesn't change?
__________________
. |
July 2nd, 2017, 02:57 PM | #150 | |
Vintage Idiot
Join Date: Feb 2012
Location: History
Posts: 22,143
Thanks: 226,791
Thanked 357,042 Times in 21,638 Posts
|
Quote:
edit: if we really wanted to save typing we might ask for: p=249738 Last edited by effCup; July 2nd, 2017 at 03:15 PM.. |
|
|
|