Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!
vintage erotica forum vintage erotica forum vintage erotica forum
vintage erotica forum

Go Back   Vintage Erotica Forums > Information & Help Forum > Help Section > Imagebam/Imgbox are no longer shutting down

Follow Vintage Erotica Forum on Twitter
Best Porn Sites Meet Our Girls Register FAQ Members List Calendar Mark Forums Read

Notices
Imagebam/Imgbox are no longer shutting down The day has been saved, the sites are not shutting, more info soon.


Reply
 
Thread Tools Display Modes
Old 01-24-2018, 08:15 AM   #181
halvar
Journeyman
 
halvar's Avatar
 
Join Date: Jan 2008
Location: HH
Posts: 579
Thanks: 24,069
Thanked 7,286 Times in 567 Posts
halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+
Default

I have created a new version of the forum backup tool:
Version 0.0.6, https://1fichier.com/?t870vumjcm
  • usability is improved, editing of files is not needed anymore
  • a bug was fixed that prevented the generation of reports under Windows
  • there are three download modes supported: single post, threads, backup
I do not know if anybody is still interested. If not, I am not disappointed.
The tool is mainly created for my personal use. It would be nice somebody else finds it useful. But if not then not. I know that it is not very easy to use.

What does it do
  • download pages from a forum, threads or posts
  • store the information about these in an embedded database
  • parse posts for links to image hosts
  • download linked images
About
  • this is a java program. The program requires a Java8 runtime environment
  • the distributed zip contains a JRE for Windows
  • it is developed on Linux, but it also run on Windows.
  • I personally use it on Linux and only test it briefly under Windows
  • configuration values are stored by default under <user home>/forum-backup/forum-backup.properties
  • there are log files in <user home>/forum-backup/logs
  • downloaded files and the embedded database are stored in configured location
  • do not alter your thread display options like display mode and number of posts per page in your forum settings. It would mess up the downloaded pages.
Upgrade
New versions pick up settings and data from previous versions.
  • unzip zip file
  • start program
  • goto settings and check configuration values
  • do a check configuration

New Installation
unzip the zip file anywhere

start forum-backup.bat, e.g. by double click. A console window opens

open the url http://localhost:3137/ with your browser

click on the settings page link and enter your values

click on 'Check Configuration'. The output should look like this (every line starting with 'OK')

click on 'Save Configuration' to save the configuration. The configuration values are saved to <user-home>/forum-backup/forum-backup.properties.
e.g. 'C:\Users\<your login name>\forum-backup\forum-backup.properties' depending on your operating system.

Click on the 'Back to main view' link and start with downloading a single post

There are tree ways to download
posts
Only posts and linked images are downloaded. Nothing is stored in the database.
Enter one or more post numbers and click on 'Download Post'

The images are saved to <storage-path>/adhoc-posts/<post-folder>, e.g. 'C:\data\forum-storage\adhoc-posts\Judith_Ramirez-post-2230617'


threads

One or more threads are downloaded. For each thread
  • thread pages are downloaded if they are not downloaded yet
  • the last page of a thread is always downloaded, because it could contain new posts.
  • the downloaded pages are parsed for posts and image links
  • this information is stored in the database
  • image links that have not been downloaded yet are downloaded
  • failed image downloads are marked for retrying them later
  • previously failed image downloads are retried
enter one ore more threads with optional start page and click 'Download Threads'

during the download a simple progress bar is shown

downloaded files are stored at the storage location:


thread backup
  • for all active threads configured in the database the forum is determined
  • forum pages are downloaded for these until a the last forum scan date is reached (maximum 14 days)
  • if a thread was modified since that date it is downloaded
  • due to the overhead of checking for modified threads it is only economically if you have many threads (> 100) configured and if the process is started regularly, e.g. once a day.
halvar is online now   Reply With Quote
The Following 14 Users Say Thank You to halvar For This Useful Post:
Old 03-31-2018, 07:47 AM   #182
halvar
Journeyman
 
halvar's Avatar
 
Join Date: Jan 2008
Location: HH
Posts: 579
Thanks: 24,069
Thanked 7,286 Times in 567 Posts
halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+
Default 0.0.7 with pixhost.to support

The new version 0.0.7 was released. It contains:
* support for pixhost.to
* pixhost.to links are converted to pixhost.to when downloading. This should not be necessary anymore since the links were fixed on the forum
* a new report to show downloads of the last n days, with optional filtering for failed downloads.

Full install (including java runtime)
https://1fichier.com/?d4gkjyjy94 (66MB)

Only the jar:
https://1fichier.com/?lwymlqpmoa (7MB)
If you have a working installation just replace your forum-backup-0.0.x.jar with the new forum-backup-0.0.7.jar
halvar is online now   Reply With Quote
The Following 9 Users Say Thank You to halvar For This Useful Post:
Old 04-01-2018, 02:57 PM   #183
The Old Hacker
Vintage Member
 
Join Date: Jun 2007
Location: England Town
Posts: 1,062
Thanks: 1,591
Thanked 15,846 Times in 982 Posts
The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+The Old Hacker 50000+
Default

Halvar: These GitLab links all seem to be dead. It's the same for the Teknik Git links posted earlier in this thread. Are you still hosting on Git?

Last edited by The Old Hacker; 04-01-2018 at 03:14 PM.. Reason: Edited text.
The Old Hacker is offline   Reply With Quote
The Following 6 Users Say Thank You to The Old Hacker For This Useful Post:
Old 04-01-2018, 03:39 PM   #184
halvar
Journeyman
 
halvar's Avatar
 
Join Date: Jan 2008
Location: HH
Posts: 579
Thanks: 24,069
Thanked 7,286 Times in 567 Posts
halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+
Default

Quote:
Originally Posted by The Old Hacker View Post
Halvar: These GitLab links all seem to be dead. It's the same for the Teknik Git links posted earlier in this thread. Are you still hosting on Git?
No, it is not in a public repo. First I moved to gitlab because I had technical problems with teknik.io. Then I had doubts about having it in a public repo. I was paranoid and wanted to remove most of the stuff I had online.

Also I did not want to have the documentation with screen shots containing VEF in a public repo. Even though issue tracking and wiki would be nice.

The source is included in the zip download. It is a Java project using gradle. If you have a JDK installed you can build it using gradle, e.g. './gradlew build'.

Please drop me a line if you have suggestions for improvements or found errors. (I know of the text errors on the settings page).

Sadly I cannot make this my official side project, since "Downloader for erotic material" does not look that good on a resume. So I have another official side project where I spend most of my free programming time on.
halvar is online now   Reply With Quote
The Following 10 Users Say Thank You to halvar For This Useful Post:
Old 04-15-2018, 06:15 PM   #185
halvar
Journeyman
 
halvar's Avatar
 
Join Date: Jan 2008
Location: HH
Posts: 579
Thanks: 24,069
Thanked 7,286 Times in 567 Posts
halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+
Default forum-backup 0.0.8 with improved handling of deleted posts/pages

The new version 0.0.8 was released. It contains:
  • improved logging of exceptions (now with stack trace)
  • improved handling of deleted posts/pages

handling of deleted posts/pages
situation:
A thread had pages from 1 to 10 and those were previously downloaded. Now multiple posts are deleted and only pages 1 to 7 exist. A new post is added to page 7.

previous behavior:
Page 7 is not downloaded because locally page 10 exists. The new post is missed.

new behavior:
previously downloaded pages 8 to 10 are renamed by appending the date to the filename.
page 7 is downloaded.

There are still scenarios where new posts are missed, but this fixes a major one. I expect more deletions in the future (because of dmca, cleanups and newly banned content)

Full install (including java runtime)
https://1fichier.com/?lb6qavanj1 (66MB)

Only the jar:
https://1fichier.com/?bpf29h2561 (7MB)
If you have a working installation just replace your forum-backup-0.0.x.jar with the new forum-backup-0.0.8.jar
halvar is online now   Reply With Quote
The Following 10 Users Say Thank You to halvar For This Useful Post:
Old 05-11-2018, 10:14 AM   #186
deezer
Moderator
 
deezer's Avatar
 
Join Date: Jan 2016
Posts: 1,395
Thanks: 10,100
Thanked 10,742 Times in 1,539 Posts
deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+
Default

I haven't tested your new tool yet.


It seems that p&h changed the BB-code long ago. (the post I noticed that is from 2008)
The images are still up, but the thumbnail don't work.
The image url has changed but redirects to the new url.

I can't show you the post, as the old BB-code was now manually updated. But here is an example:


Old BB-code:
[URL=http://image.pimpandhost.com/guest/879324_x.html][IMG]http://pimpandhost.com/media/simple/1/thumbs/da498bdb2dda_1.jpg[/IMG][/URL]

New BB-code:
[URL=http://pimpandhost.com/image/879324][IMG]http://ist1-3.filesor.com/media/image/1/_/_/_/1/d/a/4/9/thumbs%2Fda498bdb2dda_0.jpg[/IMG][/URL]

My question is: does your tool download the images with the old BB-code too?
IHG doesn't work on these.
__________________
.

Check this sub-forum:


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
deezer is offline   Reply With Quote
The Following 6 Users Say Thank You to deezer For This Useful Post:
Old 05-11-2018, 12:07 PM   #187
halvar
Journeyman
 
halvar's Avatar
 
Join Date: Jan 2008
Location: HH
Posts: 579
Thanks: 24,069
Thanked 7,286 Times in 567 Posts
halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+halvar 25000+
Default

Old or new should not matter. The HTML page behind that URL is downloaded, no matter what the URL looks like. The challenge is usually to find the image and the original filename on that page.

I just downloaded post
Quote:
Originally Posted by chrisnewcombe View Post
some more very hot shots of the incredible Gillian
and got 11 images.
Is that the kind of post you are referring to? It seems to have old style URLs:
HTML Code:
<a href="http://image.pimpandhost.com/guest/498275_x.html" target="_blank"><img src="http://pimpandhost.com/media/simple/1/thumbs/7d156ac06bf7_1.jpg" border="0" alt="" onload="..." /></a>
I think the problem is the pimpandhost urlpattern in the IHG hostfile
HTML Code:
<host id="pimpandhost"><urlpattern>^https?:\/\/(?:image\.|www\.)?pimpandhost\.com\/image\/.+?$</urlpattern><searchpattern>function(pageData, pageUrl) {
	var iUrl = pageData.match(/img class=('|")normal\1 src=('|")(https?:\/\/.+?)(_l)?(\.(gif|jpe?g|png|GIF|JPE?G|PNG))\2/);
	return iUrl ? {imgUrl:  iUrl[3] + iUrl[5], status: "OK"} : {imgUrl: null, status: "ABORT"}
}</searchpattern></host>
It expects pimpandhost URLs to have a path beginning with /image, but the old urls begin with /guest.
This urlpattern could work:
HTML Code:
^https?:\/\/(?:image\.|www\.)?pimpandhost\.com\/(image|guest)\/.+?$
I do not have IHG, so I cannot test it.

Last edited by halvar; 05-11-2018 at 12:26 PM.. Reason: grammar
halvar is online now   Reply With Quote
The Following 6 Users Say Thank You to halvar For This Useful Post:
Old 05-11-2018, 01:31 PM   #188
deezer
Moderator
 
deezer's Avatar
 
Join Date: Jan 2016
Posts: 1,395
Thanks: 10,100
Thanked 10,742 Times in 1,539 Posts
deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+deezer 50000+
Default

Thanks a lot.

I have IHG, but I'm not familiar with editing the hostfile, so I will dl your forum backup!

Quote:
I do not have IHG, ...
For a good reason, because you have created a superior tool.
__________________
.

Check this sub-forum:


To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
deezer is offline   Reply With Quote
The Following 7 Users Say Thank You to deezer For This Useful Post:
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump




All times are GMT. The time now is 06:42 AM.






vBulletin Optimisation provided by vB Optimise v2.6.1 (Pro) - vBulletin Mods & Addons Copyright © 2018 DragonByte Technologies Ltd.