Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!
vintage erotica forum vintage erotica forum vintage erotica forum
vintage erotica forum

Go Back   Vintage Erotica Forums > Information & Help Forum > Help Section > Tutorials

Follow Vintage Erotica Forum on Twitter
Best Porn Sites Meet Our Girls Register FAQ Members List Calendar Mark Forums Read

Notices
Tutorials Step by step Guides and How to's with screengrabs.


Reply
 
Thread Tools Display Modes
Old 05-29-2013, 03:08 PM   #21
hos
no remorse.
 
hos's Avatar
 
Join Date: Nov 2008
Location: relocated to lurkerland.
Posts: 8,989
Thanks: 28,006
Thanked 68,236 Times in 8,192 Posts
hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+hos 350000+
Default

Quote:
Originally Posted by Denaniel View Post
The problem was, sometimes a file would fail to download completely, and then I'd have to go back and find the link for that file at the multihoster again and choose a different host.

Instead of deleting, I now just disable the other links, by right clicking on all but one link for each file and selecting "disable" from the list.

Here is an example:


in addition to this good hint - you need to make sure that you also push all disabled files from the linkgrabber tab to the download tab ("continue with all") - because the linkgrabber queue won't be stored if you quit jdownloader. somehow a strange behaviour of this nice tool, there are even no options to store the linkgrabber queue into a jd-like export-file.
__________________
Always the same pack, sunshiny dandering around like a bitch in heat to the presenters..
hos is offline   Reply With Quote
The Following 4 Users Say Thank You to hos For This Useful Post:
Old 05-30-2013, 03:51 AM   #22
deepsepia
Vintage Member
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 2,981
Thanks: 12,453
Thanked 25,315 Times in 2,961 Posts
deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+
Default

Quote:
Originally Posted by hos View Post
in addition to this good hint - you need to make sure that you also push all disabled files from the linkgrabber tab to the download tab ("continue with all") - because the linkgrabber queue won't be stored if you quit jdownloader. somehow a strange behaviour of this nice tool, there are even no options to store the linkgrabber queue into a jd-like export-file.
-- Yes, a weird little quirk of JDownloader; doesn't save the linkgrabber tab. What I do is send to the downloader and then save as a DLC container if I don't want to download there and then.

One thing about Denaniel's issue: JDownloader is smart enough to ignore duplicates of files its already downloaded. So go ahead and just dump all the links into the linkgrabber, and send them to Download. JDownloader will grab the first working link, and then ignore the dupes ("mirror already exists").

This is especially useful for older board multipart posts to multiple hosts, where individual files may be dead. You should check by eye just to be sure that there is at least one good copy of each link though . . . Jdownloader will happily download 7 parts of an 8 part file when one part is missing . . . a waste of your bandwidth.
deepsepia is offline   Reply With Quote
The Following 3 Users Say Thank You to deepsepia For This Useful Post:
Old 10-23-2013, 10:39 PM   #23
nobadguy
Senior Member
 
Join Date: Oct 2012
Posts: 157
Thanks: 5,233
Thanked 653 Times in 104 Posts
nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+
Default

Could someone take a look at my thread, I have problems with some picture links that all JD version show as offline but that are online:
http://vintage-erotica-forum.com/sho...d.php?t=251265
nobadguy is offline   Reply With Quote
The Following User Says Thank You to nobadguy For This Useful Post:
Old 08-05-2014, 09:58 PM   #24
bluenoise
Senior Member
 
bluenoise's Avatar
 
Join Date: Nov 2008
Posts: 118
Thanks: 5,245
Thanked 427 Times in 79 Posts
bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+bluenoise 1000+
Default

I'm deeply confused and hoping someone can give me the answer, direct me to a FAQ, etc. I feel like a cluseless n00b on this one.

I just installed the current version (0.9.334) and pointed it at a posting of magazine scans (http://vintage-erotica-forum.com/sho...0&postcount=89). Very simple, just want the scane on imagebam that the links point to. Fed that URL into jdownloader, and the linkgrabber didn't get the imagebam links - at all. I must be doing something stupid.

Help!

(And thanks.)
__________________
The only thing better than a nude woman is a nude woman in a pair of very high heeled shoes.
- Vivienne Westwood
bluenoise is offline   Reply With Quote
The Following User Says Thank You to bluenoise For This Useful Post:
Old 08-07-2014, 02:59 AM   #25
nobadguy
Senior Member
 
Join Date: Oct 2012
Posts: 157
Thanks: 5,233
Thanked 653 Times in 104 Posts
nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+nobadguy 2500+
Default

For downloading images I would rather try firefox with the extension "ImageHost Grabber", that works sooo much better than JD.
JD can be a pain in the a.. to let him get all the links, let them be checked, sort out thumbnails, etc., it simply works much better in FF with the ImageHost Grabber extension.
Take a look at this thread:
http://vintage-erotica-forum.com/showthread.php?t=37450
nobadguy is offline   Reply With Quote
The Following 2 Users Say Thank You to nobadguy For This Useful Post:
Old 12-11-2014, 06:29 PM   #26
deepsepia
Vintage Member
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 2,981
Thanks: 12,453
Thanked 25,315 Times in 2,961 Posts
deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+
Default

JDownloader has changed quite dramatically with the new JDownloader2. Its a work in progress, with almost nightly builds of the Beta and there are a lot of changes.

The net effect is that its got a lot of helpful advances, but at the expense of clarity.

I note that they seem to have stomped the perennial bug "cannot write to HDD"

One of the really nice advances is to filter your linklist by filetype, so if you've ingested a bunch of GIFs and associated garbage as you plundered a thread, you can easily ignore them.

There are many changes, perhaps the most curious "My JDownloader" which is a mobile interface to your desktop install, so you can add links/solve captchas from your mobile device. Handy for siterippers

. . . but . . .

My concern about JDownloader was and remains security. Running Jdownloader requires enabling Java, which has some security problems, and Jdownloader has a lot of control. I've never seen any suggestion of malware in JDownloader itself, but the way they're extending their reach, if something were to go bad, you'd be very compromised.
deepsepia is offline   Reply With Quote
The Following 2 Users Say Thank You to deepsepia For This Useful Post:
Old 10-10-2015, 04:32 PM   #27
deepsepia
Vintage Member
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 2,981
Thanks: 12,453
Thanked 25,315 Times in 2,961 Posts
deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+
Default

Quick and Dirty webscraping with JDownloader

OK, a new tip, and a very useful one.

Have you ever wanted to get all the links from a thread on a board? There are some huge threads here and on other web forums, let's say you want to get all the links from a 200 page thread . . . how are you going to do it?

You could go to each page on and right click on the link . . . you'll get the links, and carpal tunnel syndrome as well. I've previously pointed out that you can grab all the links from a single page, with JD, by doing a Ctrl-A & Ctrl-C [Select all, Copy All] on the page, because JD will parse links from stuff you put on the clipboard. But there are some very big threads out there, hundreds of pages . . . that could still take some time.

There's gotta be an easier way to do this, you'd think-- and you'd be right.

If you write PHP or Python, there are a lot of ways to do it, but let's say you don't write code.

Jdownloader is your friend. You can take the address of any page from a thread and paste it into JD's Linkgrabber's "Analyze and add links" feature (the "plus" [+] button on the lower left corner of Linkgrabber), and JD will analyze the page and look for download links.

Ah, but what if you have a thread with a hundred pages? Suppose you have a thread:
[someforum]/Girlswithbigbooks-[Pagenumber].html -- where the pages are identified 1 through 100?

Simple. I used a little basic interpreter, but you can use whatever you know-- a spreadsheet would be fine-- to generate a text file that reads

[someforum]/Girlswithbigbooks-p1.html
[someforum]/Girlswithbigbooks-p2.html
[someforum]/Girlswithbigbooks-p3.html

and so on up to 100, or whatever number of pages there are. Note that there are number of different ways that different forums deal with page numbers, you just have to copy the format used in the thread that you're interested in.

Now copy it and paste into JD's "Add New Links" utility. JD will most likely pop up a screen saying that it couldn't find any links, and asks if you want it to perform "Deep Link Analysis" -- basically looking at each item on the page and seeing if it links through to a downloadable file. Click "Yes" to this.

JD will iterate through the pages, looking for all links & images (you can restrict JD to looking for links, to ignore images, and so on). Some sites hide links behind "Code" tags, I'm not sure if JD picks them up, haven't tried yet.

Its a bit slow -- for a massive thread its the sort of job to leave JD humming on overnight.

But it works very well, and if utilities like "WGET" leave you saying "huh?", then this approach -- which experienced web coders will tell you is amateur kludge-- is going to be the easiest.


Last edited by deepsepia; 10-10-2015 at 06:52 PM..
deepsepia is offline   Reply With Quote
The Following 5 Users Say Thank You to deepsepia For This Useful Post:
Old 10-19-2015, 07:14 PM   #28
deepsepia
Vintage Member
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 2,981
Thanks: 12,453
Thanked 25,315 Times in 2,961 Posts
deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+
Default Linkgrabber Filtering in JDownloader 2

Very useful, here's an example, which limits the links that JD will add to archives and video files (eg rejects all the random HTML, images and other stuff that you'd otherwise hoover up as you rip a site or thread)

deepsepia is offline   Reply With Quote
The Following 4 Users Say Thank You to deepsepia For This Useful Post:
Old 05-02-2016, 03:12 PM   #29
lagerlout
Veteran Member
 
lagerlout's Avatar
 
Join Date: Jun 2010
Posts: 3,453
Thanks: 22,899
Thanked 39,592 Times in 3,313 Posts
lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+lagerlout 175000+
Default

Anyone notice it doesn't appear to be updating anymore ?

also some of my old 1fichier links say " This link is set to private " but they will download direct in Firefox just fine ?
__________________
Nice girls are nice but BAD gals are much much better
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.


Please Pm me with any of my links that are not working. Please do not repost my links
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
lagerlout is offline   Reply With Quote
The Following 2 Users Say Thank You to lagerlout For This Useful Post:
Old 05-15-2016, 12:23 AM   #30
deepsepia
Vintage Member
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 2,981
Thanks: 12,453
Thanked 25,315 Times in 2,961 Posts
deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+deepsepia 100000+
Default

Quote:
Originally Posted by lagerlout View Post
Anyone notice it doesn't appear to be updating anymore ?

also some of my old 1fichier links say " This link is set to private " but they will download direct in Firefox just fine ?
Do you have an example?
deepsepia is offline   Reply With Quote
The Following User Says Thank You to deepsepia For This Useful Post:
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump




All times are GMT. The time now is 07:40 AM.






vBulletin Optimisation provided by vB Optimise v2.6.1 (Pro) - vBulletin Mods & Addons Copyright © 2017 DragonByte Technologies Ltd.