Register on the forum now to remove ALL ads + popups + get access to tons of hidden content for members only!
vintage erotica forum vintage erotica forum vintage erotica forum
vintage erotica forum
Home
Go Back   Vintage Erotica Forums > Information & Help Forum > Help Section > Tutorials
Best Porn Sites Live Sex Register FAQ Members List Calendar Mark Forums Read

Notices
Tutorials Step by step Guides and How to's with screengrabs.


Reply
 
Thread Tools Display Modes
Old May 29th, 2013, 03:08 PM   #21
hos
Veteran Member
 
hos's Avatar
 
Join Date: Nov 2008
Location: back in the dirt
Posts: 10,632
Thanks: 29,720
Thanked 89,340 Times in 9,361 Posts
hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+hos 500000+
Default

Quote:
Originally Posted by Denaniel View Post
The problem was, sometimes a file would fail to download completely, and then I'd have to go back and find the link for that file at the multihoster again and choose a different host.

Instead of deleting, I now just disable the other links, by right clicking on all but one link for each file and selecting "disable" from the list.

Here is an example:


in addition to this good hint - you need to make sure that you also push all disabled files from the linkgrabber tab to the download tab ("continue with all") - because the linkgrabber queue won't be stored if you quit jdownloader. somehow a strange behaviour of this nice tool, there are even no options to store the linkgrabber queue into a jd-like export-file.
__________________
You may be the most important brick in the least important wall, but really you're just a bit of something on a bit of something else.
hos is offline   Reply With Quote
The Following 5 Users Say Thank You to hos For This Useful Post:
Old May 30th, 2013, 03:51 AM   #22
deepsepia
Moderator
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 7,200
Thanks: 47,930
Thanked 83,396 Times in 7,194 Posts
deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+
Default

Quote:
Originally Posted by hos View Post
in addition to this good hint - you need to make sure that you also push all disabled files from the linkgrabber tab to the download tab ("continue with all") - because the linkgrabber queue won't be stored if you quit jdownloader. somehow a strange behaviour of this nice tool, there are even no options to store the linkgrabber queue into a jd-like export-file.
-- Yes, a weird little quirk of JDownloader; doesn't save the linkgrabber tab. What I do is send to the downloader and then save as a DLC container if I don't want to download there and then.

One thing about Denaniel's issue: JDownloader is smart enough to ignore duplicates of files its already downloaded. So go ahead and just dump all the links into the linkgrabber, and send them to Download. JDownloader will grab the first working link, and then ignore the dupes ("mirror already exists").

This is especially useful for older board multipart posts to multiple hosts, where individual files may be dead. You should check by eye just to be sure that there is at least one good copy of each link though . . . Jdownloader will happily download 7 parts of an 8 part file when one part is missing . . . a waste of your bandwidth.
deepsepia is offline   Reply With Quote
The Following 4 Users Say Thank You to deepsepia For This Useful Post:
Old October 23rd, 2013, 10:39 PM   #23
nobadguy
Senior Member
 
Join Date: Oct 2012
Posts: 286
Thanks: 11,817
Thanked 1,533 Times in 222 Posts
nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+
Default

Could someone take a look at my thread, I have problems with some picture links that all JD version show as offline but that are online:
http://vintage-erotica-forum.com/sho...d.php?t=251265
nobadguy is offline   Reply With Quote
The Following 2 Users Say Thank You to nobadguy For This Useful Post:
Old August 5th, 2014, 09:58 PM   #24
bluenoise
Senior Member
 
bluenoise's Avatar
 
Join Date: Nov 2008
Location: Upper Soviet Canuckistan
Posts: 295
Thanks: 21,290
Thanked 1,424 Times in 231 Posts
bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+bluenoise 5000+
Default

I'm deeply confused and hoping someone can give me the answer, direct me to a FAQ, etc. I feel like a cluseless n00b on this one.

I just installed the current version (0.9.334) and pointed it at a posting of magazine scans (http://vintage-erotica-forum.com/sho...0&postcount=89). Very simple, just want the scane on imagebam that the links point to. Fed that URL into jdownloader, and the linkgrabber didn't get the imagebam links - at all. I must be doing something stupid.

Help!

(And thanks.)
__________________
The only thing better than a nude woman is a nude woman in a pair of very high heeled shoes.
- Vivienne Westwood
bluenoise is offline   Reply With Quote
The Following 2 Users Say Thank You to bluenoise For This Useful Post:
Old August 7th, 2014, 02:59 AM   #25
nobadguy
Senior Member
 
Join Date: Oct 2012
Posts: 286
Thanks: 11,817
Thanked 1,533 Times in 222 Posts
nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+nobadguy 5000+
Default

For downloading images I would rather try firefox with the extension "ImageHost Grabber", that works sooo much better than JD.
JD can be a pain in the a.. to let him get all the links, let them be checked, sort out thumbnails, etc., it simply works much better in FF with the ImageHost Grabber extension.
Take a look at this thread:
http://vintage-erotica-forum.com/showthread.php?t=37450
nobadguy is offline   Reply With Quote
The Following 3 Users Say Thank You to nobadguy For This Useful Post:
Old December 11th, 2014, 06:29 PM   #26
deepsepia
Moderator
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 7,200
Thanks: 47,930
Thanked 83,396 Times in 7,194 Posts
deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+
Default

JDownloader has changed quite dramatically with the new JDownloader2. Its a work in progress, with almost nightly builds of the Beta and there are a lot of changes.

The net effect is that its got a lot of helpful advances, but at the expense of clarity.

I note that they seem to have stomped the perennial bug "cannot write to HDD"

One of the really nice advances is to filter your linklist by filetype, so if you've ingested a bunch of GIFs and associated garbage as you plundered a thread, you can easily ignore them.

There are many changes, perhaps the most curious "My JDownloader" which is a mobile interface to your desktop install, so you can add links/solve captchas from your mobile device. Handy for siterippers

. . . but . . .

My concern about JDownloader was and remains security. Running Jdownloader requires enabling Java, which has some security problems, and Jdownloader has a lot of control. I've never seen any suggestion of malware in JDownloader itself, but the way they're extending their reach, if something were to go bad, you'd be very compromised.
deepsepia is offline   Reply With Quote
The Following 3 Users Say Thank You to deepsepia For This Useful Post:
Old October 10th, 2015, 04:32 PM   #27
deepsepia
Moderator
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 7,200
Thanks: 47,930
Thanked 83,396 Times in 7,194 Posts
deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+
Default

Quick and Dirty webscraping with JDownloader

OK, a new tip, and a very useful one.

Have you ever wanted to get all the links from a thread on a board? There are some huge threads here and on other web forums, let's say you want to get all the links from a 200 page thread . . . how are you going to do it?

You could go to each page on and right click on the link . . . you'll get the links, and carpal tunnel syndrome as well. I've previously pointed out that you can grab all the links from a single page, with JD, by doing a Ctrl-A & Ctrl-C [Select all, Copy All] on the page, because JD will parse links from stuff you put on the clipboard. But there are some very big threads out there, hundreds of pages . . . that could still take some time.

There's gotta be an easier way to do this, you'd think-- and you'd be right.

If you write PHP or Python, there are a lot of ways to do it, but let's say you don't write code.

Jdownloader is your friend. You can take the address of any page from a thread and paste it into JD's Linkgrabber's "Analyze and add links" feature (the "plus" [+] button on the lower left corner of Linkgrabber), and JD will analyze the page and look for download links.

Ah, but what if you have a thread with a hundred pages? Suppose you have a thread:
[someforum]/Girlswithbigbooks-[Pagenumber].html -- where the pages are identified 1 through 100?

Simple. I used a little basic interpreter, but you can use whatever you know-- a spreadsheet would be fine-- to generate a text file that reads

[someforum]/Girlswithbigbooks-p1.html
[someforum]/Girlswithbigbooks-p2.html
[someforum]/Girlswithbigbooks-p3.html

and so on up to 100, or whatever number of pages there are. Note that there are number of different ways that different forums deal with page numbers, you just have to copy the format used in the thread that you're interested in.

Now copy it and paste into JD's "Add New Links" utility. JD will most likely pop up a screen saying that it couldn't find any links, and asks if you want it to perform "Deep Link Analysis" -- basically looking at each item on the page and seeing if it links through to a downloadable file. Click "Yes" to this.

JD will iterate through the pages, looking for all links & images (you can restrict JD to looking for links, to ignore images, and so on). Some sites hide links behind "Code" tags, I'm not sure if JD picks them up, haven't tried yet.

Its a bit slow -- for a massive thread its the sort of job to leave JD humming on overnight.

But it works very well, and if utilities like "WGET" leave you saying "huh?", then this approach -- which experienced web coders will tell you is amateur kludge-- is going to be the easiest.


Last edited by deepsepia; October 10th, 2015 at 06:52 PM..
deepsepia is offline   Reply With Quote
The Following 7 Users Say Thank You to deepsepia For This Useful Post:
Old October 19th, 2015, 07:14 PM   #28
deepsepia
Moderator
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 7,200
Thanks: 47,930
Thanked 83,396 Times in 7,194 Posts
deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+
Default Linkgrabber Filtering in JDownloader 2

Very useful, here's an example, which limits the links that JD will add to archives and video files (eg rejects all the random HTML, images and other stuff that you'd otherwise hoover up as you rip a site or thread)

deepsepia is offline   Reply With Quote
The Following 5 Users Say Thank You to deepsepia For This Useful Post:
Old May 2nd, 2016, 03:12 PM   #29
lagerlout
Veteran Member
 
lagerlout's Avatar
 
Join Date: Jun 2010
Posts: 4,505
Thanks: 31,568
Thanked 73,323 Times in 4,399 Posts
lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+lagerlout 350000+
Default

Anyone notice it doesn't appear to be updating anymore ?

also some of my old 1fichier links say " This link is set to private " but they will download direct in Firefox just fine ?
__________________
Nice girls are nice but BAD gals are much much better
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.


Please Pm me with any of my links that are not working. Please do not repost my links
To view links or images in signatures your post count must be 0 or greater. You currently have 0 posts.
lagerlout is offline   Reply With Quote
The Following 3 Users Say Thank You to lagerlout For This Useful Post:
Old May 15th, 2016, 12:23 AM   #30
deepsepia
Moderator
 
deepsepia's Avatar
 
Join Date: Jul 2007
Location: Upper left corner
Posts: 7,200
Thanks: 47,930
Thanked 83,396 Times in 7,194 Posts
deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+deepsepia 350000+
Default

Quote:
Originally Posted by lagerlout View Post
Anyone notice it doesn't appear to be updating anymore ?

also some of my old 1fichier links say " This link is set to private " but they will download direct in Firefox just fine ?
Do you have an example?
deepsepia is offline   Reply With Quote
The Following 2 Users Say Thank You to deepsepia For This Useful Post:
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump




All times are GMT. The time now is 04:15 AM.






vBulletin Optimisation provided by vB Optimise v2.6.1 (Pro) - vBulletin Mods & Addons Copyright © 2024 DragonByte Technologies Ltd.