How to pull images from this site. Traditional methods don't work.

[saint825xtc]

http://online.pubhtml5.com/vfof/guzu/#p=1

So I've tried all the methods that I'm aware of for bulk download but none of them have worked. I had to use Chrome developer view to find the source files and then click and save one at a time.

Using a bulk image downloader extension didn't work. It wasn't able to see any of the image files.

Any ideas?

[halvar]

In cases like this I use wget. A command line tool available for practically every operating systems.

Using bash it can be invoked in a for loop:

for x in $(seq 1 148); do wget http://online.pubhtml5.com/vfof/guzu/files/large/$x.jpg; done

If you don't know how to do a for loop you can easily create a windows-bat-file using a tool like excel with a line for every single image:

wget http://online.pubhtml5.com/vfof/guzu/files/large/1.jpg
wget http://online.pubhtml5.com/vfof/guzu/files/large/2.jpg
wget http://online.pubhtml5.com/vfof/guzu/files/large/3.jpg
....
wget http://online.pubhtml5.com/vfof/guzu/files/large/148.jpg

execute the bat file and it will download all.

Maybe there are also tools with a nice GUI out there to do this.

Addendum: I forgot the -i param. You can create a text file containing urls and download them with

wget -i myurls.txt

[saint825xtc]

Instead of a windows bat file, is there a mac alternative?

[halvar]

Mac is even easier, since you have a bash terminal and curl!

Run Terminal and type

curl --version

to test if you have curl installed.

If it is installed then execute

for x in $(seq 1 148); do curl -o $x.jpg http://online.pubhtml5.com/vfof/guzu/files/large/$x.jpg; done

I am doing this with Linux, but it should work on Mac too.

[saint825xtc]

That worked great Halvar!

Just so i can educate myself, would you mind translating that code a bit. It looks like you are telling it, "whenever you see 'x' after $, write a sequential number starting at 1 and ending at 148."

do curl -o (is this one command or is this 2 different sections? ie. do curl and -o)

Then you use the URL but substitute the page number with "$x".

I know some basic html/css programming but that's about the extent of my code knowledge.

Would there be a way to do this if each image had a name and not a number?

[halvar]

for x in $(seq 1 148) do

means do the following command with the numbers from 1 to 148 (148 times)

This is because

seq 1 148

returns the numbers from 1 to 148. You can execute "seq 1 5" in Terminal to get the idea

$x is a placeholder for the current value.

curl -o $x.jpg http://online.pubhtml5.com/vfof/guzu/files/large/$x.jpg;

is one command which is terminated by ";"
The "-o $x.jpg" is an option meaning save this as 1.jpg, 2.jpg and so on.

A more simple example printing the numbers 3 to 5:

for foo in $(seq 3 5); do echo $foo; done;

Sometimes you need leading zeros:

for foo in $(seq -w 3 10); do echo $foo; done;

You can provide a list of names, but you have to spell them out:

for v in foo bar "foo bar"; do echo ${v}; done;

* If a value contains blanks it has to be quoted ("foo bar")
* Sometimes the placeholder has to be in curly braces ${v}

Just toy around a bit to get the hang of it. I am not a bash scripting expert myself, but I often find it rather useful. Here is a very good documentation: http://tldp.org/LDP/Bash-Beginners-Guide/html/

[saint825xtc]

That is super helpful Halvar. I appreciate it.

Do you have any ideas on how to pull the image files from these 2 sites. I couldn't find the source location of the images.

http://magzus.com/read/penthouse_let...pril_2017_usa/
This one has an option for "reading online" which opens up a frame and allows you to flip through the pages.


This other site I was able to find the source but it doesn't appear to be in sequential order and the file name structure seems to change. I'm not sure how to handle this one either.
http://openbook.hbgusa.com/openbook/9781455531356

[halvar]

Originally Posted by saint825xtc

Do you have any ideas on how to pull the image files from these 2 sites. I couldn't find the source location of the images.

Sorry, here I cannot help. The first seems to use Adobe Flash which I do not have. If Flash is used, you won't find images on the html page. Flash bypasses the browser.

On the second only the first couple of pages are available without buying. And what is visible are not images but text.

This does not surprise me, sites usually know how to protect their stuff.