Checking duplicate images before posting - best way?

[london_manuk]

I think I've got quite a lot of pictures of girls on existing threads that may not have already been posted.

I'd prefer not to accidentally post duplicates but it's probably quite difficult to check my stock against the thread - say checking 550 pictures vs 500.

How do the more prolific posters manage this problem?

TIA

[Jism Jim]

you could suck the threads using a tool like imagehostgrabber and then compare your pics to the downloaded thread content with Uniquefiler. Search this section for Uniquefiler and you will find a link I posted.

[london_manuk]

Thanks JJ - much appreciated.

Uniquefiler looks similar to DupeGuru - a duplicate file finder which I've used with a little success, though I'm worried that the initial IHB download may not successfully get all the files in the thread due to server worries.

Having said that, I guess we have to be practical and say that this is likely the best solution.

[Jism Jim]

I have tried DupeGuru too. Uniquefiler is lightyears better.

[Rommelbommel]

I find Awesome Duplicate Photo Finder to be the most accurate image comparison tool:
http://www.duplicate-finder.com/photo.html

[fragilefranky]

I have used Visipics for a long time with good results.

[Midnight Air]

i use SimImages. It is excellent, and keeps a cache of all compared files in a database, so no comparing images again that have been marked as "not wanting to delete although similar."

[ButteredUp]

I first categorize the pics as by file size first & keep them as a thumbnail in folder so that I can see the image without having to click it.

I like to create folders for the pics like in hardcore & softcore & seperate them like that, then have blonde section & brunette section.Thats how I can keep up with models I have.I don't like using a program for something like that cause it's just another program that I don't need running while it could degrade how my computer runs (less programs, better performance).

[deepsepia]

Originally Posted by Jism Jim

you could suck the threads using a tool like imagehostgrabber and then compare your pics to the downloaded thread content with Uniquefiler. Search this section for Uniquefiler and you will find a link I posted.

This got me thinking.

When it comes to big threads, its more than a bit of a chore for every potential poster to d/l every image to check.

But what a board could have -- and it would require someone with some good PHP coding skills-- is to automatically generate a file contain hashes of all the images on the thread; a thread might have gigabytes of pix, but a file containing all the hashes would be tiny, a few megabytes at most.

A potential uploader could then check against these hashes to see if his images already existed. . . could build it into any uploader, would be most convenient.

A bit like the old CSV file catalogs . . . and its also a bit like what some of the hosts use to defeat piracy, they detect the hash of a file that's already on their banned list and you can't upload it.

I don't think anything like this exists at present. . .

[ConstantOgler]

This one of many = help threads here that prompt me to ask: This is all about file name matching, no? And worst case, it requires exact name match. (I don't know how fuzzy/flexible these programs are.) How practical is it to think filename will be the same? Filenames are changed constantly by hosts & others. And if it's your own new scan you want to check, name match is meaningless.

Originally Posted by Midnight Air

i use SimImages. It is excellent, and keeps a cache of all compared files in a database, so no comparing images again that have been marked as "not wanting to delete although similar."

Is it doing bitmap file analysis/comparison ("Computer Vision") or is it all about text, i.e., filenames?