mangle

Does anyone know of a computer program that will automatically search through a folder on a website for all the files inside and download them all? For example, if I want to download all the images at http://www.sample.com/whatever, is there something that could download all the .jpgs in that folder without me knowing what the filenames are?

Artsemis

__________________

- Artsemis
~~~~~~~~~~~~~~~~~~~~
There are two keys to being the best:
1.) Never tell everything you know

mangle

Not quite, but thanks. With that program, the file has to be linked off of one of the websites. What if I need to gather all the files, regardless of if they are linked or not?

CSflim

I might be wrong, but I don't think such a program would be possible, as web servers generally do not allow people access to folder listings (except when there is no default html file to display).

The only way it could work would be by 'brute force' but that would be incredibly slow and not very ethical (or possibly legal?).

__________________

cyrnel

CSflim mostly said it. You need read and execute permissions on the directory itself. Most websites don't leave things this open though so you're limited to reading the files linked to in html docs. It isn't always locked though, sometimes just obscured by a default html that makes it less obvious. Give leaching/ripping programs a try.

A rare alternative these days is FTP. If you can connect to ftp://www.sample.com/, or substitute ftp.sample.com, or just sample.com, look around for the www and whatever directories. FTP is rarely left open by careful admins these days but it's something to try.

cataklysm

I'm not entirely sure if it does it, but you might want to look into Get Right.

http://www.getright.com/

__________________
--Cataklysm--

SiN

...which is why we have a computer forum ...



ok, I'm a bit confused. what do you mean by 'linked'?

(*)according to your first post, you would want all of the jpg's physically contained in the 'whatever' dir of the www.sample.com domain.
in other words, http://www.sample.com/whatever/picture.jpg

....

so, by 'linked off of' do you mean, linked off of? as in, a picture with a URL of say, http://www.whatever.com/sample/picture.jpg, in an html file contained within the 'whatever' dir of the www.sample.com domain?

am I confusing you yet?

just trying to straighten this out ...

because if you're asking what I think you are(*), httrack *will* work, as would wget.
or, for the expensive option, and what I use, offline explorer.

please try to more clearly explain what you're trying to do.

ps - if he's asking what I'm thinking, CS and cataklysm are a bit off.

__________________

mikec

as someone who runs a site, and has assorted stuff in folders that I only want certain people to see (and therefore are not linked on a webpage somewhere, I provide people with the specific URL to the image, .exe or whatever), I think what you're trying to accomplish is unethical. if you want everything in the folder, contact whoever runs the site and ask them.

__________________
Until the 20th century, reality was everything humans could touch, smell, see, and hear. Since the initial publication of the charted electromagnetic spectrum, humans have learned that what they can touch, smell, see, and hear is less than one millionth of reality

SiN

...and if mikec's right on what you're trying to do ... then google may be your best option ...

__________________

mikec

just came upon this...if it's an open directory, it'll list everything in it..

http://www.opendirviewer.nl/

__________________
Until the 20th century, reality was everything humans could touch, smell, see, and hear. Since the initial publication of the charted electromagnetic spectrum, humans have learned that what they can touch, smell, see, and hear is less than one millionth of reality

sailor

Yeah, but thats gonna totally depend on if the server is configured to allow directory listings, which most arent. I know none of mine are. Beyond that, I dont think there is a way to get all the files.

__________________
"Good people do not need laws to tell them to act responsibly, while bad people will find a way around the laws."
--Plato