Tilted Forum Project Discussion Community

Tilted Forum Project Discussion Community (https://thetfp.com/tfp/)
-   Tilted Technology (https://thetfp.com/tfp/tilted-technology/)
-   -   Looking for a computer program... (https://thetfp.com/tfp/tilted-technology/78866-looking-computer-program.html)

mangle 12-16-2004 11:39 PM

Looking for a computer program...
 
Does anyone know of a computer program that will automatically search through a folder on a website for all the files inside and download them all? For example, if I want to download all the images at http://www.sample.com/whatever, is there something that could download all the .jpgs in that folder without me knowing what the filenames are?

Artsemis 12-17-2004 01:12 AM

http://www.httrack.com/index.php?p=2&l=en

mangle 12-17-2004 03:06 AM

Not quite, but thanks. With that program, the file has to be linked off of one of the websites. What if I need to gather all the files, regardless of if they are linked or not?

CSflim 12-17-2004 03:56 AM

I might be wrong, but I don't think such a program would be possible, as web servers generally do not allow people access to folder listings (except when there is no default html file to display).

The only way it could work would be by 'brute force' but that would be incredibly slow and not very ethical (or possibly legal?).

cyrnel 12-17-2004 04:20 AM

CSflim mostly said it. You need read and execute permissions on the directory itself. Most websites don't leave things this open though so you're limited to reading the files linked to in html docs. It isn't always locked though, sometimes just obscured by a default html that makes it less obvious. Give leaching/ripping programs a try.

A rare alternative these days is FTP. If you can connect to ftp://www.sample.com/, or substitute ftp.sample.com, or just sample.com, look around for the www and whatever directories. FTP is rarely left open by careful admins these days but it's something to try.

cataklysm 12-29-2004 01:05 PM

I'm not entirely sure if it does it, but you might want to look into Get Right.

http://www.getright.com/

SiN 12-29-2004 01:35 PM

Quote:

Originally Posted by mangle
Looking for a computer program...

...which is why we have a computer forum ...


Quote:

Originally Posted by mangle
Does anyone know of a computer program that will automatically search through a folder on a website for all the files inside and download them all? For example, if I want to download all the images at http://www.sample.com/whatever, is there something that could download all the .jpgs in that folder without me knowing what the filenames are?


Quote:

Originally Posted by mangle
With that program, the file has to be linked off of one of the websites. What if I need to gather all the files, regardless of if they are linked or not?

ok, I'm a bit confused. what do you mean by 'linked'?

(*)according to your first post, you would want all of the jpg's physically contained in the 'whatever' dir of the www.sample.com domain.
in other words, http://www.sample.com/whatever/picture.jpg

....

so, by 'linked off of' do you mean, linked off of? as in, a picture with a URL of say, http://www.whatever.com/sample/picture.jpg, in an html file contained within the 'whatever' dir of the www.sample.com domain?

am I confusing you yet? :p

just trying to straighten this out ...

because if you're asking what I think you are(*), httrack *will* work, as would wget.
or, for the expensive option, and what I use, offline explorer.

please try to more clearly explain what you're trying to do.

ps - if he's asking what I'm thinking, CS and cataklysm are a bit off.

mikec 12-29-2004 01:52 PM

as someone who runs a site, and has assorted stuff in folders that I only want certain people to see (and therefore are not linked on a webpage somewhere, I provide people with the specific URL to the image, .exe or whatever), I think what you're trying to accomplish is unethical. if you want everything in the folder, contact whoever runs the site and ask them.

SiN 12-29-2004 02:10 PM

...and if mikec's right on what you're trying to do ... then google may be your best option ...

mikec 12-30-2004 06:11 AM

just came upon this...if it's an open directory, it'll list everything in it..

http://www.opendirviewer.nl/

sailor 12-30-2004 07:42 AM

Quote:

Originally Posted by mikec
just came upon this...if it's an open directory, it'll list everything in it..

http://www.opendirviewer.nl/

Yeah, but thats gonna totally depend on if the server is configured to allow directory listings, which most arent. I know none of mine are. Beyond that, I dont think there is a way to get all the files.


All times are GMT -8. The time now is 07:29 PM.

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
Search Engine Optimization by vBSEO 3.6.0 PL2
© 2002-2012 Tilted Forum Project


1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360