John Kirriemuir writes:
| As for mirroring software, there are bits of freeware that apparently can
| help with this (though haven't yet looked heavily into it); good things
| heard about something called Webcopy. I either do it by hand (as all have
| mirrored so far are small Web-based resources with no default directory
| files), or by using the Autosurf and caching manager functions in the
| wonderful NCSA Mosaic 2.0 (PC-based browser for Windows 95/32 bit Windows
| 3.11), which are very useful for controlling the depth/width of Web resource
| auto-caching.
You can grab "webcopy" from ...
<URL:http://sunsite.doc.ic.ac.uk/packages/www/tools/webcopy/>
IMHO this is a much nicer approach, since it lets you make WWW
mirroring into a background activity which can be carried out
automatically by your machine at regular intervals (e.g. via "cron" on
Unix boxes), leaving you with more time to throw your boomerang around
and watch Star Trek... ;-)
This approach seems to be the most commonly used for pre-WWW protocols
like FTP. FTP is particularly well catered for by Lee McLoughlin's
excellent "mirror" package...
<URL:http://sunsite.doc.ic.ac.uk/packages/mirror/>
I was wondering was whether there was sufficient interest in WWW
mirroring within eLib projects that it might be possible to get a bit
of work going on in the background investigating replication, perhaps
using the Harvest project's Replicator tool...
<URL:http://excalibur.usc.edu/research/mirrord.html>
This uses "mirror" behind the scenes, but adds some extra bits to cope
with a large number of replicas using a flood-fill technique similar to
that adopted by Usenet News. Note that it requires cooperation from
the site being mirrored, is aimed at cases where there will be a large
number of replicas (e.g. in the order of one per country) and since
we're talking about Web pages and in-lined images rather than "simple"
things like free/public domain/shareware software distributions, there
would probably be nasty copyright issues involved too.
Toodle pip!
Martin
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
|