On Wed, 28 Jun 2000, Matthew Turvey wrote:
> Regarding your claim about "the more servers you have the more likely to
> have a larger proportion of your content indexed", presumably you are
> misquoting from Danny Sullivan's talk about search engines limiting the
> number of pages indexed *per domain* - a search engine has no idea how many
> *boxes* those domains come from.
As I understood it, if you had many pages under foo.ac.uk, a search
engine may only index 2 levels deep in that. If you split them into
foo.foo.ac.uk and bar.foo.ac.uk, each with lots of pages, the search
engine would index 2 levels deep on both sites, potentially doubling the
number of indexed pages?
Andrew.
-----------------------------------------------------------------------------
Web Consultant | Email: a.savory at uea.ac.uk
Library and Learning Resources | URL: http://www.uea.ac.uk/
University of East Anglia | All views are my own -
Norwich, NR4 7TJ, UK | who else would want them?
-----------------------------------------------------------------------------
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
|