Re: Manuals and Spiders
| From: | Gabor Hojtsy | Date: | Tue, 22 Apr 2003 15:03:51 +0000 |
| Subject: | Re: Manuals and Spiders | ||
| References: | 1 2 | Groups: | php.mirrors |
| Request: | Send a blank email to php-mirrors+get-16897@lists.php.net to get a copy of this message | ||
> > I personally think that all mirrors should block all spiders, except for
> > www.
> >
> > Why? Because I am constantly getting linked from Google from people from
> > Taiwan, etc, to my mirror (which is on the other side of earth...)
> >
> > This is not smart. Only the www links should appear in search engines
(in
> > my opinion), and the main www should be mirrors aware, and direct people
> > *automatically* to mirrors, thus, always giving users:
> >
> > 1) fast php net
> >
> > 2) take off most of the load off www.php.net's server.
>
> Well, this would be a good option, in case php.net would
> utilize the geoip features used to be tested... There were
> some progress in this, and code was added to phpweb to
> support GeoIP (automatic close mirror finder), but the
> lack of GeoIP data on php.net stopped this from going
> live....
Someone said, [maybe Jim] that MaxMind is willing to provide
actual geoip data for us, given that we don't distribute it
(only use at php.net and don't open it for the public). I
have asked for some info on where this will be put on
php.net, so I can configure the geoip scripts to test the
database, but nothing happened ;(((
Goba