Re: Manuals and Spiders

From: Date: Tue, 22 Apr 2003 15:03:51 +0000
Subject: Re: Manuals and Spiders
References: 1 2  Groups: php.mirrors 
Request: Send a blank email to php-mirrors+get-16897@lists.php.net to get a copy of this message
> > I personally think that all mirrors should block all spiders, except for > > www. > > > > Why? Because I am constantly getting linked from Google from people from > > Taiwan, etc, to my mirror (which is on the other side of earth...) > > > > This is not smart. Only the www links should appear in search engines (in > > my opinion), and the main www should be mirrors aware, and direct people > > *automatically* to mirrors, thus, always giving users: > > > > 1) fast php net > > > > 2) take off most of the load off www.php.net's server. > > Well, this would be a good option, in case php.net would > utilize the geoip features used to be tested... There were > some progress in this, and code was added to phpweb to > support GeoIP (automatic close mirror finder), but the > lack of GeoIP data on php.net stopped this from going > live.... Someone said, [maybe Jim] that MaxMind is willing to provide actual geoip data for us, given that we don't distribute it (only use at php.net and don't open it for the public). I have asked for some info on where this will be put on php.net, so I can configure the geoip scripts to test the database, but nothing happened ;((( Goba

« previous php.mirrors (#16897) next »