Re: Manuals and Spiders

> I personally think that all mirrors should block all spiders, except for > www. > > Why? Because I am constantly getting linked from Google from people from > Taiwan, etc, to my mirror (which is on the other side of earth...) > > This is not smart. Only the www links should appear in search engines (in > my opinion), and the main www should be mirrors aware, and direct people > *automatically* to mirrors, thus, always giving users: > > 1) fast php net > > 2) take off most of the load off www.php.net's server. Well, this would be a good option, in case php.net would utilize the geoip features used to be tested... There were some progress in this, and code was added to phpweb to support GeoIP (automatic close mirror finder), but the lack of GeoIP data on php.net stopped this from going live.... Goba