#24901 [Opn]: Remove mirrors of PHP website from google to make finding solutions easier

ID: 24901 Updated by: goba@php.net Reported By: webmaster at geog dot cam dot ac dot uk Status: Open Bug Type: Documentation problem Operating System: n/a PHP Version: Irrelevant New Comment: OK, so let the generated files be disallowed for robots. I have added a meta tag for printed pages immediately, so those will not be indexed anymore (this cannot be expressed in robots.txt AFAIK)... Previous Comments: ------------------------------------------------------------------------ [2003-08-01 07:18:38] hholzgra@php.net had the very same problem yesterday ... pdf_setdash() documentation is lousy and i tried to find some example script that uses it on google no way! and it is not only the official mirrors, i also got lots of hits for copies of the manual pages on other servers even if we want the official mirrors to be indexed (i seem to have missed these discussions so i don't know the pros and cons) we should IMHO add an option to generate noindex meta tags for the HTML formats of the manual this should be controlable using configure and enabled by default manuals for php.net would then be created with the option explicitly turned off (with the option of overriding it in robots.txt on mirrors) ------------------------------------------------------------------------ [2003-08-01 06:44:35] webmaster at geog dot cam dot ac dot uk > We have discussed this point several times, and the > outcome was always the same But might this be worth reconsidering now that the redirection system is in place? > If you would like to restrict the search to > www.php.net only No, the problem is when you're trying to find results that are _not_ from the PHP documentation, i.e. when the documentation doesn't solve the problem. ------------------------------------------------------------------------ [2003-08-01 06:40:02] goba@php.net We have discussed this point several times, and the outcome was always the same. We would not like to disallow mirrors to be indexed. If you would like to restrict the search to www.php.net only, you can do it on Google, and many other search sites. Our current site search excatly does this. ------------------------------------------------------------------------ [2003-08-01 06:35:16] webmaster at geog dot cam dot ac dot uk Description: ------------ Can consideration be given to putting a robots.txt containing User-agent: * Disallow: / for mirrors of the PHP website? I.e. only php.net would not disallow google in. It is very annoying when using google/whatever to find a solution to a problem to be confronted with continual multiple copies of the same thing. Given that the main www.php.net has redirections to local mirrors installed, google searching will take people to the local mirror anyway. Presumably this would take a while to filter through to all the mirrors. There might be an issue with using site:[mirrorname] [searchterms] but this would be outweighed by not having to plough through multiple copies (many of which are out of date) of the PHP documentation. ------------------------------------------------------------------------ -- Edit this bug report at http://bugs.php.net/?id=24901&edit=1