Problem:
- php.net cannot take the load of htdig
Solution:
- keep the good old way of using ch.php.net for searching if a
mirror has no support for local search
- redirect to ch.php.net from www.php.net, but provide a
different originating server adress, fooling ch.php.net to
direct the user to a different server instead of php.net
What about blocking bots like google on the search pages.
there are a lot of sites with the shortcuts php.net/echo
and bots just crawl that..
Oh, so blocking bots from indexing shortcuts. That is fine with me. In case you can point to some good resource on how to identify bots ;)
and maybe another idea...
common requests, like time (which I lookup sometimes) placed in an array.
when there is a request for the time() function it will search the array or something and won't use htdig for that.
Htdig only comes into play when we need to perform a site/manual content search. In case of function lookups, like /time, we currently have a sqlite table lookup on mirror sites having that, and a file check on others.
and maybe php.net can use the timezones.
sounds strange but might be a good idea.
When it's afternoon in The Netherlands it's just morning in the USA.
where is the highest load? just re-direct the user to a mirror with
a lower load, not just the country mirror.
I am not fully convinced that you can have a good guess about the load on a server by checking the time. Many developers work overnight, schedule downloads and updates for the nights, etc.
Goba