I was looking at the stats and noticed that altough 64% of the hits are
from Greek sites only 8% is Greek traffic...
So I looked into it and saw that 1.78 GB was transfered to greek sites
and 18.67GB to US...
As I can assume most of it should be Google...
Check out... http://gr2.php.net/stats/usage_200310.php
We can safely add a disallow rule for /distributions to the robots.txt IMHO. Any objections?
Does anyone know what does Google has to crawl the .gz and .zip files
also?
It might crawl the contents of the gz and zip files...
Goba