Fw: Spoofing user_agent
| From: | Ron Piggott | Date: | Thu, 25 Nov 2010 08:25:59 +0000 |
| Subject: | Fw: Spoofing user_agent | ||
| Groups: | php.general | ||
| Request: | Send a blank email to php-general+get-309659@lists.php.net to get a copy of this message | ||
I have wrote a script to generate a sitemap of my web site. It crawls all of the site web pages.
(About 30,000)
I need help to spoof the user_agent variable so the stats program running in the background (
“AWSTATS” ) will treat the crawl as a bot, not browsing usage.
The sitemap generator is a cron job. I tried the syntax:
ini_set('user_agent', 'RonBot (http://www.theverseoftheday.info)'/);
This didn’t work. The browsing was attributed to the dedicated IP address.
How do I get AWSTATS to access this, such as other entries under the “Robots/Spiders visitors”
heading:
Unknown robot (identified by 'bot*')
I don’t mean any ill will by changing this setting. Thanks for the help.
Ron
The Verse of the Day
“Encouragement from God’s Word”
http://www.TheVerseOfTheDay.info