Changing User Agent for fopen

From:	Gohaku	Date:	Thu, 04 Dec 2003 15:36:10 +0000
Subject:	Changing User Agent for fopen
Groups:	php.general
Request:	Send a blank email to php-general+get-171839@lists.php.net to get a copy of this message

Hi everybody, There are some pages I would like to extract links from but I can't access the page using the following:

        ini_set('php.user_agent', 'Mozilla/5.0');

$url = "http://www.google.com/search?q=php";

        $fp = fopen($url,"r");
        $buffer = fread($fp,1000000);
        echo $buffer;
Also, what is the best number to use when allocating Buffer space for a URL?

Is 1000000 too much? Thanks. -Gohaku