Re: [Fwd: Re: [PHP] error while reading google-search-results]
| From: | James | Date: | Sat, 08 Mar 2003 12:25:25 +0000 |
| Subject: | Re: [Fwd: Re: [PHP] error while reading google-search-results] | ||
| References: | 1 2 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-138746@lists.php.net to get a copy of this message | ||
LWP is a perl thing. Curl is probably the best thing to use.
Have you tried using googles php api which they provide free?
http://www.google.com/apis/
"Jens Lehmann" <jens.lehmann@goldmail.de> wrote in message
news:3E69C27F.2050304@goldmail.de...
> James Holden wrote:
> >
> >
> > Welcome to a mine field of problems :-)
> >
> > 1. The url you have entered is invalid. Thats a good first check to
> > make usually. Try /search?q=test to get that bit sorted.
>
> Ok, this was just a typo. :)
>
> > 2. Google prevents known useragents from accessing it's content as it
> > believes you are acting as a spider or a search engine stealing thier
> > content. To counter this you need to use a new url capturing method and
> > specifically set the name of the useragent. Use 'MSIE'. You can use
> > curl, lwp etc to do this kind of thing.
> > Curl is excellent, fast, highly configurable and execellent with secure
> > connections.
>
> I heard about curl, but not about lwp. I can't find documentation for
> lwp on php.net. I must check out if I can use one of these.
>
> > 3. I suggest you don't do this - they prevent it for a reason.
>
> It's part of a larger project and not especially related to google. The
> script should be able to read in any website and do some processing. One
> of its functions should (later) be to determine search engine positions.
> Is there a simple way to do this without reading in the search results
> of google (or other search engines)?
>
> Jens
>
>
>