RE: local search support
| From: | Spyros Ioakim | Date: | Fri, 23 May 2003 10:39:47 +0000 |
| Subject: | RE: local search support | ||
| References: | 1 | Groups: | php.mirrors |
| Request: | Send a blank email to php-mirrors+get-17947@lists.php.net to get a copy of this message | ||
So in the future when somebody goes into google and search for something
he will get results from 100+ mirrors. This doesn't seem very nice.
I would suggest we keep the local mirror for searching but use the
directi db to redirect results to the mirrors.
Spyros
-----Original Message-----
From: shimi [mailto:shimi@shimi.net]
Sent: Friday, May 23, 2003 1:28 PM
To: Ioakim Spyros
Cc: Ioakim Spyros; 'Wez Furlong'; php-mirrors@lists.php.net
Subject: RE: local search support
right *now* - and you're totally correct. the state as it is now says
only
one thing:
people didn't use the mirrors so far. most probably because of lack of
awareness for their existence. up to the point that in my mirror, for
instance, 70% of the traffic was the crawlers (see
http://il.php.net/stats/). Now that people will see page
results (i.e.
http://www.php.net/strings will redirect them to ->
il.php.net/manual/en/ref.strings.php, google will learn that this page
exists, and add it to the index. Right, it WILL take some time, but it
will happen.
On Fri, 23 May 2003, Spyros Ioakim wrote:
> So you are saying that if people search from your site get as many
> results from google as they get if they search from www.php.net?
>
> Because I don't see the search with google to be extensive in the
> mirrors.
>
> Spyros
>
> -----Original Message-----
> From: shimi [mailto:shimi@shimi.net]
> Sent: Friday, May 23, 2003 1:19 PM
> To: Ioakim Spyros
> Cc: Ioakim Spyros; 'Wez Furlong'; php-mirrors@lists.php.net
> Subject: RE: local search support
>
>
> Well, I know for a fact that google works by crawling links from
remote
> sites... I.E. if a page inside your site is not linked to from
anywhere
> outside (that google knows about) - it will never be displayed.
>
> Now, usually people link to the main www site, because that's what
they
> knew, and that's what google then realizes... Also google is based on
> results coming from its toolbar. When those php pages are now
accessible
>
> by *everyone* in their countries, google's toolbar will see people
> surfing
> to them. Google's algorithm basically say: If people surf there (and I
> know about that) - it will be in my index. And I read that in the
> Google's
> site... http://www.google.com/technology/index.html
>
> On Fri, 23 May 2003, Spyros Ioakim wrote:
>
> > Did you do the test I said with google?
> >
> > Go into google and search for this:
> > sybase site:www.php.net
> > you will get 136 results
> > search now for:
> > Sybase site:il.php.net
> > You will get 4 results
> > Same thing for gr.php.net of course.
> >
> > So if a user is searching for example Sybase installation on the php
> > site (which is a real case scenario) the user will get 78 results.
> > If the user tries on il.php.net he will get 0.
> > You can try it directly in google by searching for:
> > sybase installation site:www.php.net
> > sybase installation site:il.php.net
> >
> > Spyros
> >
> > P.S. Yes I have read it somewhere that google doesn't index mirror
> sites
> > 100% so that it would give more accurate results.
> > If a user would search for Sybase installation without a limitation
at
> a
> > site he would get instead of 78 from www.php.net it would display at
> > least 4000 results from the mirror sites plus any other non php.net
> > sites (actually you get 137,000 results for the above query)
> >
> >
> > -----Original Message-----
> > From: shimi [mailto:shimi@shimi.net]
> > Sent: Friday, May 23, 2003 12:40 PM
> > To: Ioakim Spyros
> > Cc: 'Wez Furlong'; php-mirrors@lists.php.net
> > Subject: RE: local search support
> >
> >
> > Uhmm...
> >
> > Google indexes mirror sites IMHO. When looking for my site's address
> > ("where is this site linked from") - google showed me EVERY and
EVERY
> > mirror site of the php.net out there (the mirrors.php page, of
course,
> > on
> > every mirror, linked to my site, as it is a mirror house).
> >
> > Also I just ran some queries directly from www.php.net - they all
> > referred
> > to google search in my mirror, and results were given...
> >
> > Are you sure?
> >
> > On Fri, 23 May 2003, Spyros Ioakim wrote:
> >
> > > This has a huge drawback that google has to index your pages
first.
> > > And usually it takes 1 month for a new site before your pages get
on
> > > google.
> > > Also google will tend not to index mirror sites.
> > > Results on mirror sites will probably return fewer results than on
> > > limiting the search of google on www.php.net.
> > >
> > > What I want to say is that if you do a search on google for:
> > > Sybase site:gr.php.net
> > > Sybase site:www.php.net
> > >
> > > You will get two different results (not a lot of answers on
> > gr.php.net)
> > >
> > > Give it a try...
> > >
> > > Spyros
> > >
> > > -----Original Message-----
> > > From: Wez Furlong [mailto:wez@php.net]
> > > Sent: Friday, May 23, 2003 12:13 PM
> > > To: php-mirrors@lists.php.net
> > > Subject: Re: local search support
> > >
> > > This is intentional; in many cases google will give equal or
better
> > > results
> > > than the local search, and relying on google allows us to utilize
> all
> > > the
> > > mirrors in a load balancing arrangement.
> > >
> > > This move was necessary in order to combat excessive load on the
> > > www.php.net
> > > site itself.
> > >
> > > --Wez.
> > >
> > > "Ioakim Spyros" <sioakim@atlas.ace-hellas.gr> wrote in message
> > >
>
> news:CC9A3154C326EE4FAFF784F0A4785167580E59@acemain.ace-internal.gr...
> > > Does local search support still works?
> > >
> > >
> > >
> > > On my mirror (gr2) it redirects it to google....
> > >
> > >
> > >
> > > Spyros
> > >
> >
> >
>
>
--
Best regards,
Shimi
----
"Outlook is a massive flaming horrid blatant security violation,
which
also happens to be a mail reader."
"Sure UNIX is user friendly; it's just picky about who its friends
are."