Re: Portal Question
| From: | Kenny | Date: | Tue, 10 Oct 2000 10:03:41 +0000 |
| Subject: | Re: Portal Question | ||
| References: | 1 2 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-19398@lists.php.net to get a copy of this message | ||
Hi
You will need a least TWO robots: One for downloading pages, the other one
parses the download and
put them into the database. But there are harder problems than developing
the two robots. It is
HOW are you going to make the data in the database useful to the web, or
your customers?
It might be a work requires a lot of labor to just map the data into the
categories you wanted.
Writing the downloading robot is not very hard. You can use UNIX "wget" or,
Perl, or some
PHP building functions. Suggest to use Perl.
Writing a good parsing Engine is very hard. Please read my message under
this subject:
"Re: [PHP] Metasearches"
Hardware and network requirement for both of these are very high!
Wish you can find some other ways to do it quicker.
regards,
-Kenny Kang
----- Original Message -----
From: Web Master <webmaster@unni.com>
To: <php-general@lists.php.net>
Sent: Tuesday, October 10, 2000 5:31 PM
Subject: [PHP] Portal Question
> Hi Everyone,
>
> I am planning to create a portal. Can any one help me with some
> links,ideas,suggestions etc.,
>
> Thanks.
>
>
>
> --
> PHP General Mailing List (http://www.php.net/)
> To unsubscribe, e-mail: php-general-unsubscribe@lists.php.net
> For additional commands, e-mail: php-general-help@lists.php.net
> To contact the list administrators, e-mail: php-list-admin@lists.php.net
>
>