Scrubbing URL's
| From: | Paul Nowosielski | Date: | Tue, 11 Jul 2006 16:42:34 +0000 |
| Subject: | Scrubbing URL's | ||
| Groups: | php.general | ||
| Request: | Send a blank email to php-general+get-239342@lists.php.net to get a copy of this message | ||
Dear All,
I have 150,000 + URLS I need to validate. When I say validate, I mean I would
like to verify the URL opens up a web page that returns a '200' and not a
'404'.
I was thinking of first verifying the host has a DNS A record by using
checkdnsrr().
Then using CURL to check server response.
Does any one know of a function or class that already does this? Your thoughts
would be greatly appreciated.
TIA!
--
Paul Nowosielski
Webmaster