Re: Kakasi & Japanese MySQL FULLTEXT indexing
| From: | Moriyoshi Koizumi | Date: | Sat, 31 Jan 2004 01:10:53 +0000 |
| Subject: | Re: Kakasi & Japanese MySQL FULLTEXT indexing | ||
| References: | 1 | Groups: | php.pecl.dev |
| Request: | Send a blank email to pecl-dev+get-394@lists.php.net to get a copy of this message | ||
Hi,
On 2004/01/31, at 4:30, Ignatius Reilly wrote:
Question for a Japanese expert: - is Kakasi the right tool to do this? (I understand it converts into hiragana/ katakana - but there are many homophones in Japanese?)Both Kakasi and Chasen can be used equally for that purpose, but it's often found that Chasen gives more accurate results whilst Kakasi works with less memory footprints. I'll try to package them the next weekend.
- where can I find a list of Japanese stop words ( ??????)?I don't know exactly what you mean by "stop words", but in contrast to Kakasi, Chasen gives detailed information such as syntactic role (noun, verb, etc) for each parsed word, so you can filter them out by checking it. BTW, it'd be better to ask this kind of question at php-i18n@lists.php.net Moriyoshi