Re: Kakasi & Japanese MySQL FULLTEXT indexing

From: Date: Sat, 31 Jan 2004 01:10:53 +0000
Subject: Re: Kakasi & Japanese MySQL FULLTEXT indexing
References: 1  Groups: php.pecl.dev 
Request: Send a blank email to pecl-dev+get-394@lists.php.net to get a copy of this message
Hi, On 2004/01/31, at 4:30, Ignatius Reilly wrote:
Question for a Japanese expert: - is Kakasi the right tool to do this? (I understand it converts into hiragana/ katakana - but there are many homophones in Japanese?)
Both Kakasi and Chasen can be used equally for that purpose, but it's often found that Chasen gives more accurate results whilst Kakasi works with less memory footprints. I'll try to package them the next weekend.
- where can I find a list of Japanese stop words ( ??????)?
I don't know exactly what you mean by "stop words", but in contrast to Kakasi, Chasen gives detailed information such as syntactic role (noun, verb, etc) for each parsed word, so you can filter them out by checking it. BTW, it'd be better to ask this kind of question at php-i18n@lists.php.net Moriyoshi

« previous php.pecl.dev (#394) next »