Generic Tokenizer

Hi, Just recently joined this group as this is my first attempt at building a PHP extension. Or even look at the engine code for that matter.. I set my sights on a little project I had in mind for some time, and I managed to get a simple prototype working which I'm quite happy with, but I thought I'd drop a line before I go on to get the advice of the community on whether or not this idea is worth spending an effort on. The idea is very simple: After implementing all sorts of tokenizers in user-space code numerous times throughout my PHP career, I thought there's a place for a generic simple tokenizer that can serve as the base of different user-space parsers. The tokenizer is meant to be very straight-forward, not very configurable and not rely on regexp in any way so it should be very fast. Do you think there is room for such an extension? A