|
|||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | ||||||||||
| Class Summary | |
| DefaultTokeniser | A composed tokeniser containing a SimpleTokeniser and a
Transducer.
|
| SimpleTokeniser | Implementation of a Unicode rule based tokeniser. |
| TestTokeniser | |
| Exception Summary | |
| InvalidRuleException | Fired when an invalid tokeniser rule is found |
| TokeniserException | The top level exception for all the exceptions fired by the tokeniser |
|
|||||||||||
| PREV PACKAGE NEXT PACKAGE | FRAMES NO FRAMES | ||||||||||