rita.support.ifs
Interface RiTokenizerIF

All Known Implementing Classes:

PennWordTokenizer, RegexTokenizer, RiTokenizer, TTSWordTokenizer

public interface RiTokenizerIF

Method Summary

java.lang.String[]	tokenize(java.lang.String sentence)
void	tokenize(java.lang.String sentence, java.util.List result)

Method Detail

tokenize

java.lang.String[] tokenize(java.lang.String sentence)

tokenize

void tokenize(java.lang.String sentence,
              java.util.List result)