Uses of Class
cc.redpen.tokenizer.TokenElement

Packages that use TokenElement

Package	Description
cc.redpen.model	Elements of Documents such as List, Sentence are provided.
cc.redpen.tokenizer	Provides tokenizers for each languages.
cc.redpen.validator	Validators and the factory classes are provided.

Uses of TokenElement in cc.redpen.model

Methods in cc.redpen.model that return types with arguments of type TokenElement

Modifier and Type	Method and Description
List<TokenElement>	Sentence.getTokens() Get a set of tokenized words in the sentence.

Method parameters in cc.redpen.model with type arguments of type TokenElement

Modifier and Type	Method and Description
void	Sentence.setTokens(List<TokenElement> tokens) Set a set of tokenized words.

Uses of TokenElement in cc.redpen.tokenizer

Methods in cc.redpen.tokenizer that return types with arguments of type TokenElement

Modifier and Type	Method and Description
List<TokenElement>	WhiteSpaceTokenizer.tokenize(String content)
List<TokenElement>	RedPenTokenizer.tokenize(String sentence) Tokenize input sentence into tokens.
List<TokenElement>	JapaneseTokenizer.tokenize(String content)

Uses of TokenElement in cc.redpen.validator

Methods in cc.redpen.validator with parameters of type TokenElement

Modifier and Type	Method and Description
void	ExpressionRule.addElement(TokenElement element)
protected void	Validator.addLocalizedErrorFromToken(Sentence sentenceWithError, TokenElement token) create a ValidationError using the details within the given token & localized message
void	JavaScriptValidator.addLocalizedErrorFromToken(Sentence sentenceWithError, TokenElement token)
protected void	Validator.addValidationErrorFromToken(Sentence sentenceWithError, TokenElement token) Deprecated. use Validator.addLocalizedErrorFromToken(Sentence, TokenElement) instead

Method parameters in cc.redpen.validator with type arguments of type TokenElement

Modifier and Type	Method and Description
boolean	ExpressionRule.match(List<TokenElement> tokens)