public class TokenizerOperation extends AbstractDelegatingOperation
| Modifier and Type | Field and Description |
|---|---|
private java.lang.String[] |
_delimiters |
static java.lang.String |
DELIMITERS
Parameter list that determines the delimiters this
operation will use to concatanate tokens.
|
static java.lang.String |
PHRASE_OPERATIONS
Parameter that determines the operations this operation
will perform on the phrases.
|
static java.lang.String |
TOKEN_OPERATIONS
Parameter that determines the operations this operation
will perform on the tokens.
|
| Constructor and Description |
|---|
TokenizerOperation() |
TokenizerOperation(java.lang.String[] delimiters) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
execute(POS pos,
java.lang.String lemma,
BaseFormSet forms)
Execute the operation.
|
protected AbstractDelegatingOperation |
getInstance(java.util.Map params) |
protected java.lang.String[] |
getKeys() |
private boolean |
tryAllCombinations(POS pos,
BaseFormSet[] tokenForms,
int startIndex,
int endIndex,
BaseFormSet forms) |
private boolean |
tryAllCombinations(POS pos,
java.lang.String[] tokens,
java.lang.String delimiter,
BaseFormSet forms) |
addDelegate, create, delegate, hasDelegatepublic static final java.lang.String TOKEN_OPERATIONS
public static final java.lang.String PHRASE_OPERATIONS
public static final java.lang.String DELIMITERS
private java.lang.String[] _delimiters
public TokenizerOperation()
public TokenizerOperation(java.lang.String[] delimiters)
protected AbstractDelegatingOperation getInstance(java.util.Map params) throws JWNLException
getInstance in class AbstractDelegatingOperationJWNLExceptionprotected java.lang.String[] getKeys()
getKeys in class AbstractDelegatingOperationpublic boolean execute(POS pos, java.lang.String lemma, BaseFormSet forms) throws JWNLException
Operationforms - BaseFormSet to which all discovered base forms should
be added.JWNLExceptionprivate boolean tryAllCombinations(POS pos, BaseFormSet[] tokenForms, int startIndex, int endIndex, BaseFormSet forms) throws JWNLException
JWNLExceptionprivate boolean tryAllCombinations(POS pos, java.lang.String[] tokens, java.lang.String delimiter, BaseFormSet forms) throws JWNLException
JWNLException