Package opennlp.tools.tokenize

# Class TokenizerEvaluator

java.lang.Object
opennlp.tools.util.eval.Evaluator<opennlp.tools.tokenize.TokenSample>
opennlp.tools.tokenize.TokenizerEvaluator

public class TokenizerEvaluator extends Evaluator<opennlp.tools.tokenize.TokenSample>
The `TokenizerEvaluator` measures the performance of the given `Tokenizer` with the provided reference `samples`.

See Also:
  - `Evaluator`
  - `Tokenizer`
  - `TokenSample`

- ## Constructor Summary

  Constructors
  Constructor
  Description
  `TokenizerEvaluator(opennlp.tools.tokenize.Tokenizer tokenizer, opennlp.tools.tokenize.TokenizerEvaluationMonitor... listeners)`
  Initializes an instance to evaluate a `Tokenizer`.

- ## Method Summary

  Modifier and Type
  Method
  Description
  `opennlp.tools.util.eval.FMeasure`
  `getFMeasure()`

  ### Methods inherited from class opennlp.tools.util.eval.Evaluator

  `evaluate, evaluateSample`

  ### Methods inherited from class java.lang.Object

  `equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait`

- ## Constructor Details

  - ### TokenizerEvaluator

    public TokenizerEvaluator(opennlp.tools.tokenize.Tokenizer tokenizer, opennlp.tools.tokenize.TokenizerEvaluationMonitor... listeners)
    Initializes an instance to evaluate a `Tokenizer`.
    Parameters:
      `tokenizer` - The `Tokenizer` to evaluate.
      `listeners` - The `evaluation listeners`.

- ## Method Details

  - ### getFMeasure

    public opennlp.tools.util.eval.FMeasure getFMeasure()