Package org.ctan.site.services.search.base

Class CtanTokenizer

java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.ctan.site.services.search.base.CtanTokenizer
All Implemented Interfaces:
Closeable, AutoCloseable
public final class CtanTokenizer extends org.apache.lucene.analysis.Tokenizer
This tokenizer knows a little bit of TeX.

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

    org.apache.lucene.util.AttributeSource.State

  • Field Summary

    Fields inherited from class org.apache.lucene.analysis.Tokenizer

    input

    Fields inherited from class org.apache.lucene.analysis.TokenStream

    DEFAULT_TOKEN_ATTRIBUTE_FACTORY

  • Constructor Summary

    Constructors
    Constructor
    Description
    CtanTokenizer(Reader reader)
    Creates a new object.

  • Method Summary

    Modifier and Type
    Method
    Description
    boolean
    equals(Object obj)
    Overwritten to make SpotBugs happy.
    int
    hashCode()
    Overwritten to make SpotBugs happy.
    boolean
    incrementToken()

    Methods inherited from class org.apache.lucene.analysis.Tokenizer

    close, correctOffset, reset, setReader, setReaderTestPoint

    Methods inherited from class org.apache.lucene.analysis.TokenStream

    end

    Methods inherited from class org.apache.lucene.util.AttributeSource

    addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait

  • Constructor Details

    • CtanTokenizer

      public CtanTokenizer(Reader reader)
      Creates a new object.
      Parameters:
      reader - the reader

  • Method Details

    • equals

      public boolean equals(Object obj)
      Overwritten to make SpotBugs happy.
      Overrides:
      equals in class org.apache.lucene.util.AttributeSource
      See Also:
      • AttributeSource.equals(java.lang.Object)

    • hashCode

      public int hashCode()
      Overwritten to make SpotBugs happy.
      Overrides:
      hashCode in class org.apache.lucene.util.AttributeSource
      See Also:
      • AttributeSource.hashCode()

    • incrementToken

      public boolean incrementToken() throws IOException
      Specified by:
      incrementToken in class org.apache.lucene.analysis.TokenStream
      Throws:
      IOException
      See Also:
      • TokenStream.incrementToken()