Package com.easydesk.lucene.analyzer.latex

Class LaTeXLexer

java.lang.Object
com.easydesk.lucene.analyzer.latex.Lexer
com.easydesk.lucene.analyzer.latex.LaTeXLexer
All Implemented Interfaces:
LaTeXLexerConstants, LexerConstants
public final class LaTeXLexer extends Lexer implements LaTeXLexerConstants

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    int
    end
     
    static final int
    YYEOF
    This character denotes the end of file.
    static final int
    YYINITIAL
     

    Fields inherited from class com.easydesk.lucene.analyzer.latex.Lexer

    start

    Fields inherited from interface com.easydesk.lucene.analyzer.latex.LaTeXLexerConstants

    AMP, COMMAND, COMMENTS, DOLLAR, EOF, NUMBER, NUMBEROFTOKENS, OPENCLOSE, SUBSUP

    Fields inherited from interface com.easydesk.lucene.analyzer.latex.LexerConstants

    DEFAULT, TAB, UNKNOWN, WHITE

  • Constructor Summary

    Constructors
    Constructor
    Description
    LaTeXLexer()
     
    LaTeXLexer(Reader in)
    Creates a new scanner
    LaTeXLexer(Document doc)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    int
    getKeyword(int pos, boolean strict)
    Get the keyword at the current position
    int
    scan()
    Get the token's identifier
    void
    setDocument(Document doc)
    Set the document in the lexer
    void
    setRange(int p0, int p1)
    Set the range to parse
    final boolean
    yyatEOF()
    Returns whether the scanner has reached the end of the reader it reads from.
    final void
    yybegin(int newState)
    Enters a new lexical state.
    int
    yychar()
    Get the actual position in the parsed reader
    final char
    yycharat(int position)
    Returns the character at the given position from the matched text.
    final void
    yyclose()
    Closes the input reader.
    final int
    yylength()
    How many characters were matched.
    int
    yylex()
    Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
    void
    yypushback(int number)
    Pushes the specified amount of characters back into the input stream.
    final void
    yyreset(Reader reader)
    Resets the scanner to read from a new input stream.
    final int
    yystate()
    Returns the current lexical state.
    final String
    yytext()
    Returns the text matched by the current regular expression.

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

    • YYEOF

      public static final int YYEOF
      This character denotes the end of file.
      See Also:

    • YYINITIAL

      public static final int YYINITIAL
      See Also:

    • end

      public int end

  • Constructor Details

    • LaTeXLexer

      public LaTeXLexer()

    • LaTeXLexer

      public LaTeXLexer(Document doc)

    • LaTeXLexer

      public LaTeXLexer(Reader in)
      Creates a new scanner
      Parameters:
      in - the java.io.Reader to read input from.

  • Method Details

    • setDocument

      public void setDocument(Document doc)
      Description copied from class: Lexer
      Set the document in the lexer
      Specified by:
      setDocument in class Lexer
      Parameters:
      doc - the document

    • setRange

      public void setRange(int p0, int p1)
      Description copied from class: Lexer
      Set the range to parse
      Specified by:
      setRange in class Lexer
      Parameters:
      p0 - the start
      p1 - the end

    • yychar

      public int yychar()
      Description copied from class: Lexer
      Get the actual position in the parsed reader
      Specified by:
      yychar in class Lexer
      Returns:
      the position

    • scan

      public int scan() throws IOException
      Description copied from class: Lexer
      Get the token's identifier
      Specified by:
      scan in class Lexer
      Returns:
      the id
      Throws:
      IOException

    • getKeyword

      public int getKeyword(int pos, boolean strict)
      Description copied from class: Lexer
      Get the keyword at the current position
      Specified by:
      getKeyword in class Lexer
      Parameters:
      pos - where to search
      strict - if true then the keyword is searched just after position
      Returns:
      the keyword id

    • yyclose

      public final void yyclose() throws IOException
      Closes the input reader.
      Throws:
      IOException - if the reader could not be closed.

    • yyreset

      public final void yyreset(Reader reader)
      Resets the scanner to read from a new input stream.

      Does not close the old reader.

      All internal variables are reset, the old input stream cannot be reused (internal buffer is discarded and lost). Lexical state is set to ZZ_INITIAL.

      Internal scan buffer is resized down to its initial length, if it has grown.

      Parameters:
      reader - The new input stream.

    • yyatEOF

      public final boolean yyatEOF()
      Returns whether the scanner has reached the end of the reader it reads from.
      Returns:
      whether the scanner has reached EOF.

    • yystate

      public final int yystate()
      Returns the current lexical state.
      Returns:
      the current lexical state.

    • yybegin

      public final void yybegin(int newState)
      Enters a new lexical state.
      Parameters:
      newState - the new lexical state

    • yytext

      public final String yytext()
      Returns the text matched by the current regular expression.
      Returns:
      the matched text.

    • yycharat

      public final char yycharat(int position)
      Returns the character at the given position from the matched text.

      It is equivalent to yytext().charAt(pos), but faster.

      Parameters:
      position - the position of the character to fetch. A value from 0 to yylength()-1.
      Returns:
      the character at position.

    • yylength

      public final int yylength()
      How many characters were matched.
      Specified by:
      yylength in class Lexer
      Returns:
      the length of the matched text region.

    • yypushback

      public void yypushback(int number)
      Pushes the specified amount of characters back into the input stream.

      They will be read again by then next call of the scanning method.

      Parameters:
      number - the number of characters to be read again. This number must not be greater than yylength().

    • yylex

      public int yylex() throws IOException
      Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs.
      Returns:
      the next token.
      Throws:
      IOException - if any I/O-Error occurs.