[Java] Class Token

Field Detail

public static final Token EOF

public static final Token NULL

Property Detail

int meaning

String text

Constructor Detail

public Token(int type, String text, int startLine, int startColumn)

Initializes the Token with the specified information.

Method Detail

public Reduction asReduction()

Creates a Reduction from this token. Returns self if the node is already a Reduction.

public Reduction asReduction(CSTNode second)

Creates a Reduction from this token, adding the supplied node as the second element.

public Reduction asReduction(CSTNode second, CSTNode third)

Creates a Reduction from this token, adding the supplied nodes as the second and third element, respectively.

public Reduction asReduction(CSTNode second, CSTNode third, CSTNode fourth)

Creates a Reduction from this token, adding the supplied nodes as the second, third, and fourth element, respectively.

public Token dup()

Returns a copy of this Token.

public CSTNode get(int index)

Returns the specified element, or null.

public int getMeaning()

Returns the meaning of this node. If the node isEmpty(), returns the type of Token.NULL.

public Token getRoot()

Returns the root of the node. By convention, all nodes have a Token as the first element (or root), which indicates the type of the node. May return null if the node isEmpty().

public String getRootText()

Returns the text of the root node. Uses getRoot(true) to get the root, so you will only receive null in return if the root token returns it.

public int getStartColumn()

Returns the starting column of the node. Returns -1 if not known.

public int getStartLine()

Returns the starting line of the node. Returns -1 if not known.

public String getText()

Returns the text of the token. Equivalent to getRootText() when called directly.

public int getType()

Returns the actual type of the node. If the node isEmpty(), returns the type of Token.NULL.

public static Token newDecimal(String text, int startLine, int startColumn)

Creates a token that represents a decimal number.

public static Token newIdentifier(String text, int startLine, int startColumn)

Creates a token that represents an identifier.

public static Token newInteger(String text, int startLine, int startColumn)

Creates a token that represents an integer.

public static Token newKeyword(String text, int startLine, int startColumn)

Creates a token that represents a keyword. Returns null if the specified text isn't a keyword.

public static Token newPlaceholder(int type)

Creates a token with the specified meaning.

public static Token newString(String text, int startLine, int startColumn)

Creates a token that represents a double-quoted string.

public static Token newSymbol(int type, int startLine, int startColumn)

Creates a token that represents a symbol, using a library for the text.

public static Token newSymbol(String type, int startLine, int startColumn)

Creates a token that represents a symbol, using a library for the type.

public CSTNode setMeaning(int meaning)

Sets the meaning for this node (and it's root Token). Not valid if the node isEmpty(). Returns this token, for convenience.

public void setText(String text)

Not advisable, but if you need to adjust the token's text, this will do it.

public int size()

Returns the number of elements in the node (including root).