Skip to content

Latest commit

 

History

History
58 lines (55 loc) · 2.16 KB

Tokens.md

File metadata and controls

58 lines (55 loc) · 2.16 KB
Raw

🎫 Tokens Supported by Phplexer

Phplexer tokenizes various PHP constructs into the following tokens:

  • TOKEN_EOF: End of file marker
  • TOKEN_WHITESPACE: White space
  • TOKEN_COMMENT: Comments
  • TOKEN_STRING: Strings
  • TOKEN_NUMBER: Numbers
  • TOKEN_STRING_LITERAL: String literals
  • TOKEN_OCURLY: Open curly brace {
  • TOKEN_CCURLY: Close curly brace }
  • TOKEN_OPAREN: Open parenthesis (
  • TOKEN_CPAREN: Close parenthesis )
  • TOKEN_PHP_OPEN: PHP opening tag
  • TOKEN_SEMICOLON: Semicolon ;
  • TOKEN_FUNCTION: function keyword
  • TOKEN_CLASS: class keyword
  • TOKEN_EXTENDS: extends keyword
  • TOKEN_IMPLEMENTS: implements keyword
  • TOKEN_RETURN: return keyword
  • TOKEN_PUBLIC: public keyword
  • TOKEN_PROTECTED: protected keyword
  • TOKEN_PRIVATE: private keyword
  • TOKEN_BACKSLASH: Backslash \
  • TOKEN_COMMA: Comma ,
  • TOKEN_BOOL: Boolean values
  • TOKEN_DOT: Dot .
  • TOKEN_VARIABLE: Variables
  • TOKEN_COLON: Colon :
  • TOKEN_NEW: new keyword
  • TOKEN_NULL: null keyword
  • TOKEN_DASH: Dash -
  • TOKEN_PLUS: Plus +
  • TOKEN_EQUAL: Equal =
  • TOKEN_NOT_EQUAL: Not equal !=
  • TOKEN_PLUS_EQUAL: Plus equal +=
  • TOKEN_EQUAL_EQUAL: Equal equal ==
  • TOKEN_EQUAL_EQUAL_EQUAL: Equal equal equal ===
  • TOKEN_NOT_EQUAL_EQUAL: Not equal equal !==
  • TOKEN_DASH_EQUAL: Dash equal -=
  • TOKEN_DASH_GT: Dash greater ->
  • TOKEN_DASH_GT_EQUAL: Dash greater or equal ->=
  • TOKEN_DASH_LT_EQUAL: Dash less or equal -<=
  • TOKEN_DASH_DASH: Dash dash --
  • TOKEN_DASH_COLON: Dash colon :-
  • TOKEN_DOUBLE_AND: Double ampersand &&
  • TOKEN_DOUBLE_OR: Double vertical bar ||
  • TOKEN_AND: Ampersand &
  • TOKEN_OR: Vertical bar |
  • TOKEN_DOUBLE_COLON: Double colon ::
  • TOKEN_NAMESPACE: namespace keyword
  • TOKEN_OBRACKET: Open bracket [
  • TOKEN_CBRACKET: Close bracket ]
  • TOKEN_QUESTION_MARK: Question mark ?
  • TOKEN_NULL_COALESCE: Null coalesce ??

For more details on how these tokens are used within Phplexer, refer to the Lexer class in the project.