Tokenizer
in package
Table of Contents
Properties
- $map : array<string|int, mixed>
- Token Map for "non-tokens"
Methods
Properties
$map
Token Map for "non-tokens"
private
array<string|int, mixed>
$map
= ['(' => 'T_OPEN_BRACKET', ')' => 'T_CLOSE_BRACKET', '[' => 'T_OPEN_SQUARE', ']' => 'T_CLOSE_SQUARE', '{' => 'T_OPEN_CURLY', '}' => 'T_CLOSE_CURLY', ';' => 'T_SEMICOLON', '.' => 'T_DOT', ',' => 'T_COMMA', '=' => 'T_EQUAL', '<' => 'T_LT', '>' => 'T_GT', '+' => 'T_PLUS', '-' => 'T_MINUS', '*' => 'T_MULT', '/' => 'T_DIV', '?' => 'T_QUESTION_MARK', '!' => 'T_EXCLAMATION_MARK', ':' => 'T_COLON', '"' => 'T_DOUBLE_QUOTES', '@' => 'T_AT', '&' => 'T_AMPERSAND', '%' => 'T_PERCENT', '|' => 'T_PIPE', '$' => 'T_DOLLAR', '^' => 'T_CARET', '~' => 'T_TILDE', '`' => 'T_BACKTICK']
Methods
parse()
public
parse(string $source) : TokenCollection
Parameters
- $source : string
Return values
TokenCollectionfillBlanks()
private
fillBlanks(TokenCollection $tokens, int $maxLine) : TokenCollection
Parameters
- $tokens : TokenCollection
- $maxLine : int