method
next_token
next_token()
public
The method to fetch next token. If you use #do_parse method, you must implement #next_token.
The format of return value is [TOKEN_SYMBOL, VALUE]. token-symbol is represented by Ruby’s symbol by default, e.g. :IDENT for ‘IDENT’. “;” (String) for ‘;’.
The final symbol (End of file) must be false.