public Token next() {
        // Go to the next-non-space. Then set token, then increase position by one
        while (position < tokenList.size()) {
            Token current = tokenList.get(position++);

            if (current.kind != Token.Kind.SPACE) {
                return current;
            }
        }
        return null;
    }
Returns the current token and increases the position by one.
Returns null (no exception) if there are no more tokens
container-search/src/main/java/com/yahoo/prelude/query/parser/TokenPosition.java