private void addToken(Token.Kind kind, String word, int start, int end) {
        addToken(new Token(kind, word, false, new Substring(start, end, source)));
    }
Consumes a word or number <i>and/or possibly</i> a special token starting within this word or number
container-search/src/main/java/com/yahoo/prelude/query/parser/Tokenizer.java