public Token toToken(SpecialTokens.Token specialToken, int start, String rawSource) {
        return new Token(Token.Kind.WORD,
                         specialToken.replacement(),
                         true,
                         new Substring(start, start + specialToken.token().length(), rawSource)); // XXX: Unsafe?
    }
Consumes a word or number <i>and/or possibly</i> a special token starting within this word or number
container-search/src/main/java/com/yahoo/prelude/query/parser/Tokenizer.java