public void setSubstringSpecialTokens(boolean substringSpecialTokens) {
        this.substringSpecialTokens = substringSpecialTokens;
    }
Sets whether to recognize tokens also as substrings of other tokens, needed for cjk. Default false.
container-search/src/main/java/com/yahoo/prelude/query/parser/Tokenizer.java