@Override
    Item parse(String queryToParse, String filterToParse, Language parsingLanguage,
               IndexFacts.Session indexFacts, String defaultIndex, Parsable parsable) {
        var parameters = new LinguisticsParameters(parsingLanguage,
                                                   StemMode.BEST,
                                                   true,
                                                   true);
        var parent = newComposite();
        for (com.yahoo.language.process.Token token : environment.getLinguistics().getTokenizer().tokenize(queryToParse, parameters)) {
            if ( ! token.getType().isIndexable()) continue;
            parent.addItem(toItem(token, defaultIndex));
        }
        return parent;
    }
A parser which delegates all tokenization and processing to the linguistics component.
The full string is given as-is to the linguistics component for tokenization, and
what comes back is assumes fully processed including stemming (if applicable).
The returned tokens are collected into a single parent item.

@author bratseth
container-search/src/main/java/com/yahoo/prelude/query/parser/LinguisticsParser.java