@Override
    public void disclose(Discloser discloser) {
        super.disclose(discloser);
        discloser.addProperty("fromSegmented", fromSegmented);
        discloser.addProperty("segmentIndex", segmentIndex);
        discloser.addProperty("stemmed", stemmed);
        discloser.addProperty("words", words);
    }
Sets if this consists of regular word characters (true) or represents a "special token" (false)
container-search/src/main/java/com/yahoo/prelude/query/WordItem.java