protected Tensor embedQuery(String text, Context context, TensorType tensorType) {
        if (tensorType.valueType() == TensorType.Value.INT8)
            throw new IllegalArgumentException("ColBert query embed does not accept int8 tensor value type");

        EmbeddingResult result = lookupOrEvaluate(context, text, true);
        return toFloatTensor((IndexedTensor)result.outputs.get(outputName), tensorType, result.inputIdSize);
    }
A ColBERT embedder implementation that maps text to multiple vectors, one vector per token subword id.
This embedder uses a HuggingFace tokenizer to produce a token sequence that is then input to a transformer model.

See col-bert-embedder.def for configurable parameters.

@author bergum
model-integration/src/main/java/ai/vespa/embedding/ColBertEmbedder.java