@Override
    public void close() {
        var ch = (ManagedChannel) invokeGrpc(grpcInferenceStub, AbstractStub::getChannel);
        ch.shutdown();
        try {
            if (!ch.awaitTermination(5, SECONDS))
                throw new IllegalStateException("Failed to close channel");
        } catch (InterruptedException e) {
            Thread.currentThread().interrupt();
            throw new TritonException("Failed to close channel", e);
        } finally {
            ch.shutdownNow();
        }
    }
Experimental model inference using Nvidia Triton as ONNX backend.

@author bjorncs
model-integration/src/main/java/ai/vespa/triton/TritonOnnxClient.java