public boolean isHealthy() {
        var req = HealthCheckRequest.newBuilder().build();
        var response = invokeGrpc(grpcHealthStub, s -> s.check(req));
        log.fine(() -> "Triton health status: " + response.getStatus());
        return response.getStatus() == HealthCheckResponse.ServingStatus.SERVING;
    }
Experimental model inference using Nvidia Triton as ONNX backend.

@author bjorncs
model-integration/src/main/java/ai/vespa/triton/TritonOnnxClient.java