Anyone working on GGUF, ONNX support?
#2
by abe238 - opened
Anyone working on GGUF, ONNX support for added surface coverage?
yes we have a PR open for the ocr model https://github.com/ggml-org/llama.cpp/pull/21045
once merged, we will build on top of it for perception
@abe238 working prototype with ONNX is here: https://huggingface.co/spaces/shreyask/falcon-perception and the model is uploaded here: https://huggingface.co/onnx-community/falcon-perception-onnx-webgpu