Post
22
MNN-Pocket-0.3B on a Galaxy S26: an assistant in your app can turn a short request into a team note in under 0.7 s, without a server. It decodes about 105 tokens/s on the GPU.
litert-community/MNN-Pocket-0.3B
The MNN team's chat model for on-device assistants, data extraction and light agent pipelines (not heavy reasoning), converted to LiteRT-LM.
In the clip, the GPU writes the note with the request's day, time and place; a test app shows 674.0 ms from Send to the last token.
To run it: the card has LiteRT-LM command-line and Python commands.
litert-community/MNN-Pocket-0.3B
The MNN team's chat model for on-device assistants, data extraction and light agent pipelines (not heavy reasoning), converted to LiteRT-LM.
In the clip, the GPU writes the note with the request's day, time and place; a test app shows 674.0 ms from Send to the last token.
To run it: the card has LiteRT-LM command-line and Python commands.