TEST RECORD · ← all field reports

FIELD REPORTS/AUDIO/ISSUE #134

Understands images, video and speech, and answers out loud

Voice assistants usually chain three tools together: one to hear you, one to think, one to talk back. This small model from Liquid AI does all of it on its own, and it can look at a picture or a video clip while it listens.

MODELLFM3-Omni-2B
PUBLISHEDOctober 30, 2026
READ TIME3 min
CATEGORYAUDIO

Field notes

01 What it does

You give it a photo, a video clip, a recording or plain text, and ask about it by typing or by speaking. It answers in text, in speech, or both at once. Hold up a photo of a street sign and ask what it says, play it a clip and ask what the person in it just said, or simply talk to it like an assistant and get a spoken reply.

The difference is that one model handles the whole loop. With a video that has sound, it watches and listens at the same time, so it can answer questions that need both, such as who is speaking when the door slams. The same model also transcribes speech, reads text aloud in a male or female voice, and translates speech into text in another language.

It is small: about 2 billion parameters, built to run on laptops and phones. In Liquid AI's own tests it beat larger models from Qwen, Google and Microsoft at answering questions about video with sound. It understands text in 16 languages and speaks 19, Turkish among them.

02 How to try it

Open the LFM3-Omni-2B Space on Hugging Face. Upload a short video clip with some talking in it, switch on the video soundtrack, set the answer to speech, then press the microphone and ask what happens in the clip. Listen for whether it describes what it heard as well as what it saw. Next, drop in a photo and ask about it in a second language. The Space runs on Hugging Face's shared free GPUs, so a free account gets a limited number of turns. To run it yourself, there is a version for llama.cpp that runs on an ordinary computer, and Liquid's WebGPU voice demo on Hugging Face runs the model straight in your browser.

03 Caveat

It is a small model and does not reason step by step, so long or tricky questions can get confident but wrong answers. Check anything that matters. Its license is free for personal and research use and for companies under 10 million US dollars in yearly revenue; larger companies need a separate license from Liquid AI.

04 What you can do with it

  • Ask about a photo by voice when your hands are busy, such as a recipe page or a wiring diagram.
  • Get a spoken summary of what happens in a short clip, sound included.
  • Build a voice assistant that runs on a laptop without sending audio to a server.
  • Transcribe or translate a voice memo, then have the result read back to you.

Try the demo

View model page

Read this issue on neuralexpedition.com →