Naia
Table of Contents
  1. 1Video Manual
  2. 2Naia OS Live USB
  3. 3Installation
  4. 3.1Naia OS Installation (ISO)
  5. 3.2Linux App Installation
  6. 4Getting Started
  7. 4.1Naia Model Pricing
  8. 4.2naia-0.9-omni-24g Realtime Multimodal Module
  9. 4.3Live Demo
  10. 4.4Naia Model Download
  11. 4.5Naia Model — Developer Guide
  12. 4.6Naia Model Online (planned)
  13. 5Main Screen
  14. 6Chat
  15. 6.1Personal Radio DJ & Exhibition Guide
  16. 7Conversation History
  17. 8Work Progress
  18. 9Skills
  19. 10Channels
  20. 11Agents
  21. 12Diagnostics
  22. 13Workspace
  23. 14Browser
  24. 15Panel Management
  25. 16Voice Chat
  26. 17Settings
  27. 18Tool Details
  28. 19Naia Account
  29. 20Troubleshooting
  30. 21Open Source Usage & Contribution

4.2. naia-0.9-omni-24g Realtime Multimodal Module

naia-0.9-omni-24g uses the same interface as an omni model, but it isn't, strictly, an omni model. It's a cascade module that naia builds by weaving several models together, aiming to be a realtime multimodal "brain." Today it starts by listening to your voice in real time and replying in voice; as versions advance, it expands toward seeing, remembering, and thinking more richly.

What it aims to be

The goal is for naia to grow beyond "listening and speaking" into a realtime cognitive module that sees, remembers, and understands context.

  • Now: realtime voice conversation — listen → think → speak
  • Ahead: we plan to add cognitive abilities such as image input (since current LLMs already handle images, this can come relatively soon), long-term memory (naia-memory) integration, and retrieval augmentation (naia-agent RAG). (What gets added, and in what order, is not fixed.)
  • Direction: a realtime multimodal cognitive module that brings vision, memory, and other abilities together.

The name naia-0.9-omni-24g refers not to a single voice capability but to one realtime multimodal endpoint that will carry all of these.

Looks like an omni model — but it's actually a cascade

naia-0.9-omni-24g is served in the same place, in the same way, as an omni (unified multimodal) model. To a client it's exactly like calling a single omni model. But internally it's not one model — it's a cascade.

What is a cascade

A cascade builds the whole capability by chaining proven, role-specific parts in sequence instead of doing everything with one giant model. naia-0.9-omni-24g chains speech recognition (STT) → language model (LLM) → speech synthesis (TTS), with voice activity detection (VAD) and emotion handling in between.

voice in → speech recognition (STT) → language model (LLM) → speech synthesis (TTS) → voice out

Because each stage is independent, multiple models can be used together. Choosing the best model for each stage is itself a kind of orchestration — a cascade isn't just a chain, it's an assembly that weaves several models into a better result.

Single omni model vs cascade

Single omni modelCascade (naia's way)
Compositionone unified modelassembled role-specific parts
Changing abilityfixed once trained — new ability needs retrainingswap/add parts anytime — improve without retraining
Speedunified, so fast (low latency)extra stages may add a little latency
Multimodal growthretrain from scratchplug parts into input/output
Part choicelocked as onepick & swap proven parts
Using modelsone fixed modelmultiple models together — best per stage, orchestration in itself

→ naia chose a cascade to add abilities quickly and safely. The smooth omni-like experience is delivered through one standard endpoint, while the inside grows as a flexible assembly.

Other characteristics

  • Running VoxCPM2 speech synthesis (TTS) by itself locally requires VRAM 6GB or more. It has been verified on an RTX 4060 laptop, RTX 3080 Ti laptop, and RTX 4070 desktop. This requirement applies to the speech-synthesis stage and is separate from the full naia-0.9-omni-24g cascade tier below.
  • Barge-in: interrupt mid-sentence and start over. This faithfully reproduces the natural barge-in feel of a live omni model.
  • A single 24GB GPU (RTX 3090 / 4090 / A5000) tier. The -24g suffix means exactly this — it's designed from the start to run on a single GPU in a personal PC (the cloud just rents the same setup).
  • Exposed as one single endpoint — the client never needs to know if the backend is a local or cloud GPU. This single endpoint stays even as it expands to images, video, and memory.

Why this shape grows into a "realtime multimodal brain"

  • Realtime, bidirectional: data flows both ways without breaks while the connection is open. Input is processed the moment it arrives; responses stream the moment they're generated. It's not one-question-one-answer — it exchanges anything in real time while the conversation is alive.
  • Cascade (modular) structure: input (perception), thinking (LLM), and output (expression) are separated, so adding an image/video encoder on input or a new expression on output is just plugging a part in. That's how it grows to take in anything and answer with anything, in real time.
  • Instead of retraining one monolithic model, it swaps in proven parts to add abilities quickly and safely.

Usage

naia-0.9-omni-24g is designed from the start to run standalone on a single 24GB GPU. Pricing and how to use it are covered on dedicated pages:

Easiest way — Live Demo

A 1-minute web demo to experience naia-0.9-omni-24g's voice quality with the free credits issued at sign-up (a quality preview, not the full service). Mic/speaker status, persona changes, reference-voice (URL) changes, and text input are supported.

👉 Open the Live Demo

Using it in naia-os

In Settings > AI, select naia-0.9-omni-24g from the model list. No API key needed — it runs on your Naia account credits.

Developers — call the API directly (the gateway Realtime API) — see 4.5 Online version.

Using only speech synthesis (TTS) via cascade — the Voice Host field

If you want just the speaking (TTS) part handled by a cascade server — not the full omni conversation — change one address in naia-os voice settings.

  1. In Settings > Voice, pick Naia Host Voice (GPU) as the speaking (TTS) provider.
  2. In the Voice Host field right below it, enter the cascade server URL.
    • Leave it empty (default): naia-os installs and runs this PC's built-in GPU voice engine automatically. Requires a Naia login (BASIC/PRO) and an NVIDIA GPU (6 GB+).
    • Enter a cascade URL: that remote server synthesizes the voice. No port number needed.
  3. Check the TTS slot in the Profile tab — ● running means connected, ◌ waiting means not yet.

What happens to voices

  • Preset voices (the female/male voice list) travel to the remote server as-is. If the server doesn't have that voice, it falls back to its own default voice.
  • "My voice" (a clip you recorded or uploaded) is currently local-engine only. While using a remote cascade server, replies use the server's default voice instead. (Carrying your voice to remote servers via a voice-fingerprint mechanism is planned.)

Built-in GPU vs cascade — which to pick

Built-in GPU voice (Voice Host empty)cascade (remote URL)
Hardware neededNVIDIA GPU 6 GB+ in this PCNone (server side)
My voice (recorded/uploaded)SupportedFalls back to server default
NetworkWorks offlineInternet required
First-time setupOne-time component install + warm-up on startInstant

Cascade URLs can change between sessions. If the connection fails, check that the address is still valid first.