LoginSign Up
← Back to all sparks
L

LiveKit Agents

AI-ASSISTANTS
Velocity6.3

Framework for building real-time voice and multimodal AI agents over WebRTC.

docs.livekit.io/agents ↗

LiveKit ships a v1.0 turn detector, its clearest move on voice-agent latency

voice-aiagentsturn-detectionrealtimeasync-toolsprovider-integrations
◆Current state
LiveKit Agents is a framework for building real-time voice AI agents, releasing frequently against a growing roster of STT/TTS/LLM providers. The recent line pairs steady provider work (AssemblyAI, Gemini, Cartesia model updates and fixes) with two capability releases that matter: a v1.0 Turn Detector that uses audio and text semantics to decide when the agent should speak, and Asynchronous Tools that hand control back to the LLM while long-running work streams updates.
◆Where it's heading
The direction is toward the hard, differentiating parts of voice agents: natural turn-taking and responsiveness under long-running tool calls. Around those, LiveKit keeps broadening provider coverage so teams can swap models freely. The framework is competing on conversation quality and latency, not just integrations.
◆Prediction
Expect continued turn-detector refinement and more async/streaming primitives, alongside a steady stream of new STT/TTS/LLM provider support as models ship.

◆Recent moves

  1. 1d ago

    @livekit/agents@1.6.5

    A fix release broadening Gemini 3 Flash model detection, handling AssemblyAI mode presets, and improving worker retry behavior. Routine maintenance.

    View source ↗
  2. 16d ago

    livekit-agents@1.6.4

    Disables retries on end-of-turn connection errors and updates dependencies and examples. Reliability tuning, no user-facing feature.

    View source ↗
  3. 18d ago

    livekit-agents@1.6.3

    Fixes across speed options, realtime tool_choice handling, and end-of-turn timeout behavior. Bug-fix release.

    View source ↗
  4. 21d ago

    livekit-agents@1.6.2

    Adds AssemblyAI universal-3-5-pro as the new default STT with Voice Focus streaming params, plus Gemini 3.1 Flash TTS support. Real broadened model coverage, consistent with the provider-integration arc.

    View source ↗
  5. 21d ago

    livekit-agents@1.6.1

    ⚡ SPARK

    Introduces LiveKit Turn Detector v1.0, a model that combines audio and text semantics to decide the optimal moment for the agent to respond. It targets the core turn-taking problem in voice agents and is the most directional release in the recent line.

    View source ↗
  6. 29d ago

    livekit-agents@1.6.0

    Adds Asynchronous Tools, letting a long-running tool hand control back to the LLM and stream progress into the conversation instead of leaving the user in silence. A meaningful responsiveness primitive that complements the turn-detection work.

    View source ↗