LiveKit Agents is an open-source, end-to-end framework designed to facilitate the development of real-time, multimodal AI applications. This framework empowers developers to create programmable, intelligent AI agents that can interact with users through various modalities, including voice, video, and text. LiveKit Agents seamlessly integrates with large language models (LLMs) and other AI models, making it an ideal solution for a wide range of applications. The LiveKit Agents framework encompasses a variety of features that enhance its usability and functionality in developing multimodal applications. Below is an overview of the specific features available within the LiveKit Agents framework: LiveKit Agents can be utilized in various scenarios, showcasing their versatility in real-time interactions: Getting started with LiveKit Agents involves several steps to develop and deploy your AI applications:Features
Feature
Description
Multimodal Interaction
Supports voice, video, and text exchanges for comprehensive interactions.
Stateful Processes
Operates as long-running processes for intuitive user interaction management.
Low-Latency Media Transport
Utilizes WebRTC for real-time media transport with minimal delay.
Centralized Business Logic
Maintains business logic within the agent for consistent service across platforms.
Extensive Plugin Ecosystem
Includes plugins for STT, TTS, and VAD, with options for custom integrations.
Agent Lifecycle Management
Efficiently manages agent lifecycle and can handle multiple instances.
Orchestration and Scaling
Facilitates load balancing and scaling by adding more servers.
Open Source and Edge Optimization
Apache 2.0 licensed, with optimized performance over edge servers.
Use Cases
How to get started
LIVEKIT_URL
, LIVEKIT_API_KEY
, and LIVEKIT_API_SECRET
, along with any necessary API keys for integrations.node my_agent.js start
or node my_agent.ts connect --room <my-room>
to join an active room.
The pricing for LiveKit Agents is structured across several plans: LiveKit also has a connection fee starting at $0.0005/minute, which decreases with volume, and a lower bandwidth fee starting at $0.12 per GB, which also decreases with volume. There is no charge for upstream bandwidth.LiveKit Agents Pricing
Additional Fees