Skip to main content

OpenAI Realtime adapter (coming soon)

OpenAI Realtime is a natural fit for orb-ui because realtime voice agents need fast visual feedback. orb-ui does not ship a dedicated OpenAI Realtime adapter yet, so the supported path today is controlled mode. Your app owns the Realtime session. orb-ui renders the visual state.
import { Orb } from 'orb-ui'

export function OpenAIRealtimeOrb({ realtimeState, outputVolume }) {
  return <Orb state={realtimeState} volume={outputVolume} theme="circle" />
}

How orb-ui fits

Map your session events into the Orb component:
  • connection started -> connecting
  • user audio detected -> listening
  • assistant audio output -> speaking
  • session idle -> idle
  • session failure -> error

Planned adapter

A future OpenAI Realtime adapter should normalize session events, audio output volume, interruption state, and error handling while letting your app manage WebRTC or WebSocket connection details. Until that exists, controlled mode is the honest API.
Last modified on May 28, 2026