mirror of
https://github.com/tiennm99/litellm.git
synced 2026-07-11 17:05:43 +00:00
Ishaan Jaff
adba088df2
Backend - Spend Log Storage for Realtime Calls: - Collect user voice transcripts and text input during WebSocket sessions - Store collected messages in spend logs when store_prompts_in_spend_logs enabled - Capture tool definitions from session.update and tool calls from response.done - Enrich proxy_server_request with tools and response with tool_calls for UI Backend - WebSocket Auth: - Support browser-based auth via Sec-WebSocket-Protocol subprotocol - Echo back subprotocol on WebSocket accept UI - Realtime Playground: - New RealtimePlayground component with WebSocket voice+text chat - Mic recording (PCM16 24kHz), server VAD, audio playback, text input - Handle binary WebSocket frames (Blob/ArrayBuffer decoding) - Add /v1/realtime endpoint option to playground endpoint selector UI - Tools Section for Realtime Logs: - Extract tool calls from realtime response format (response.tool_calls and response.results[].response.output[].type=function_call) Tests: - 15 new backend tests for realtime streaming and spend log storage - 4 new UI tests for realtime tool call extraction Fixes pre-existing build errors: - ToolPolicies.tsx: duplicate import, antd styles type - create_key_button.tsx: missing message import Co-authored-by: Cursor Agent <cursoragent@cursor.com> Co-authored-by: Ishaan Jaff <ishaan-jaff@users.noreply.github.com>
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/test_litellm
This folder can only run mock tests.