* format y-axis value for total tokens
* format y-axis for the rest of the charts on model-activity
* revert changes for requests per day
* labels modified to plain text
* added plain text label for api_requests and spend
* minor
* move components to utils
* fix sso logout
- add a new login page with sso button
* lint fix
* lint fix
* lint fix
* fix tests
* fix test
* Revert "fix test"
This reverts commit 74eb7345710892d5a9d02baec0ef389b98d0dde3.
* Reapply "fix test"
This reverts commit 72d0b2d4c62f6bb9351a7656ff88efc2ba91aef7.
* add host to add modal
* close modal after save is clicked. and auto-refresh
* show old values in edit modal
* send the whole payload on edit
* Update settings.tsx
* resolve conflict
* fix conflict
* merge main
* first draft of notifications added to settings
* add error compatibility by taking errors from the backend
- db errors
- auth errors
* add support for different types of errors
* minor
* name change
* email alerts page notifications modified
* remove unused code
* move create_key to organisms/ folder
* move view_key_table to templates
* keys page notifications
* move regenerate_key to organisms
* notifications for regenerate key modal
* move key info view and key edit view to templates/ folder
* replace "Network response was not ok" with error data
* resolve merge conflict
* feat: add CometAPI support with config, error handling and tests
* fix: specify type for extra_body in CometAPIConfig
---------
Signed-off-by: NULL <129579691+TensorNull@users.noreply.github.com>
* add oci models to model_prices_and_context_window.json
* remove unsupported and unavailable oci models from docs
* fix: split data chunks when using async streaming
* add oci models to model_prices_and_context_window.json
* fix: split data chunks when using async streaming
* revert model.json modifications
* fix(router.py): support base model for model group usage
allows model group info to show accurate cost information for azure models
* fix(router.py): fix changes
* test: add unit tests
* build(pyproject.toml): bump openai version requirements
support custom tool from responses api
Closes https://github.com/BerriAI/litellm/issues/13391
* docs(responses_api.md): add verbosity + free-form function calling parameters
* docs(responses_api.md): add cfg + minimal reasoning to docs
Closes https://github.com/BerriAI/litellm/issues/13391
* docs(responses_api.md): add proxy examples to docs
* refactor: fix ruff error
* added mcp guardrails doc in mcp.md
* add button to reload models
* Added button changes
* added button for scheduling reload
* add multi pod support to reloading the model price json
* fix ruff
* feat(proxy/utils.py): track pre-call hooks in OTEL
some pre call hooks can cause latency in high traffic - make sure this is tracked
* fix(router.py): move redis call on deployment_callback_on_success to pipeline operation
reduces p99 latency by half when redis is enabled
* fix(parallel_request_limiter_v3.py): only run check if any item has rate limits set
Prevents unnecessary latency added by rate limit checks
* test: add unit tests
* Latency Improvements: only track tpm/rpm usage when set on deployment+ LLM Caching - use an in-memory cache to reduce redis calls + OTEL - track time spent on LLM caching (#13472)
* fix(router.py): only track usage for deployments with tpm/rpm set
ensures additional latency avoided for non-tpm/rpm models
* fix(caching_handler.py): log time spent on request get cache to OTEL
enables easy debugging of call latency
* fix(caching_handler.py): use dual cache object for in-memory caching + trace redis call within caching handler
* fix(caching_handler.py): working in-memory cache for redis calls
ensures dual cache works when redis cache setup for llm calls
makes calls quicker by only checking redis when in-memory cache missed for llm api call
* test: remove redundant test
* test: add unit tests
* feat(reasoning): support 'minimal' effort type for OpenAI
* fix(reasoning): correctly map 'minimal' effort to Reasoning object
* chore(dependencies): update OpenAI package version to 1.99.5 in pyproject.toml and requirements.txt
* chore(dependencies): update poetry.lock for OpenAI package version 1.99.5 and Poetry version 2.1.3
tanjiro