290e2528cd
Schedule budget resets at expectable times ( #10331 ) ( #10333 )
...
* Schedule budget resets at expectable times (#10331 )
* Enhance budget reset functionality with timezone support and standardized reset times
- Added `get_next_standardized_reset_time` function to calculate budget reset times based on specified durations and timezones.
- Introduced `timezone_utils.py` to manage timezone retrieval and budget reset time calculations.
- Updated budget reset logic in `reset_budget_job.py`, `internal_user_endpoints.py`, `key_management_endpoints.py`, and `team_endpoints.py` to utilize the new timezone-aware reset time calculations.
- Added unit tests for the new reset time functionality in `test_duration_parser.py`.
- Updated `.gitignore` to include `test.py` and made minor formatting adjustments in `docker-compose.yml` for consistency.
* Fixed linting
* Fix for mypy
* Fixed testcase for reset
* fix(duration_parser.py): move off zoneinfo - doesn't work with python 3.8
* test: update test
* refactor: improve budget reset time calculation and update related tests for accuracy
* clean up imports in team_endpoints.py
* test: update budget remaining hours assertions to reflect new reset time logic
* build(model_prices_and_context_window.json): update model
---------
Co-authored-by: Prathamesh Saraf <pratamesh1867@gmail.com >
2025-04-29 20:59:44 -07:00
f1d6ac4af6
fix google studio url ( #10095 )
2025-04-29 17:34:58 -07:00
25c726ed61
Revert "build(deps): bump axios, @docusaurus/core, @docusaurus/plugin-google-…" ( #10421 )
...
This reverts commit a01cd87f4d
2025-04-29 17:33:47 -07:00
f30871ef13
[Feat] Add support for using Bedrock Knowledge Bases with LiteLLM /chat/completions requests ( #10413 )
...
* add make_bedrock_kb_retrieve_request
* working bedrock KB hook
* working bedrock KB hook
* test_openai_with_knowledge_base_mock_openai
* fix linting
* fix BedrockKnowledgeBaseHook
* docs using bedrock kb with litellm
* docs kb with litellm
* fix bedrock kb test
* DynamicPromptManagementParamLiteral
* fix _should_run_prompt_management_hooks_without_prompt_id
* test_init_custom_logger_compatible_class_as_callback
2025-04-29 17:29:02 -07:00
36264d4764
[Feat Security] - Allow blocking web crawlers ( #10420 )
...
* security add robots.txt settings to security
* block web crawlers
* test_enterprise_routes.py
* docs proxy enterprise
2025-04-29 17:28:08 -07:00
00605e3611
docs: Improve documentation of phoenix logging ( #10416 )
2025-04-29 17:24:47 -07:00
a01cd87f4d
build(deps): bump axios, @docusaurus/core, @docusaurus/plugin-google-gtag, @docusaurus/plugin-ideal-image and @docusaurus/preset-classic ( #10419 )
...
Removes [axios](https://github.com/axios/axios ). It's no longer used after updating ancestor dependencies [axios](https://github.com/axios/axios ), [@docusaurus/core](https://github.com/facebook/docusaurus/tree/HEAD/packages/docusaurus ), [@docusaurus/plugin-google-gtag](https://github.com/facebook/docusaurus/tree/HEAD/packages/docusaurus-plugin-google-gtag ), [@docusaurus/plugin-ideal-image](https://github.com/facebook/docusaurus/tree/HEAD/packages/docusaurus-plugin-ideal-image ) and [@docusaurus/preset-classic](https://github.com/facebook/docusaurus/tree/HEAD/packages/docusaurus-preset-classic ). These dependencies need to be updated together.
Removes `axios`
Updates `@docusaurus/core` from 2.4.1 to 3.7.0
- [Release notes](https://github.com/facebook/docusaurus/releases )
- [Changelog](https://github.com/facebook/docusaurus/blob/main/CHANGELOG.md )
- [Commits](https://github.com/facebook/docusaurus/commits/v3.7.0/packages/docusaurus )
Updates `@docusaurus/plugin-google-gtag` from 2.4.3 to 3.7.0
- [Release notes](https://github.com/facebook/docusaurus/releases )
- [Changelog](https://github.com/facebook/docusaurus/blob/main/CHANGELOG.md )
- [Commits](https://github.com/facebook/docusaurus/commits/v3.7.0/packages/docusaurus-plugin-google-gtag )
Updates `@docusaurus/plugin-ideal-image` from 2.4.3 to 3.7.0
- [Release notes](https://github.com/facebook/docusaurus/releases )
- [Changelog](https://github.com/facebook/docusaurus/blob/main/CHANGELOG.md )
- [Commits](https://github.com/facebook/docusaurus/commits/v3.7.0/packages/docusaurus-plugin-ideal-image )
Updates `@docusaurus/preset-classic` from 2.4.1 to 3.7.0
- [Release notes](https://github.com/facebook/docusaurus/releases )
- [Changelog](https://github.com/facebook/docusaurus/blob/main/CHANGELOG.md )
- [Commits](https://github.com/facebook/docusaurus/commits/v3.7.0/packages/docusaurus-preset-classic )
---
updated-dependencies:
- dependency-name: axios
dependency-version:
dependency-type: indirect
- dependency-name: "@docusaurus/core"
dependency-version: 3.7.0
dependency-type: direct:production
- dependency-name: "@docusaurus/plugin-google-gtag"
dependency-version: 3.7.0
dependency-type: direct:production
- dependency-name: "@docusaurus/plugin-ideal-image"
dependency-version: 3.7.0
dependency-type: direct:production
- dependency-name: "@docusaurus/preset-classic"
dependency-version: 3.7.0
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-29 17:23:07 -07:00
25213f6087
docs: fix docs
2025-04-28 15:36:56 -07:00
a38e2f052e
docs: fix docs
2025-04-28 15:36:31 -07:00
a5ef8a9556
update release note with imgs
2025-04-26 20:14:39 -07:00
ab4523c080
docs(index.md): cleanup
2025-04-26 19:00:56 -07:00
1390ae8e18
docs(index.md): cleanup doc
2025-04-26 18:54:08 -07:00
6f3c158266
[QA] Allow managing sessions with litellm_session_id ( #10348 )
...
* allow dynamically setting litellm_session_id
* allow dynamically setting litellm_session_id
2025-04-26 18:52:50 -07:00
dcfa26c428
docs fix index stable release
2025-04-26 14:31:24 -07:00
9614d5ba69
docs fix stable release
2025-04-26 14:23:09 -07:00
a0b6766321
docs release notes
2025-04-26 14:02:38 -07:00
cd5f0e809e
docs responses API session management
2025-04-26 14:01:24 -07:00
3d516fee1f
docs responses API GET, DELETE examples
2025-04-26 12:40:21 -07:00
8c8b786267
doc fix stable release add images of UI improvements
2025-04-26 12:13:59 -07:00
93b6df96e0
Prisma Migrate - support setting custom migration dir ( #10336 )
...
* build(litellm-proxy-extras/utils.py): correctly generate baseline migration for non-empty db
* fix(litellm-proxy-extras/utils.py): Fix issue in migration, where if a migration fails during baselining, all are still marked as applied
* fix(prisma_client.py): don't pass separate schema.prisma to litellm-proxy-extras
use the one in litellm-proxy-extras
* fix(litellm-proxy-extras/utils.py): support passing custom dir for baselining db in read-only fs
Fixes https://github.com/BerriAI/litellm/issues/9885
* fix(utils.py): give helpful warning message when permission denied error raised in fs
2025-04-26 12:05:06 -07:00
f2899cb66e
[Docs] v1.67.4-stable ( #10338 )
...
* draft 1.67.4
* completed New Models / Updated Models
* docs clean up image gen
* docs azure granularities for whisper
* docs New Models / Updated Models
* docs cohere
* update cohere docs
* complete New Models / Updated Models updates
* docs responses API
* complete Logging / Guardrail Integrations
* completed Logging / Guardrail Integrations
* doc Spend Tracking Improvements
* Logging / Guardrail Integrations
2025-04-26 11:54:18 -07:00
f7e75fa276
[Docs] UI Session Logs ( #10334 )
...
* add ui logs session doc
* docs add instructions on how to do session management
* docs session management
* docs session management
* docs responses api session management
* docs ui logs
2025-04-26 08:26:23 -07:00
0cc0da37f3
Update image_generation.md ( #10312 )
...
Copy parameters `size` and `quality` from [OpenAI API page](https://platform.openai.com/docs/api-reference/images/create )
2025-04-25 08:50:12 -07:00
6023427dae
docs(gemini.md): cleanup
2025-04-23 21:54:12 -07:00
5e2fd49dd3
Fix typos ( #10232 )
2025-04-23 20:59:25 -07:00
36ee132514
[Feat] Add gpt-image-1 cost tracking ( #10241 )
...
* add gpt-image-1
* add gpt-image-1 example to docs
2025-04-23 12:20:55 -07:00
6e4fed59b6
docs agent ops logging
2025-04-22 18:32:28 -07:00
b2955a2bdd
Add AgentOps Integration to LiteLLM ( #9685 )
...
* feat(sidebars): add new item for agentops integration in Logging & Observability category
* Update agentops_integration.md to enhance title formatting and remove redundant section
* Enhance AgentOps integration in documentation and codebase by removing LiteLLMCallbackHandler references, adding environment variable configurations, and updating logging initialization for AgentOps support.
* Update AgentOps integration documentation to include instructions for obtaining API keys and clarify environment variable setup.
* Add unit tests for AgentOps integration and improve error handling in token fetching
* Add unit tests for AgentOps configuration and token fetching functionality
* Corrected agentops test directory
* Linting fix
* chore: add OpenTelemetry dependencies to pyproject.toml
* chore: update OpenTelemetry dependencies and add new packages in pyproject.toml and poetry.lock
2025-04-22 10:29:01 -07:00
ebfff975d4
docs responses routing
2025-04-21 23:05:53 -07:00
104e4cb1bc
[Feat] Add infinity embedding support (contributor pr) ( #10196 )
...
* Feature - infinity support for #8764 (#10009 )
* Added support for infinity embeddings
* Added test cases
* Fixed tests and api base
* Updated docs and tests
* Removed unused import
* Updated signature
* Added support for infinity embeddings
* Added test cases
* Fixed tests and api base
* Updated docs and tests
* Removed unused import
* Updated signature
* Updated validate params
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
* fix InfinityEmbeddingConfig
---------
Co-authored-by: Prathamesh Saraf <pratamesh1867@gmail.com >
2025-04-21 20:01:29 -07:00
0c2f705417
[Feat] Add Responses API - Routing Affinity logic for sessions ( #10193 )
...
* test for test_responses_api_routing_with_previous_response_id
* test_responses_api_routing_with_previous_response_id
* add ResponsesApiDeploymentCheck
* ResponsesApiDeploymentCheck
* ResponsesApiDeploymentCheck
* fix ResponsesApiDeploymentCheck
* test_responses_api_routing_with_previous_response_id
* ResponsesApiDeploymentCheck
* test_responses_api_deployment_check.py
* docs routing affinity
* simplify ResponsesApiDeploymentCheck
* test response id
* fix code quality check
2025-04-21 20:00:27 -07:00
1ff7625984
docs: cleanup
2025-04-20 09:26:05 -07:00
aa55103486
docs: cleanup doc
2025-04-20 09:20:47 -07:00
1d9b58688b
docs(sidebars.js): place scim doc in correct place
2025-04-20 09:20:10 -07:00
bb13ac45c8
docs(index.md): cleanup
2025-04-19 19:16:10 -07:00
1be36be72e
Litellm docs SCIM ( #10174 )
...
* docs scim
* docs SCIM stash
* docs litellm SCIM
* docs fix
* docs scim with LiteLLM
2025-04-19 18:29:09 -07:00
bbfcb1ac7e
Litellm release notes 04 19 2025 ( #10169 )
...
* docs(index.md): initial draft release notes
* docs: note all pending docs
* build(model_prices_and_context_window.json): add o3, gpt-4.1, o4-mini pricing
* docs(vllm.md): update vllm doc to show file message type support
* docs(mistral.md): add mistral passthrough route doc
* docs(gemini.md): add gemini thinking to docs
* docs(vertex.md): add thinking/reasoning content for gemini models to docs
* docs(index.md): more links
* docs(index.md): add more links, images
* docs(index.md): cleanup highlights
2025-04-19 17:26:30 -07:00
daf024bad1
Supported Responses API Parameters
2025-04-19 17:14:53 -07:00
f39d917886
[Docs] Responses API ( #10172 )
...
* docs litellm responses api
* doc fix
* docs responses API
* add get_supported_openai_params for LiteLLMCompletionResponsesConfig
* add Supported Responses API Parameters
2025-04-19 17:10:45 -07:00
6de3481252
doc fix
2025-04-18 19:57:03 -07:00
76f00a5121
add info on litellm release
2025-04-18 19:56:29 -07:00
3d5022bd79
[Feat] Support for all litellm providers on Responses API (works with Codex) - Anthropic, Bedrock API, VertexAI, Ollama ( #10132 )
...
* transform request
* basic handler for LiteLLMCompletionTransformationHandler
* complete transform litellm to responses api
* fixes to test
* fix stream=True
* fix streaming iterator
* fixes for transformation
* fixes for anthropic codex support
* fix pass response_api_optional_params
* test anthropic responses api tools
* update responses types
* working codex with litellm
* add session handler
* fixes streaming iterator
* fix handler
* add litellm codex example
* fix code quality
* test fix
* docs litellm codex
* litellm codexdoc
* docs openai codex with litellm
* docs litellm openai codex
* litellm codex
* linting fixes for transforming responses API
* fix import error
* fix responses api test
* add sync iterator support for responses api
2025-04-18 19:53:59 -07:00
19664960eb
docs azure responses API
2025-04-17 18:47:44 -07:00
8be8022914
docs(vertex_ai.md): document new vertex passthrough route
2025-04-16 22:25:16 -07:00
7b7b43e1a7
build(deps): bump http-proxy-middleware in /docs/my-website ( #10064 )
...
Bumps [http-proxy-middleware](https://github.com/chimurai/http-proxy-middleware ) from 2.0.7 to 2.0.9.
- [Release notes](https://github.com/chimurai/http-proxy-middleware/releases )
- [Changelog](https://github.com/chimurai/http-proxy-middleware/blob/v2.0.9/CHANGELOG.md )
- [Commits](https://github.com/chimurai/http-proxy-middleware/compare/v2.0.7...v2.0.9 )
---
updated-dependencies:
- dependency-name: http-proxy-middleware
dependency-version: 2.0.9
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-16 09:55:44 -07:00
dcc43e797a
[Docs] Auto prompt caching ( #10044 )
...
* docs prompt cache controls
* doc fix auto prompt caching
2025-04-15 22:29:47 -07:00
837a6948d8
Fix typo: Entrata -> Entra in code ( #9922 )
...
* Fix typo: Entrata -> Entra
* Fix a few more
2025-04-15 17:31:18 -07:00
c9cf43df5b
chore(docs): Update logging.md ( #10006 )
...
Fixes a missing slash in OTEL_ENDPOINT example
2025-04-15 16:34:55 -07:00
8424171c2a
fix(config_settings.md): cleanup
2025-04-15 13:41:22 -07:00
aff0d1a18c
docs(cohere.md): add cohere cost tracking support to docs
2025-04-14 23:46:58 -07:00
Krish Dholakia