* fix(auth_checks.py): enforce auth checks on target model names
ensures user has access to models they are trying to call
* test(test_auth_utils.py): add unit tests for auth check
* fix(exception_mapping_utils.py): handle mistral 429 exception
* fix: fix linting error
* fix(auth_checks.py): add max fallback depth
* feat(router.py): translate the model in jsonl for create file deployment to use the deployment model name
* test: add unit test for replace model in jsonl
* test(test_router.py): add unit tests
* test: add unit tests
* fix(router.py): write file to all deployments
allows unified file id to work across multiple deployments
* fix(view_logs/index.tsx): show call type in request logs
* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs
* fix(batch_utils.py): broaden check
* fix(router_utils.py): handle null type for function name
* fix(proxy_track_cost_callback.py): fix ruff check error
* fix(router.py): handle healthy_deployments as a dict
* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)
* feat(managed_files.py): support encoding / decoding unified batch id when using managed files
allows routing retrieve batch to the right model id
* fix: fix linting error
* feat(managed_files.py): support unified output file id
enables batch output file id to be used to retrieve the actual file
* fix(managed_files.py): attempt to fix ci/cd linting error
* fix: fix ruff check
* fix(router.py): write file to all deployments
allows unified file id to work across multiple deployments
* fix(view_logs/index.tsx): show call type in request logs
* fix(router.py): pass a deep copy of kwargs to avoid conflict across multiple runs
* fix(batch_utils.py): broaden check
* fix(router_utils.py): handle null type for function name
* fix(proxy_track_cost_callback.py): fix ruff check error
* fix(router.py): handle healthy_deployments as a dict
* feat(managed_files.py): support encoding / decoding unified batch id … (#10711)
* feat(managed_files.py): support encoding / decoding unified batch id when using managed files
allows routing retrieve batch to the right model id
* fix: fix linting error
* test: add unit tests
* fix: fix ruff check
* Azure LLM: fix passing through of azure_ad_token_provider parameter
* add test
---------
Co-authored-by: Clara Luise Pohland <clara-luise.pohland@telekom.de>
* fix(caching_handler.py): fix embedding str caching result
Fixes issue where str caching results were not being correctly assembled on str input
* feat(azure/image_generation): Support dropping response_format for azure gpt-image-1
Fixes LIT-118
* test(test_utils.py): add unit testing
* test: rename file to avoid testing conflict
* Add management client docs
* Docs enhancements
* Add "proxy/management_cli" to sidebar
* Small formatting changes
* Add overview table
* Wrap long line
* Add "Quick Start" section
* Document uv tool upgrade and uninstall
* Add blank lines to eliminate yellow squigglies in VS Code
* For each section link to section on swagger used
* Wrap some long command examples
* Break long http request command on to multiple lines
* Add --version flag to litellm-proxy CLI
```shell
$ litellm-proxy --version
litellm-proxy version: 1.68.1
```
* Return both client and server version
* Update docs
* Add a test for the version command
* Add litellm/proxy/client/health.py
* [FIX] Update token fields in schema.prisma to use BigInt for improved handling of large values across LiteLLM models.
* [FIX] revert SpendLogs back to Int
* fix support for python 3.11-
3.11 introduced datetime.UTC, this provides a fallback for 3.11-
* use litellm.utils.get_utc_datetime
* remove unused timezone import
Co-authored-by: Matthew Farrellee <matt@cs.wisc.edu>
* test(base_llm_unit_tests.py): return '<thinking>' tag in response content
* fix(converse_transformation.py): extract `<thinking>` block from nova tool use response
Fixes https://github.com/BerriAI/litellm/issues/9063
* fix(factory.py): handle non-signature reasoning blocks to bedrock
pass as text input - bedrock raises ""User messages cannot contain reasoning content. Please remove the r
easoning content and try again." otherwise
* fix(main.py): Add drop params support for gpt
Fixes https://github.com/BerriAI/litellm/issues/10501
* fix(converse_transformation.py): fix linting error
* fix(utils.py): fix linting error
* test: cleanup test
* test: skip test until we have bedrock prompt caching permission
* fix(user_api_key_auth.py): add 'headers' to constructed request for websocket
Fix issue on some datastructure versions which require a headers field in scope
* test(test_user_api_key_auth.py): add unit testing for headers in scope change
* fix(router.py): migrate `_arealtime` to generic router endpoint
Fix infinite loop on model name missing for realtime api calls
* test(test_router_helper_utils.py): cleanup test post refactor
Krrish Dholakia