* Enable Tool Calling for `meta_llama` (#11825)
* feat: enable tools and function_call features
* fix: ignore pydantic warnings for StreamingChoices from llama-api
* docs: add tool calling examples
* docs: change default models to Maverick
* docs: fix output of tool use
* test_map_openai_params
---------
Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
* feat: add summarize parameter to /spend/logs endpoint for individual transaction logs
- Introduced a new `summarize` parameter to control data format when querying spend logs.
- `summarize=true` (default) returns aggregated data, while `summarize=false` provides individual transaction logs.
- Updated documentation and added tests to validate the new functionality.
* fix: wrap boto3.Session() with tracer for observability - Add tracer.trace wrapper around boto3.Session() call in _get_aws_region_name method - Ensures all boto3 initializations in base_aws_llm.py are properly instrumented - Fixes test_boto3_init_tracer_wrapping test failure - Maintains consistency with other boto3 calls in the same file
* Fix: #11853
Updated alerting.md to call the latest model for adding metadata.
* Fix: #11856
Updated billing docs to call newer GPT model for Langchain and CURL
Added the `aws_region_name` and `aws_role_name` keys to the definition of a guardrail config.
Without these you will get the error `{\"message\":\"The guardrail identifier or version provided in the request does not exist.\"}`
* fix(handle_jwt.py): check user object, if jwt user is proxy admin
correctly return user role - if jwt user has role updated in UI
* test(test_handle_jwt.py): add unit test for passing correct user role
* feat(model_info_view.tsx): separate UI component for updating edit model component
* feat(model_info_view.tsx): allow updating model access group on UI
show all available access groups in ui component
* docs: minor fixes
* feat(ui_sso.py): allow admin to specify additional headers for sso provider
some sso providers require special headers to return a json response
* test(test_ui_sso.py): add unit tests to ensure custom headers are respect3ed
* docs(config_settings.md): document new header param
* fix(litellm_pre_call_utils.py): add spend tag tracking by user agent
allows checking spend for cli tools like claude code
* feat(litellm_pre_call_utils.py): track spend by user agent part if user agent contains "/"
allows tracking spend across user agent versions
Better cost tracking for claude cod
* test(test_litellm_pre_call_utils.py): add testing for pre call utils, user agent parsing
* fix: fix linting check
* docs: track which items need docs
* docs(anthropic.md): add tool_choice="none" to docs
* docs: add docs for new anthropic + perplexity features
* docs: cleanup mistral reasoning docs
* docs: add links to docs
* docs(index.md): update docs
* docs: refactor to add a new 'integrations' tab to docs
* refactor(docs/): create separate tab for integrations
make it easier to highlight new integrations
* docs: sort sidebar
* docs: update
* feat: working claude code with openai codex mini
* docs: add responses api to docs
* feat(index.md): update docs
* fix: fix linting error
* docs: track which items need docs
* docs(anthropic.md): add tool_choice="none" to docs
* docs: add docs for new anthropic + perplexity features
* docs: cleanup mistral reasoning docs
* docs: add links to docs
* docs(index.md): update docs
* docs: refactor to add a new 'integrations' tab to docs
* refactor(docs/): create separate tab for integrations
make it easier to highlight new integrations
* docs: sort sidebar
* docs: update
* feat(langfuse_otel): add Langfuse OpenTelemetry integration for observability
- Introduced a new integration for Langfuse OpenTelemetry, allowing users to send LiteLLM traces and observability data.
- Updated sidebars to include documentation for the new integration.
- Added example usage and configuration details in the documentation.
- Implemented necessary classes and methods to handle OpenTelemetry attributes and configuration.
- Included tests to validate the integration functionality and environment variable handling.
Still WIP
* Remove example script for Langfuse OpenTelemetry integration with LiteLLM
- Revised the reasoning support indicators in the Mistral model documentation for clarity.
- Improved the `_add_reasoning_system_prompt_if_needed` method to handle both string and list content types for system messages, ensuring the reasoning prompt is correctly prepended.
- Added a new test case to verify the functionality of adding the reasoning system prompt when the existing content is a list.