a03390ccc7
Litellm dev 07 03 2025 p2 ( #12301 )
...
* fix(langfuse_prompt_management.py): add langfuse prompt version param support
Adds prompt versioning support
* test(test_langfuse_prompt_management.py): add unit test
* fix: fix linting errors
* fix: add prompt_version instrumentation
* fix(langfuse_otel.py): correctly read env var
* docs(langfuse_integration.md): clarify v3 recommendation is to use langfuse_otel
Closes https://github.com/BerriAI/litellm/issues/11500
* docs(langfuse_otel_integration.md): cleanup docs
* test: fix test
* test: update tests
* fix: fix linting error
2025-07-03 22:40:21 -07:00
f76375b651
docs(index.md): add batch api cost tracking to docs
2025-06-28 22:25:15 -07:00
50dd9980dc
docs - update release notes
2025-06-28 21:56:58 -07:00
f7af8902b0
/v1/messages - Remove hardcoded model name on streaming + Tags - enable setting custom header tags (#12131 )
...
* fix(anthropic/experimental_pass_through): use given model name when returning streaming chunks
don't harcode model name on streaming
confusing for user
* fix(anthropic/streaming_iterator.py): remove scope of import
* feat(litellm_logging.py): allow admin to specify additional headers for using as spend tags
Closes https://github.com/BerriAI/litellm/issues/12129
* test(test_litellm_logging.py): add unit tests
* feat(openweb_ui.md): add custom tag tutorial to docs
* docs(cost_tracking.md): add tag based usage UI screenshot
* test: update test
* fix: fix import
2025-06-28 21:49:35 -07:00
51c1c7bd36
Add Elasticsearch Logging Tutorial ( #11761 )
...
* docs: add Elasticsearch logging tutorial and update sidebar
* docs: update Elasticsearch logging tutorial to include OpenTelemetry setup and configuration
* docs: remove sections from Elasticsearch logging tutorial
* docs: remove analytics examples from Elasticsearch logging tutorial
* Update Elasticsearch version and logging exporter configuration in the Elasticsearch logging tutorial
* Add visualization instructions for LLM telemetry data in Kibana to Elasticsearch logging tutorial
* Add Elasticsearch demo image to documentation
* Move demo image for Elasticsearch logging tutorial
2025-06-25 15:17:37 -07:00
c0de1320fc
docs(index.md): update release notes with default team for new users
2025-06-21 23:09:47 -07:00
3224b0f4fe
(Tutorial) Onboard Users for AI Exploration ( #11955 )
...
* fix: allow setting no-default-models and unsetting max budget
* docs(sso_self_serve.md): add e2e tutorial of onboarding users for ai exploration
* docs: rename doc
2025-06-21 16:54:23 -07:00
6cd799a78c
docs release notes
2025-06-21 16:37:35 -07:00
0bed17068b
docs add imgs
2025-06-21 15:11:58 -07:00
bb256c6d83
Release note updates + Responses API Bridge improvements ( #11740 )
...
* docs: track which items need docs
* docs(anthropic.md): add tool_choice="none" to docs
* docs: add docs for new anthropic + perplexity features
* docs: cleanup mistral reasoning docs
* docs: add links to docs
* docs(index.md): update docs
* docs: refactor to add a new 'integrations' tab to docs
* refactor(docs/): create separate tab for integrations
make it easier to highlight new integrations
* docs: sort sidebar
* docs: update
* feat: working claude code with openai codex mini
* docs: add responses api to docs
* feat(index.md): update docs
* fix: fix linting error
2025-06-15 01:13:10 -07:00
55af010d26
docs mcp
2025-06-14 18:10:37 -07:00
b091c1ac4d
[Feat] Prometheus - Allow controlling exposed metrics and labels ( #11489 )
...
* feat: init prometheus_metrics_config
* feat: add prometheus_metrics_config
* test prometheus
* feat: use factor to init metrics
* fix - pretty print allowed metrics controls
* fix config
* fix - working get_labels_for_metric
* test_no_prometheus_config
* docs update prometheus
2025-06-14 13:56:40 -07:00
6657012f07
docs release note
2025-06-12 11:11:00 -07:00
35bc2d52a3
docs(index.md): document rate limiting improvements
2025-06-07 19:51:26 -07:00
3f41b84408
docs add audit logs to release note
2025-06-07 18:27:27 -07:00
4fc92244b5
[Docs] v1.72.2.rc ( #11519 )
...
* v1-72-2.rc
* docs v1.72.2.rc
* docs 1.72.2.rc
* docs update
* docs Bug Fixes
* add TLDR section
* add table
* docs release notes
* docs v1-72-2-stable
* docs /v1/messages
* docs hf rerank
2025-06-07 17:20:15 -07:00
368e59181d
docs(entity_usage.tsx): fix bad link
2025-05-29 11:00:18 -07:00
77d2615185
docs release notes
2025-05-24 21:24:44 -07:00
66c44bb9f3
docs notes
2025-05-24 21:00:01 -07:00
cb58fc7f6d
docs: doc improvements
2025-05-24 19:06:00 -07:00
8da898c55e
[feature] ConfidentAI logging enabled for proxy and sdk ( #10649 )
...
* async success implemented
* fail async event
* sync events added
* docs added
* docs added
* test added
* style
* test
* .
* lock file genrated due to tenacity change
* mypy errors
* resolved comments
* resolved comments
* resolved comments
* resolved comments
* style
* style
* resolved comments
2025-05-23 11:40:48 -07:00
16b2158d25
docs: update release notes
2025-05-17 19:47:57 -07:00
d367eb3460
[Docs] Pii masking with LiteLLM ( #10924 )
...
* doc pii masking
* remove old doc
* docs add deployment options
* docs guardrail pii masking
* docs pii masking / tracing
* add images of tracing guards litellm ui
* docs presidio pii
2025-05-17 18:35:33 -07:00
b342aa9253
add docs for spend logs ( #10913 )
...
* add docs for spend logs
* change docs
* change docs
* change docs and change default run loops.
There was a calc error previously, it was not a million when run 100 times, but 100k, now default run would delete 500k records in 50s (running 500 loops of function before exiting)
* add docs changes to ui logs to metion deletion
2025-05-17 16:00:28 -07:00
2cc4a87861
[Docs] Using litellm with Google ADK ( #10777 )
...
* docs litellm ADK usage
* docs litellm google adk
* docs litellm ADK
* docs litellm with ADK usage examples
* docs litellm proxy with ADK
* cookbook litellm ADK
2025-05-12 16:41:49 -07:00
97e23f9c03
docs email notifs 2.0
2025-05-10 23:00:20 -07:00
af201d7c5d
docs release notes
2025-05-10 22:48:58 -07:00
b42c32fae5
docs - stable release
2025-05-10 22:35:05 -07:00
7942f6f595
[Docs] Email notifs ( #10733 )
...
* docs emails
* docs email notifs
2025-05-10 17:24:18 -07:00
9ae239b3e1
docs(index.md): add graphic
2025-05-05 20:49:47 -07:00
489f1a6c25
[Feat] v2 Custom Logger API Endpoints ( #10575 )
...
* fixes for generic api logger
* tests for generic api logger
* test_generic_api_callback_multiple_logs
* allow health checking generic api endpoints
* docs generic api endpoint for logging
* allow setting headers for generic api callback
* fix for test_init_custom_logger_compatible_class_as_callback
* fix linting
2025-05-05 16:57:55 -07:00
bccab23a6a
add vector stores to release note
2025-05-03 21:51:03 -07:00
071c8a2e26
[Docs] Using LiteLLM with vector stores / knowledge bases ( #10534 )
...
* docs vector store registry
* img for kbs
* docs kb with litellm
* fix code qa
2025-05-03 11:28:33 -07:00
a5ef8a9556
update release note with imgs
2025-04-26 20:14:39 -07:00
8c8b786267
doc fix stable release add images of UI improvements
2025-04-26 12:13:59 -07:00
f7e75fa276
[Docs] UI Session Logs ( #10334 )
...
* add ui logs session doc
* docs add instructions on how to do session management
* docs session management
* docs session management
* docs responses api session management
* docs ui logs
2025-04-26 08:26:23 -07:00
1ff7625984
docs: cleanup
2025-04-20 09:26:05 -07:00
1be36be72e
Litellm docs SCIM ( #10174 )
...
* docs scim
* docs SCIM stash
* docs litellm SCIM
* docs fix
* docs scim with LiteLLM
2025-04-19 18:29:09 -07:00
bbfcb1ac7e
Litellm release notes 04 19 2025 ( #10169 )
...
* docs(index.md): initial draft release notes
* docs: note all pending docs
* build(model_prices_and_context_window.json): add o3, gpt-4.1, o4-mini pricing
* docs(vllm.md): update vllm doc to show file message type support
* docs(mistral.md): add mistral passthrough route doc
* docs(gemini.md): add gemini thinking to docs
* docs(vertex.md): add thinking/reasoning content for gemini models to docs
* docs(index.md): more links
* docs(index.md): add more links, images
* docs(index.md): cleanup highlights
2025-04-19 17:26:30 -07:00
3d5022bd79
[Feat] Support for all litellm providers on Responses API (works with Codex) - Anthropic, Bedrock API, VertexAI, Ollama ( #10132 )
...
* transform request
* basic handler for LiteLLMCompletionTransformationHandler
* complete transform litellm to responses api
* fixes to test
* fix stream=True
* fix streaming iterator
* fixes for transformation
* fixes for anthropic codex support
* fix pass response_api_optional_params
* test anthropic responses api tools
* update responses types
* working codex with litellm
* add session handler
* fixes streaming iterator
* fix handler
* add litellm codex example
* fix code quality
* test fix
* docs litellm codex
* litellm codexdoc
* docs openai codex with litellm
* docs litellm openai codex
* litellm codex
* linting fixes for transforming responses API
* fix import error
* fix responses api test
* add sync iterator support for responses api
2025-04-18 19:53:59 -07:00
dcc43e797a
[Docs] Auto prompt caching ( #10044 )
...
* docs prompt cache controls
* doc fix auto prompt caching
2025-04-15 22:29:47 -07:00
65e18f6abe
docs(index.md): update changelog with realtime api cost tracking details
2025-04-12 19:15:40 -07:00
c86e678809
[Docs] v1.66.0-stable fixes ( #9953 )
...
* add categories for spend tracking improvements
* xai reasoning usage
* docs tag management
* docs tag based routing
* [Beta] Routing based
* docs tag based routing
* docs tag routing
* docs enterprise web search
2025-04-12 16:57:25 -07:00
eb998ee1c0
[v1.66.0-stable] Release notes ( #9952 )
...
* release notes
* docs release notes
* docs fix release notes
* docs clean up
* docs clean up
* release notes
* docs sso tag management
2025-04-12 15:32:52 -07:00
25d4cf1c1d
Litellm managed files docs ( #9948 )
...
* docs(files_endpoints.md): add doc on litellm managed files
* refactor: separate litellm managed file docs from `/files` docs
clearer
* docs(litellm_managed_files.md): add architecture diagram explaining managed files
2025-04-12 13:02:33 -07:00
595c0cbb42
docs msft default team settings
2025-04-10 20:22:46 -07:00
34b1bf2c75
docs msft_default_settings
2025-04-10 20:21:14 -07:00
f5c5c79ea4
update docs
2025-04-10 20:18:54 -07:00
98e34cbf5d
[Docs] Tutorial using MSFT auto team assignment with LiteLLM ( #9898 )
...
* add default_team_params as a config.yaml setting
* create_litellm_team_from_sso_group
* test_default_team_params
* test_create_team_without_default_params
* docs default team settings
* docs msft entra id tutorial
* commit litellm docs msft group assignment
* litellm MSFT sso
* member, team assignment on litellm
* docs msft auto assignment
* bug fix default team setting
* docs litellm default team settings
* test_default_team_params
2025-04-10 20:07:55 -07:00
6f7e9b9728
[Feat SSO] Debug route - allow admins to debug SSO JWT fields ( #9835 )
...
* refactor SSO handler
* render sso JWT on ui
* docs debug sso
* fix sso login flow use await
* fix ui sso debug JWT
* test ui sso
* remove redis vl
* fix redisvl==0.5.1
* fix ml dtypes
* fix redisvl
* fix redis vl
* fix debug_sso_callback
* fix linting error
* fix redis semantic caching dep
2025-04-09 15:29:35 -07:00
Krish Dholakia