tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-05 22:25:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
24,546 Commits 2,072 Branches 1,425 Tags
d1c376f93e167478fc2dd37bed80ca878126676b
Commit Graph
24546 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
mubashir1osmani d1c376f93e fix custom callback docs 2025-09-03 12:45:42 -04:00
mubashir1osmani ecc607257b fixed prometheus metrics 2025-09-03 02:14:59 -04:00
Krish DholakiaandGitHub 46655544a4 Merge pull request #14179 from zhirafovod/otel_logs_metrics 2025-09-02 19:50:40 -07:00
Ishaan Jaff 212ca20edf docs fix 2025-09-02 15:19:35 -07:00
Ishaan JaffandGitHub 128d9a3488 [Feature]: Add header support for spend_logs_metadata (#14186) 
* fix: allow settings spend_logs_metadata

* fix add_litellm_data_for_backend_llm_call

* fix: add add_litellm_metadata_from_request_headers

* fix add_litellm_metadata_from_request_headers

* test_add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers

* docs Tracking Spend with custom metadata

* add_litellm_metadata_from_request_headers

* add_litellm_metadata_from_request_headers
 2025-09-02 15:13:15 -07:00
Ishaan JaffandGitHub c821f1ddf1 [Feature]: Support GPT-OSS models on vertex ai (#14184) 
* add VertexAIGPTOSSTransformation

* fix: optional_params

* fix: is_vertex_partner_model

* test_partner_models_httpx

* docs GPT oss docs

* test_vertex_ai_gpt_oss_reasoning_effort

* add vertex ai models
 2025-09-02 14:15:26 -07:00
Ishaan Jaff 4b7c114c2a google-cloud-aiplatform 2025-09-02 14:15:00 -07:00
Ishaan Jaff 47c04a8a8c proxy_logging_guardrails_model_info_tests 2025-09-02 14:13:17 -07:00
Krrish Dholakia d282e7eaac fix: handle non-str case 2025-09-02 12:38:05 -07:00
Ishaan Jaff f0f84d6c5c refactor: BEDROCK_CONVERSE_MODELS 2025-09-02 12:12:21 -07:00
Sameer KankuteandGitHub 4adfd18bc6 [Feat]Add support for safety_identifier parameter in chat.completions.create (#14174) 
* Add support for safety_identifier parameter in chat.completions.create

* make sure param is getting actually passed to the raw api
 2025-09-02 09:37:08 -07:00
Keith Decker 5dcdbb35da add metrics and logs (events) with semconv attributes 2025-09-02 09:20:25 -06:00
Ishaan Jaff 61b2209827 test_proxy_function_calling_support_consistency 2025-09-02 07:22:52 -07:00
Krish DholakiaandGitHub 359780b436 Merge pull request #14121 from BerriAI/litellm_dev_08_31_2025_p1 
VLLM - handle output parsing responses api output + Ollama - add unified 'thinking' param support (via `reasoning_content`)
 2025-09-01 22:43:05 -07:00
Krish DholakiaandGitHub 82d6c4d5b1 Merge branch 'main' into litellm_dev_08_31_2025_p1 2025-09-01 22:42:53 -07:00
Krish DholakiaandGitHub 6d36219a4d Merge pull request #14122 from BerriAI/litellm_dev_08_30_2025_p1 
Braintrust - fix logging when OTEL is enabled + Gemini - add 'thoughtSignature' support via 'thinking_blocks'
 2025-09-01 22:42:12 -07:00
Krish DholakiaandGitHub d2c519f005 Merge pull request #14133 from retanoj/fix/gemini-token-count 
Fix token count error for gemini cli
 2025-09-01 22:39:51 -07:00
Ishaan Jaff 5ab3d74371 DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-01 20:34:23 -07:00
Ishaan Jaff 20811372d8 Revert "Merge pull request #14126 from TomeHirata/citation-supported-text-2" 
This reverts commit 3f2881cd6d, reversing
changes made to 04f9ff16c4.
 2025-09-01 20:24:14 -07:00
Ishaan Jaff 62f14dece3 fix: regression added from prometheus_missing_metrics 2025-09-01 20:21:09 -07:00
Ishaan Jaff d37be48a80 test: llama-3.3-70b-versatile 2025-09-01 20:14:12 -07:00
Ishaan Jaff 94cac6fff2 fix: groq health check 2025-09-01 20:08:36 -07:00
Krish DholakiaandGitHub 3f2881cd6d Merge pull request #14126 from TomeHirata/citation-supported-text-2 
Add supported text field to anthropic citation response
 2025-09-01 19:22:52 -07:00
retanoj b1686ecbe5 format 2025-09-02 09:59:31 +08:00
Krish DholakiaandGitHub 04f9ff16c4 Merge pull request #14139 from mubashir1osmani/prometheus_missing_metrics 
Prometheus missing metrics
 2025-09-01 18:55:24 -07:00
Krish DholakiaandGitHub 67450feb79 Merge pull request #14146 from ProjectAlita/gpt_5_unsupported_params 
GPT-5: Drop unsupported params
 2025-09-01 18:54:49 -07:00
retanoj 3b524ba5f1 format 2025-09-02 09:52:50 +08:00
Ishaan Jaff 8e72f991cc test_model_alias_map 2025-09-01 17:59:40 -07:00
Krrish Dholakia f1f9f2a594 fix: fix linting error 2025-09-01 17:52:22 -07:00
Krrish Dholakia 5d6532419f refactor: remove unused function 2025-09-01 17:46:38 -07:00
Krrish Dholakia c54c41f726 fix: fix ruff errors 2025-09-01 17:38:39 -07:00
Krrish Dholakia 4a422ca897 fix: support logging dynamic metadata values to braintrust 2025-09-01 17:38:15 -07:00
Ishaan Jaff e17bed715e DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-01 17:08:03 -07:00
Ishaan JaffandGitHub 4c7b3e10ed [Bug Fix] Gemini Tool Calling - fix gemini empty enum property (#14155) 
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* add _fix_enum_empty_strings

* test_tool_call_with_empty_enum_property

* test_fix_enum_empty_strings

* fix _fix_enum_empty_strings
 2025-09-01 17:05:01 -07:00
Ishaan Jaff 7656cb3d6e test fix 2025-09-01 17:04:47 -07:00
Ishaan JaffandGitHub 2331fb45d5 [Bug]: Gemini 2.5 Pro – schema validation fails with OpenAI-style type arrays in tools (#14154) 
* fix: _convert_schema_types

* fix recursive detector

* test_convert_schema_types_type_array_conversion

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
 2025-09-01 16:53:20 -07:00
Ishaan JaffandGitHub 98d57b5d27 [Feat] Allow using x-litellm-stream-timeout header for stream timeout in requests (#14147) 
* fix: allow passing stream_timeout header

* fix: _get_stream_timeout_from_request

* test_add_litellm_data_to_request_with_stream_timeout_header

* docs: LiteLLM Headers

* test_add_litellm_data_to_request_with_stream_timeout_header
 2025-09-01 15:59:14 -07:00
Mubashir OsmaniandGitHub 58ac3ecf84 openrouter: added gpt 4.1 model family (#14101) 2025-09-01 15:36:17 -07:00
Ishaan JaffandGitHub 58b713d19d [Bug fix] Misclassified 500 error on invalid image_url in /chat/completions request (#14149) 
* add ImageFetchError

* docs ImageFetchError

* fix ImageFetchError

* test_completion_with_invalid_image_url
 2025-09-01 15:26:27 -07:00
Ishaan JaffandGitHub 2985915357 [Perf] LiteLLM Proxy: +400 RPS when using correct amount of CPU cores (#14153) 
* bump: DEFAULT_NUM_WORKERS_LITELLM_PROXY

* fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY
 2025-09-01 15:26:16 -07:00
Krish DholakiaandGitHub 9e947fce19 Merge pull request #14087 from zainhas/main 
update together models
 2025-09-01 15:07:58 -07:00
AbhinavandGitHub b6c26c3365 helm(chart): add optional PodDisruptionBudget for litellm proxy (#14062) (#14093) 2025-09-01 12:21:44 -07:00
Krish DholakiaandGitHub a6f8808b0b Merge pull request #14134 from BerriAI/back-to-logs 
Back to Keys should say Back to Logs
 2025-09-01 12:01:47 -07:00
Sameer KankuteandGitHub c51665ec9c fix xai cost calculation (#14127) 2025-09-01 11:31:56 -07:00
tanjiroandGitHub 735af5bf36 success tooltip added (#14132) 2025-09-01 11:08:58 -07:00
tanjiroandGitHub ca70b689af Logs page screen size fixed (#14135) 
* width fixed

* tailwind css instead of inline css

* minor width fixes

* time button fixed

* fixed width for the "showing..." part
 2025-09-01 11:08:09 -07:00
Ivan Krakhmaliuk 76dd9d8110 GPT-5: Test for unsupported params 2025-09-01 20:30:43 +03:00
Ivan KrakhmaliukandGitHub 2622a0634a GPT-5: Remove params unsupported with reasoning models 2025-09-01 19:51:54 +03:00
mubashir1osmani 2626123aca added litellm_spend_metric 2025-09-01 11:33:34 -04:00
mubashir1osmani 5649c0f0b9 Revert "feat: add persistence and management for guardrails on virtual keys" 
This reverts commit 6cd5afa8b1.
 2025-09-01 10:45:46 -04:00