tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-06-17 12:48:57 +00:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 5f3b54c888 fix(cloudflare): correct content-type header in validate_environment litellm_fix_cloudflare_content_type_typo tiennm99 2026-06-12 20:50:34 +07:00
  • 6b0b43b390 fix(proxy): always return direct_access on /v1/model/info litellm_v1.88.1_patch_modelv1 Sameer Kankute 2026-06-12 13:36:34 +05:30
  • 959a6df5f5 fix(proxy): populate access_via_team_ids on /v1/model/info Sameer Kankute 2026-06-12 12:31:47 +05:30
  • 4903aba357 fix(tests): update google_ai_studio mocks from aiter_bytes to aiter_lines litellm_fix_vertex_gemini_image_streaming Sameer Kankute 2026-06-12 18:36:08 +05:30
  • 1ae254b3e8 feat(proxy): register cancel_on_disconnect in ConfigGeneralSettings and config list (#30295) litellm_oss_staging_120626 kursadlacin 2026-06-12 15:53:11 +03:00
  • 69d9d292e3 fix(pass_through_endpoints): re-export resolve_llm_passthrough_timeout for backward compat litellm_pass-through-request-timeout Sameer Kankute 2026-06-12 18:07:43 +05:30
  • 4d301c456c fix(test): update test_db_error_new_model_check for new _delete_deployment logic Sameer Kankute 2026-06-12 18:06:27 +05:30
  • 1a3282177d fix: resolve failing tests and lint in snowflake/team endpoints Sameer Kankute 2026-06-12 17:56:29 +05:30
  • 1aba1d762d fix(pass_through_endpoints): re-export DEFAULT_PASS_THROUGH_REQUEST_TIMEOUT_SECONDS Sameer Kankute 2026-06-12 17:53:49 +05:30
  • 9692f01b68 test(ui-e2e): re-issue deep-link navigation when auth bootstrap drops the page param litellm_bedrock-passthrough-guardrails mateo-berri 2026-06-12 12:23:40 +00:00
  • fda7b921f6 feat: add EmpirioLabs as an OpenAI-compatible provider (#30278) Adam Dalloul 2026-06-12 05:18:40 -07:00
  • 011e068ca2 fix(lint): remove unused imports from pass_through_endpoints.py Sameer Kankute 2026-06-12 17:42:52 +05:30
  • 88b0e2a9ba Merge pull request #29528 from aanchal22/litellm_byok-alias-merge Aanchal Khandelwal 2026-06-11 14:00:11 -04:00
  • b52b3b1866 feat(datadog): add team-scoped Datadog callback support (#29947) Aanchal Khandelwal 2026-06-10 23:00:16 -04:00
  • 6ee7a4aefe Update litellm/llms/snowflake/chat/transformation.py Sameer Kankute 2026-06-12 17:34:30 +05:30
  • 7a2c500521 fix(ui): infer Azure API version from API base (#30204) GaetanVDB07 2026-06-12 13:54:40 +02:00
  • 7bfcae0088 fix(voyage): route multimodal embeddings to correct endpoint (#30193) lost9999 2026-06-12 19:53:31 +08:00
  • 338e495b6c fix(main): clarify backend route handling for Swagger static assets (#30196) mauriceberentsen 2026-06-12 13:46:10 +02:00
  • a1c6a56668 fix: add scaleway models pricing (#27659) Quentin Champenois 2026-06-12 13:44:24 +02:00
  • db487557d2 fix: invalidate Redis spend counter on /key/reset_spend (#29694) Michael 2026-06-12 18:41:18 +07:00
  • 3bfc6a8b45 fix: evict last deleted model in multi-instance deployments (#28608) Rudra Dudhat 2026-06-12 17:00:40 +05:30
  • 489531a63f fix(snowflake): migrate to native endpoints with auto-routing for Claude models (#29964) sfc-gh-nashukla 2026-06-12 04:28:35 -07:00
  • e08455905c feat(proxy): auto-enable drop_params for Claude Code requests (#30218) Mateo Wang 2026-06-12 04:26:28 -07:00
  • 07fb284c85 fix(proxy): scope bedrock passthrough stream buffering to de-anonymizable endpoints mateo-berri 2026-06-12 11:23:27 +00:00
  • c772b8b223 fix(health): treat all-proxy-models keys as unrestricted in /health (#30087) Filippo Menghi 2026-06-12 13:10:12 +02:00
  • b4a3d372e8 fix(slack_alerting): stop false-positive hanging request alerts for requests below the alerting threshold (#30106) Filippo Menghi 2026-06-12 13:08:23 +02:00
  • 6bc5807447 fix(router): route aspeech through async_function_with_fallbacks (#30104) Filippo Menghi 2026-06-12 13:05:21 +02:00
  • badffac844 fix(proxy): set Retry-After header on RouterRateLimitError 429 responses (#30098) Filippo Menghi 2026-06-12 13:02:21 +02:00
  • 2fe68a89cc refactor(bedrock): import event-stream crc32 from binascii not botocore internals mateo-berri 2026-06-12 11:01:27 +00:00
  • 4edf1ceb8c fix(bedrock): grant aws-external-anthropic:* in OIDC session policy for claude_platform (#30200) (#30205) hcl 2026-06-12 18:59:14 +08:00
  • a00f7692ad fix(proxy): cancel in-flight upstream LLM request on client disconnect (opt-in) (#30223) kursadlacin 2026-06-12 13:54:41 +03:00
  • ae593030ec test(translation): regenerate DIFFERENTIAL_REPORT.md on the de-biased fixtures (+ the wire-carried service_tier row) mateo/translation-v2-wave1a mateo-berri 2026-06-12 10:53:04 +00:00
  • 4cc8ca455a feat(otel): emit v2 cost breakdown + stamp tracer scope version (#30156) Chris Hoogeboom 2026-06-12 06:51:41 -04:00
  • c6dfb86247 fix(translation): take critic-wave1a NITs N2, N3 and verifier-wave1a F6 mateo-berri 2026-06-12 10:47:05 +00:00
  • dd34b09893 fix(bedrock): stop buffering streamed tool-call argument deltas (#30231) fangkang 2026-06-12 11:44:44 +01:00
  • c07f64442f fix(bedrock): stop stream_chunk_size leaking into invoke request bodies (#30240) fangkang 2026-06-12 11:42:54 +01:00
  • 5955754c57 fix(translation): de-bias the stream replay fixtures and preset service_tier at the shared openai chunk seam (verifier-wave1a F1) mateo-berri 2026-06-12 10:42:48 +00:00
  • c8665a672f fix(proxy): apply response-headers hook on guardrailed bedrock passthrough responses mateo-berri 2026-06-12 10:42:28 +00:00
  • e74c1d246e fix(langfuse_otel): mark LLM spans as generations (#30250) Muspi Merol 2026-06-12 18:41:21 +08:00
  • 64aefbf9df fix(translation): close the together_ai gpt-4-name parity break (verifier-wave1a F2) mateo-berri 2026-06-12 10:40:11 +00:00
  • fa9e015a19 test(translation): encode the baseten steady state and registration-coverage completeness (critic-wave1a M2, verifier-wave1a F3) mateo-berri 2026-06-12 10:38:37 +00:00
  • c05635e9de refactor(translation): take critic-wave1a M1+M3 (+ NITs N1, N4, N5, N6) mateo-berri 2026-06-12 10:37:12 +00:00
  • 571ec52af8 feat(responses): enable the responses API for the Tensormesh provider (#30209) daitran-tensormesh 2026-06-12 17:31:17 +07:00
  • 73781d9a54 feat(bedrock): add bedrock mantle gemma 4 models (#30264) Emerson Gomes 2026-06-11 22:24:46 -05:00
  • 1e8377f3eb fix(timeout_utils): avoid fastapi transitive import by using sys.modules Sameer Kankute 2026-06-12 16:02:09 +05:30
  • 3956d58060 fix(router): use _explicit_timeout for passthrough to not shadow general_settings Sameer Kankute 2026-06-12 16:00:29 +05:30
  • 49b74ccd39 refactor(passthrough): extract timeout utils to proxy-free module, fix router_timeout drop Sameer Kankute 2026-06-12 15:49:00 +05:30
  • b4fb2b2e16 fix(bedrock): skip passthrough output write-back when guardrail returns no texts mateo-berri 2026-06-12 10:10:50 +00:00
  • 7f10ab1b70 test(databricks): drop empty __init__.py in responses test dir to avoid package collision cursor/ci-autofix-automation-64c0 Cursor Agent 2026-06-12 10:07:55 +00:00
  • ef8a250717 test(translation): regenerate DIFFERENTIAL_REPORT.md with the compat_sdk family rows mateo-berri 2026-06-12 09:56:08 +00:00
  • 33874e241e test(translation): compat_sdk two-sided differential gates per provider mateo-berri 2026-06-12 09:56:02 +00:00
  • 89622dc2b5 feat(translation): port the 13 wave-1a SDK-path openai-compat providers via one compat_sdk family mateo-berri 2026-06-12 09:55:52 +00:00
  • 0a186774f8 fix(proxy): set content-type on buffered bedrock passthrough event-stream responses mateo-berri 2026-06-12 09:38:26 +00:00
  • c6a512f3f8 test(local): skip httpbin timeout probe when the service returns 5xx mateo-berri 2026-06-12 09:14:09 +00:00
  • b64b732772 fix(translation): take critic-grok M1-M4 and verifier-grok F1/F2 (+ NITs N1, N2, N4, N5) mateo/translation-v2-grok mateo-berri 2026-06-12 09:18:50 +00:00
  • 759d013cdf fix(bedrock): log instead of silently dropping passthrough guardrail edge cases mateo-berri 2026-06-12 09:15:21 +00:00
  • 3bfeb3a8f9 fix(bedrock): scan tool definitions and additional request fields for passthrough guardrails mateo-berri 2026-06-12 09:12:20 +00:00
  • de16aa410f fix(proxy): forward upstream headers on bedrock guardrail passthrough responses mateo-berri 2026-06-12 08:51:02 +00:00
  • ae4643ba8a test(translation): xai two-sided differential gates over a generated characterization corpus mateo-berri 2026-06-12 08:44:39 +00:00
  • 3f88f7b37e feat(translation): register xai in the pipeline tables and Provider literal mateo-berri 2026-06-12 08:44:38 +00:00
  • 9cd880c9f8 feat(translation): xai provider wrapping openai_compat (guard name knob, gate-free assemble_body, xai chunk dialect) mateo-berri 2026-06-12 08:44:38 +00:00
  • 2eaffcec90 refactor(proxy): keep bedrock event-stream content-type detection in llms mateo-berri 2026-06-12 01:25:04 -07:00
  • ed0b1de96d fix(bedrock): guardrail non-text converse stream deltas on passthrough mateo-berri 2026-06-12 08:08:21 +00:00
  • 3fe015ef6c fix(translation): google raw guard for message name beside cache markers (verifier-integration blocker) mateo/translation-v2-providers mateo-berri 2026-06-12 08:10:39 +00:00
  • 99f2528bd8 fix(proxy): always return direct_access on /v1/model/info litellm_v1_model_info_team_access Sameer Kankute 2026-06-12 13:36:34 +05:30
  • bec3b8e321 fix(proxy): scope passthrough post-call guardrail buffering to the request mateo-berri 2026-06-12 07:51:43 +00:00
  • fbf032f861 fix(bedrock): make passthrough guardrail string collection iterative and type-safe mateo-berri 2026-06-12 07:50:35 +00:00
  • ff5c320127 chore(translation): take critic-integration's cheap NITs (N1, N2, N4, N6) mateo-berri 2026-06-12 07:50:09 +00:00
  • d8a1656e8b fix(bedrock): scan non-text converse blocks for passthrough guardrails mateo-berri 2026-06-12 07:30:31 +00:00
  • f799dee7ed docs(dashboard): sync OpenAPI schema for /v1/model/info query params Sameer Kankute 2026-06-12 12:53:04 +05:30
  • dfbab84f48 fix(proxy): populate access_via_team_ids on /v1/model/info Sameer Kankute 2026-06-12 12:31:47 +05:30
  • 725f5a8503 docs(translation): regenerate the differential report on the final tree; CLAUDE.md seam section reflects the unified forks mateo-berri 2026-06-12 07:08:05 +00:00
  • 96c2a14264 fix(translation): silence the pre-existing mypy arg-type on the rebuilt Choices mateo-berri 2026-06-12 07:06:44 +00:00
  • 8acfb9610a test(http_handler): drop httpbin dependence from per-request timeout test litellm_fix_mcp_rest_server_id_auth mateo-berri 2026-06-12 07:04:21 +00:00
  • 495f9bff1f fix(responses): mask reasoning summary PII in WebSocket output path litellm_responses-websocket-presidio-guardrails mateo-berri 2026-06-12 07:02:31 +00:00
  • db99d00be5 chore(translation): batch the cheap critic NITs mateo-berri 2026-06-12 06:59:52 +00:00
  • 379c53fa17 refactor(translation): one _raw_openai_body and one engine send for the seam forks (standing item + critic-google M2 send half) mateo-berri 2026-06-12 06:56:07 +00:00
  • 5aab7f5b9d fix(proxy): keep non-bedrock passthrough streams streaming under post-call guardrails mateo-berri 2026-06-12 06:52:36 +00:00
  • 5262393d92 fix(translation): google seam effects, typing, and route() (critic-google M1, M2-route, M3, M4, M6, M8 + N3) mateo-berri 2026-06-12 06:52:34 +00:00
  • 87ceb3486b fix(proxy): close guardrail bypass on bedrock invoke passthrough routes mateo-berri 2026-06-12 06:50:46 +00:00
  • 1fd8ab4c5f fix(docker): copy only runtime artifacts into the final image (#30243) litellm_internal_staging yuneng-jiang 2026-06-11 23:46:23 -07:00
  • 162340359a perf(mcp): skip registry prefix scan for separator-free REST tool names mateo-berri 2026-06-12 06:43:42 +00:00
  • 846e34fbbd fix(responses): mask function_call_output.output in WebSocket PII path mateo-berri 2026-06-12 06:40:59 +00:00
  • 02f5374262 fix(responses): suppress reasoning_summary_text.done under output PII masking mateo-berri 2026-06-12 06:40:18 +00:00
  • 3445d16b6c fix(proxy): mention caller-supplied credentials in anthropic passthrough 401 message litellm_anthropic_passthrough_missing_creds_error mateo-berri 2026-06-12 06:38:31 +00:00
  • b7df649d5a fix(mcp): allow hyphenated upstream tool names when REST server_id is authoritative mateo-berri 2026-06-12 06:37:06 +00:00
  • dec71baf21 fix(translation): unwired azure api_version is a typed fallback, not passthrough (critic-azure M2) mateo-berri 2026-06-12 06:36:57 +00:00
  • 424a610ba3 perf(mcp): scan registry prefixes only when server_id is supplied mateo-berri 2026-06-12 06:35:03 +00:00
  • 76eab27c1d fix(translation): split BlockDialect out of ChunkDialect; dialect/event mismatches are loud (critic-azure M3, critic-google M5) mateo-berri 2026-06-12 06:34:23 +00:00
  • e23faa2e74 fix(otel): don't cache invalid filter on lazy callback_settings path litellm_fix_otel_metrics_cardinality Yassin Kortam 2026-06-11 23:33:58 -07:00
  • ad85fb0a24 refactor(proxy): route bedrock event-stream de-anonymization through llm passthrough dispatcher mateo-berri 2026-06-12 06:29:22 +00:00
  • 655804086a feat(translation): carry verbatim tool-argument bytes through the IR (critic-openai M5) mateo-berri 2026-06-12 06:29:20 +00:00
  • 1b6d8745e1 fix(translation): openai-dialect responses without a wire body error loudly (critic-openai M3) mateo-berri 2026-06-12 06:23:48 +00:00
  • 3f5491448e fix(translation): remove the _flush_user out-param mutation (critic-openai M2) mateo-berri 2026-06-12 06:21:42 +00:00
  • 6eb8c25e88 fix(translation): lenient post-send finish_reason boundary for openai_compat (critic-openai M1+M4) mateo-berri 2026-06-12 06:19:08 +00:00
  • 40b5135abb test(mcp): assert requested server credentials injected on cross-server REST routing mateo-berri 2026-06-12 06:17:43 +00:00
  • cd42eebbae fix(proxy): close guardrail bypass via tool result text and default-mode post-call guardrails on bedrock passthrough mateo-berri 2026-06-12 06:15:48 +00:00
  • 5eb9c805d1 fix(responses): mask instructions and tool-call arguments in WebSocket PII path mateo-berri 2026-06-12 06:14:15 +00:00
  • 00a9df8e97 fix(translation): azure family detection uses v1's truthiness base_model-or-model (critic-azure M1, verifier-azure S1) mateo-berri 2026-06-12 06:12:28 +00:00
  • dc639cd223 fix(translation): make the gemini cache-marker gate a sound token bound (critic-google B1) mateo-berri 2026-06-12 06:11:15 +00:00