Commit Graph
18932 Commits
Author SHA1 Message Date
Ishaan Jaff ae3d8feb50 bump: version 1.57.1 → 1.57.2 2025-01-06 21:48:25 -08:00
Ishaan JaffandGitHub 2ca0977921 aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598)
* fixes for get_complete_url

* update aiohttp tests

* fix event loop for aiohtto

* ci/cd run again

* test_aiohttp_openai
2025-01-06 21:39:11 -08:00
Ishaan Jaff 744beac754 ci/cd run again 2025-01-06 21:35:34 -08:00
Krish DholakiaandGitHub fef7839e8a Litellm dev 01 06 2025 p1 (#7594)
* fix(custom_logger.py): expose new 'async_get_chat_completion_prompt' event hook

* fix(custom_logger.py): langfuse_prompt_management.py

remove 'headers' from custom logger 'async_get_chat_completion_prompt' and 'get_chat_completion_prompt' event hooks

* feat(router.py): expose new function for prompt management based routing

* feat(router.py): partial working router prompt factory logic

allows load balanced model to be used for model name w/ langfuse prompt management call

* feat(router.py): fix prompt management with load balanced model group

* feat(langfuse_prompt_management.py): support reading in openai params from langfuse

enables user to define optional params on langfuse vs. client code

* test(test_Router.py): add unit test for router based langfuse prompt management

* fix: fix linting errors
2025-01-06 21:26:21 -08:00
Krrish Dholakia 7133cf5b74 bump: version 1.57.0 → 1.57.1 v1.57.1 2025-01-06 21:13:56 -08:00
Krrish Dholakia 16f13dd55c docs(prompt_management.md): update docs to show how to point to load balanced model name 2025-01-06 21:09:09 -08:00
Krish DholakiaandGitHub 0c3fef24cd Litellm dev 01 06 2025 p2 (#7597)
* test(test_amazing_vertex_completion.py): fix test

* test: initial working code gecko test

* fix(vertex_ai_non_gemini.py): support vertex ai code gecko fake streaming

Fixes https://github.com/BerriAI/litellm/issues/7360

* test(test_get_model_info.py): add test for getting custom provider model info

Covers https://github.com/BerriAI/litellm/issues/7575

* fix(utils.py): fix get_provider_model_info check

Handle custom llm provider scenario

Fixes https://github.com/
BerriAI/litellm/issues/7575
2025-01-06 21:04:49 -08:00
Krish DholakiaandGitHub b397dc1497 Litellm dev 01 06 2025 p3 (#7596)
* build(model_prices_and_context_window.json): add gemini-1.5-pro 'supports_vision' = true

Fixes https://github.com/BerriAI/litellm/issues/7592

* build(model_prices_and_context_window.json): add new mistral models pricing + model info
2025-01-06 20:44:04 -08:00
fzowlandGitHub c22d9208da Refresh VoyageAI models, prices and context (#7472)
* Refresh VoyageAI models and prices and context

* Refresh VoyageAI models and prices and context

* Refresh VoyageAI models and prices and context
2025-01-06 20:38:01 -08:00
Ishaan JaffandGitHub 819079f23b (proxy perf improvement) - remove redundant .copy() operation (#7564)
* latency fix proxy

* remove useless copy in add_key_level_controls
2025-01-06 20:36:47 -08:00
Ishaan JaffandGitHub 6125ba1e2b (Feat) - allow including dd-trace in litellm base image (#7587)
* introduce USE_DDTRACE=true

* update dd tracer

* update

* bump dd trace

* use og slim image

* DD tracing

* fix _init_dd_tracer
2025-01-06 17:27:09 -08:00
Ishaan JaffandGitHub 0b5c1392f7 fix _return_user_api_key_auth_obj (#7591) 2025-01-06 16:43:14 -08:00
Ishaan JaffandGitHub 61d67cfa43 (perf) - fixes for aiohttp handler to hit 1K RPS (#7590)
* fix getting aiohttp sesson

* fix _get_async_client_session
2025-01-06 15:41:39 -08:00
Krrish Dholakia 23685e93f3 test: skip tests pending vertex credentials v1.57.0 2025-01-05 15:29:51 -08:00
Ishaan Jaff a40baec5ed use latest bucket for testing 2025-01-05 14:55:48 -08:00
Krrish Dholakia 8ae2ca4ed9 test: fix test 2025-01-05 14:52:38 -08:00
Krrish Dholakia 8bda3006fa fix: test 2025-01-05 14:37:17 -08:00
Krrish Dholakia 32538f09fc test: cleanup test 2025-01-05 14:18:29 -08:00
Ishaan Jaff 3110bb0723 use pathrise-convert-1606954137718 2025-01-05 14:14:43 -08:00
Ishaan Jaff 616211daee ci/cd run again 2025-01-05 14:11:27 -08:00
Ishaan Jaff 137879ffea vertex testing use pathrise-convert-1606954137718 2025-01-05 14:00:17 -08:00
Krrish Dholakia c0e4485fe0 test: update test amazing vertex 2025-01-05 13:56:31 -08:00
Ishaan Jaff ef8812d150 ci/cd update vertex acct 2025-01-05 13:43:32 -08:00
Low Jian ShengandGitHub 9cfd7c790a Prevent istio injection for db migrations cron job (#7513)
* allow option to prevent istio injection

* make annotations more generic

* make annotations empty

* revert comment deletions
2025-01-04 22:45:19 -08:00
minpeterandGitHub f7931b659b FriendliAI: Documentation Updates (#7517)
* docs(friendliai.md): update FriendliAI documentation and model details

* docs(friendliai.md): remove unused imports for cleaner documentation

* feat: add support for parallel function calling, system messages, and response schema in model configuration
2025-01-04 22:44:24 -08:00
Fredy ÁlvarezandGitHub 2b0738ecc4 add fireworks_ai/accounts/fireworks/models/deepseek-v3 (#7567) 2025-01-04 22:43:09 -08:00
Ishaan JaffandGitHub 2bf20ebfdf latency fix proxy (#7563) 2025-01-04 20:18:32 -08:00
Krrish Dholakia 0d366c58a1 build(ui/): build new ui 2025-01-04 20:03:57 -08:00
Krrish Dholakia 62dd72a705 bump: version 1.56.10 → 1.57.0 2025-01-04 19:45:16 -08:00
Krish DholakiaandGitHub 34a9833b85 Support deleting keys by key_alias (#7552)
* feat(key_management_endpoints.py): allow deleting keys based on key alias

easier for proxy admin to delete known bad key

* fix(key_management_event_hooks.py): fix linting error

* docs(key_management_endpoints.py): document new key_aliases param

* fix(key_management_endpoints.py): return deleted keys to user

fixes return when passing key aliases
2025-01-04 19:41:48 -08:00
Krish DholakiaandGitHub ce97e7e054 fix(groq/chat/transformation.py): fix groq response_format transformation (#7565)
Fixes https://github.com/BerriAI/litellm/issues/4804
2025-01-04 19:39:04 -08:00
Ishaan JaffandGitHub d74fa39454 fix [PROXY] returned data from litellm_pre_call_util (#7558) 2025-01-04 18:47:36 -08:00
Krish DholakiaandGitHub f1540ceeab Create and view organizations + assign org admins on the Proxy UI (#7557)
* feat: initial commit for new 'organizations' tab on ui

* build(ui/): create generic card for rendering complete org data table

can be reused in teams as well

simplifies things

* build(ui/): display created orgs on ui

* build(ui/): support adding orgs via UI

* build(ui/): add org in selection dropdown

* build(organizations.tsx): allow assigning org admins

* build(ui/): show org members on ui

* build(ui/): cleanup + show actual models on org dropdown

* build(ui/): explain user roles within organization
2025-01-04 17:31:24 -08:00
Ishaan JaffandGitHub 46d9d29bff (Feat) Hashicorp Secret Manager - Allow storing virtual keys in secret manager (#7549)
* use a base abstract class

* async_write_secret for hcorp

* fix hcorp

* async_write_secret for hashicopr secret manager

* store virtual keys in hcorp

* add delete secret

* test_hashicorp_secret_manager_write_secret

* test_hashicorp_secret_manager_delete_secret

* docs Supported Secret Managers

* docs storing keys in hcorp

* docs hcorp

* docs secret managers

* test_key_generate_with_secret_manager_call

* fix unused imports
2025-01-04 11:35:59 -08:00
Ishaan JaffandGitHub 7f7222ce30 fix get_custom_logger_compatible_class (#7554) 2025-01-04 11:22:09 -08:00
Ishaan JaffandGitHub e804a1850e add cohere/command-r7b-12-2024 (#7553) v1.56.10 2025-01-04 11:21:04 -08:00
Ishaan JaffandGitHub d1b101b9d7 (Fix) - Slack Alerting , don't send duplicate spend report when used on multi instance settings (#7546)
* fix send_weekly_spend_report

* test_spend_report_cache
2025-01-04 10:54:35 -08:00
Ishaan JaffandGitHub 06eea38c69 (Fix) - Docker build error with pyproject.toml (#7550)
* fix pyproject

* fix homepage
2025-01-04 10:50:24 -08:00
Krrish Dholakia 3230c902c9 bump: version 1.56.9 → 1.56.10 2025-01-03 19:36:14 -08:00
Krish DholakiaandGitHub d43d83f9ef feat(router.py): support request prioritization for text completion c… (#7540)
* feat(router.py): support request prioritization for text completion calls

* fix(internal_user_endpoints.py): fix sql query to return all keys, including null team id keys on `/user/info`

Fixes https://github.com/BerriAI/litellm/issues/7485

* fix: fix linting errors

* fix: fix linting error

* test(test_router_helper_utils.py): add direct test for '_schedule_factory'

Fixes code qa test
2025-01-03 19:35:44 -08:00
Krish DholakiaandGitHub f770dd0c95 Support checking provider-specific /models endpoints for available models based on key (#7538)
* test(test_utils.py): initial test for valid models

Addresses https://github.com/BerriAI/litellm/issues/7525

* fix: test

* feat(fireworks_ai/transformation.py): support retrieving valid models from fireworks ai endpoint

* refactor(fireworks_ai/): support checking model info on `/v1/models` route

* docs(set_keys.md): update docs to clarify check llm provider api usage

* fix(watsonx/common_utils.py): support 'WATSONX_ZENAPIKEY' for iam auth

* fix(watsonx): read in watsonx token from env var

* fix: fix linting errors

* fix(utils.py): fix provider config check

* style: cleanup unused imports
2025-01-03 19:29:59 -08:00
Krish DholakiaandGitHub cac06a32b8 fix(aws_secret_manager_V2.py): Error reading secret from AWS Secrets Manager: (#7541) 2025-01-03 18:22:12 -08:00
Ishaan Jaff 8ad9526625 bump: version 1.56.8 → 1.56.9 v1.56.9 2025-01-03 17:49:23 -08:00
Ishaan JaffandGitHub 716efd5fad (fix proxy perf) use _read_request_body instead of ast.literal_eval to get better performance (#7545)
* fix ast literal eval

* run ci/cd again
2025-01-03 17:48:32 -08:00
Ishaan JaffandGitHub 1bb4941036 [Feature]: - allow print alert log to console (#7534)
* update send_to_webhook

* test_print_alerting_payload_warning

* add alerting_args spec

* test_alerting.py
2025-01-03 17:48:13 -08:00
Krish DholakiaandGitHub 6843f3a2bb Revert "fix: add missing parameters order, limit, before, and after in get_as…" (#7542)
This reverts commit 4b0505dffd.
2025-01-03 16:32:12 -08:00
Ishaan Jaff c8f9e2afab fix _make_common_async_call 2025-01-03 15:15:38 -08:00
Ishaan Jaff 23104d9a14 test_aiohttp_openai 2025-01-03 15:12:56 -08:00
Ishaan JaffandGitHub 02875d4ae8 (fix) aiohttp_openai/ route - get to 1K RPS on single instance (#7539)
* ClientSession

* re use client_session

* _init_client_session

* fix aiohttp
2025-01-03 15:12:17 -08:00
மனோஜ்குமார் பழனிச்சாமிandGitHub 4c6a1e6c9c Add missing prefix for deepseek (#7508)
Solves https://github.com/All-Hands-AI/OpenHands/issues/5978
2025-01-03 14:42:18 -08:00