Commit Graph
11302 Commits
Author SHA1 Message Date
Krrish Dholakia 7eaddaef10 refactor(proxy_server.py): re-add custom db client logic - prevent regressions 2024-03-18 21:16:28 -07:00
VincelwtandGitHub 1cbfd312fe Merge branch 'main' into main 2024-03-19 12:50:04 +09:00
Ishaan Jaff a524918140 (fix) test load config proxy with redis 2024-03-18 20:42:41 -07:00
Krrish Dholakia 0b39bc141b test(test_update_spend.py): fix test 2024-03-18 20:38:21 -07:00
Ishaan JaffandGitHub ef39b1bc43 Merge pull request #2581 from BerriAI/litellm_ui_show_global_spend
[FIX] UI show global spend - when proxy budget not set
2024-03-18 20:34:30 -07:00
Ishaan Jaff a3397dd6c5 (feat) update ui build 2024-03-18 20:32:28 -07:00
Ishaan Jaff 51d658e878 (fix) if litellm-proxy-budget set use it 2024-03-18 20:31:23 -07:00
Krrish Dholakia f588bff69b fix(proxy_server.py): fix spend log update 2024-03-18 20:26:28 -07:00
Krish DholakiaandGitHub c669943292 Merge pull request #2577 from BerriAI/litellm_vertex_ai_streaming_func_call
feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming
2024-03-18 20:10:00 -07:00
Krish DholakiaandGitHub 5edb703d78 Merge pull request #1527 from TheDiscoMole/litellm_non_openai_tool_call_prompt
improving non-openai tool_call prompt
2024-03-18 18:29:42 -07:00
Krish DholakiaandGitHub 59a4e1bfb6 Merge branch 'main' into litellm_non_openai_tool_call_prompt 2024-03-18 18:29:36 -07:00
Ishaan Jaff 3d890ff396 (ui) show spend when budget not set 2024-03-18 18:28:30 -07:00
Ishaan Jaff a8473042d1 (ui) show users their spend when max budget not set 2024-03-18 18:28:13 -07:00
Krish DholakiaandGitHub 0ca619dc5d Merge pull request #2548 from zdsfwy/main
fix bug: custom prompt templates registered are never applied to vllm provider
2024-03-18 18:19:45 -07:00
Ishaan Jaff 87dd3f1235 (fix) show global spend on UI 2024-03-18 18:15:08 -07:00
Ishaan Jaff be6fb579df bump: version 1.32.2 → 1.32.3 2024-03-18 17:14:04 -07:00
Ishaan Jaff faddf5d351 bump: version 1.32.1 → 1.32.2 2024-03-18 17:14:01 -07:00
Ishaan JaffandGitHub 436de920e4 Merge pull request #2579 from BerriAI/litellm_datadog_docs
[Docs] datadog docs + LiteLLM Proxy
2024-03-18 17:12:52 -07:00
Ishaan JaffandGitHub bb54d692ec Merge pull request #2578 from BerriAI/litellm_datadog_int
[FEAT] DataDog Logging Provider
2024-03-18 17:10:59 -07:00
Ishaan Jaff 038c9d5781 (docs) litellm + datadog 2024-03-18 17:06:00 -07:00
Krrish Dholakia 8fefe625d9 fix(proxy/utils.py): batch writing updates to db 2024-03-18 16:47:02 -07:00
Ishaan Jaff 0dab5841cd (fix) proxy extra spacing 2024-03-18 16:43:04 -07:00
Ishaan Jaff fedb4e5703 (fix) clean dd imports 2024-03-18 16:40:58 -07:00
Ishaan Jaff 17295286d3 (cleanup) extra line 2024-03-18 16:40:01 -07:00
Ishaan Jaff 325eb35b44 (cleanup) proxy 2024-03-18 16:31:16 -07:00
Ishaan Jaff 2bce2ee7e3 (fix) log to datadog 2024-03-18 16:27:55 -07:00
Ishaan Jaff 2afddf4536 (feat) init datadog logger 2024-03-18 16:27:01 -07:00
Ishaan Jaff 6a7c86fc58 (test) dd test 2024-03-18 16:22:59 -07:00
Ishaan Jaff ac826851fa (feat) v0 datadog logger 2024-03-18 16:01:47 -07:00
Krrish Dholakia 5ad790ffdf test: fix test 2024-03-18 13:43:14 -07:00
Krrish Dholakia f0434350f1 fix(proxy_server.py): don't override cache params on proxy config if set 2024-03-18 12:11:30 -07:00
Krrish Dholakia f49dc9a99f feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming 2024-03-18 11:47:27 -07:00
Krish DholakiaandGitHub ebf17d99e5 Merge pull request #2570 from garfeildma/main
Support multiple system message tranlation for bedrock claude-3
2024-03-18 11:18:02 -07:00
Krrish Dholakia 8619499853 fix(proxy_server.py): ignore cache if value is false 2024-03-18 11:15:32 -07:00
Ishaan Jaff a1b004900b (feat) add datadog integration 2024-03-18 10:55:29 -07:00
Krish DholakiaandGitHub 6d7739aa6d Merge pull request #2573 from BerriAI/litellm_fix_redis_dynamic_args
fix(caching.py): pass redis kwargs to connection pool init
2024-03-18 08:53:26 -07:00
Krrish Dholakia 03acc07380 fix(caching.py): pass redis kwargs to connection pool init 2024-03-18 08:21:36 -07:00
Ishaan Jaff 4a4c322278 (docs) easily find call hooks 2024-03-18 07:38:29 -07:00
garfeildma 45d31e33aa support multiple system message tranlation for bedrock claude-3 2024-03-18 19:41:15 +08:00
Ikko Eltociear AshimineandGitHub 0b561764b0 Update proxy_server.py
intialize -> initialize
2024-03-18 01:28:12 +09:00
Dragos Campean f3c0b530b8 Add mistral medium latest to model prices 2024-03-17 16:01:40 +02:00
Bincheng Li e605b04927 fix bug: custom prompt templates registered are never applied to vllm provider 2024-03-17 15:21:14 +08:00
Krrish Dholakia 077b9c6234 fix(proxy/utils.py): move to batch writing db updates 2024-03-16 22:32:00 -07:00
Ishaan Jaff 6eac5c4f0a bump: version 1.32.0 → 1.32.1 v1.32.1 2024-03-16 19:39:38 -07:00
Ishaan Jaff 3636bfdf59 bump: version 1.31.17 → 1.31.18 2024-03-16 19:39:09 -07:00
Ishaan JaffandGitHub 4e33aac997 Merge pull request #2560 from BerriAI/litellm_view_team_based_spend
Admin UI - view team based spend
2024-03-16 19:38:17 -07:00
Ishaan Jaff 0d349d389a (feat) new ui build 2024-03-16 19:35:00 -07:00
Ishaan Jaff 7bbb3aa40a (feat) new ui build 2024-03-16 19:23:29 -07:00
Krish DholakiaandGitHub 055519394a Merge pull request #2460 from webkonstantin/langfuse-include-tools-in-prompt
Add functions and tools to input for langfuse
2024-03-16 19:13:24 -07:00
Ishaan Jaff 902337e28a (feat) view team based spend 2024-03-16 19:06:16 -07:00