Commit Graph
16801 Commits
Author SHA1 Message Date
Krrish Dholakia e445b78490 docs(configs.md): add global_max_parallel_requests to docs 2024-08-22 17:12:52 -07:00
Krrish Dholakia 735fc804ed fix(proxy_server.py): expose flag to disable retries when max parallel request limit is hit 2024-08-22 16:49:52 -07:00
Krrish Dholakia d7b525f391 feat(auth_checks.py): allow team to call all models, when explicitly set via /* 2024-08-22 16:38:56 -07:00
Krish DholakiaandGitHub 3cf009efbf Merge pull request #5325 from BerriAI/litellm_redis_cluster
feat(caching.py): redis cluster support
2024-08-22 16:13:45 -07:00
Krish DholakiaandGitHub 5b7fbc44be Merge pull request #5336 from micpst/docs-dbally
docs(projects): add dbally to sidebar
2024-08-22 15:49:16 -07:00
Michał Pstrąg a37f004c1d Merge branch 'main' into docs-dbally 2024-08-22 23:25:57 +02:00
Michał Pstrąg 62df7c755b add dbally project 2024-08-22 23:21:40 +02:00
Ishaan JaffandGitHub 8dbcdafe4b Merge pull request #5335 from BerriAI/litellm_add_metrics_latency
[Feat-Proxy] Prometheus Metrics to Track request latency, track llm api latency
2024-08-22 14:10:19 -07:00
Ishaan Jaff 57707b04b6 add prom docs for Request Latency Metrics 2024-08-22 14:06:14 -07:00
Ishaan Jaff 36b550b8db update promtheus metric names 2024-08-22 14:03:00 -07:00
Ishaan Jaff 06a362d35f track litellm_request_latency_metric 2024-08-22 13:58:10 -07:00
Ishaan Jaff e2cdb00a81 track api_call_start_time 2024-08-22 13:52:03 -07:00
Ishaan Jaff 65c0626aa4 fix init correct prometheus metrics 2024-08-22 13:29:35 -07:00
Krrish Dholakia a63c5c0020 docs(azure_ai.md): add azure ai jamba instruct to docs
Closes https://github.com/BerriAI/litellm/issues/5333
2024-08-22 11:34:52 -07:00
Krish DholakiaandGitHub 68cb5cae58 Merge branch 'main' into litellm_redis_cluster 2024-08-22 11:06:14 -07:00
Krrish Dholakia 98f73b35ba docs(utils.py): cleanup docstring 2024-08-22 11:05:25 -07:00
Krrish Dholakia 70bf8bd4f4 feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it
allows bedrock to be used with autogen
2024-08-22 11:03:33 -07:00
Krrish Dholakia 11bfc1dca7 fix(cohere_chat.py): support passing 'extra_headers'
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Ishaan JaffandGitHub 36c021b309 Merge pull request #5331 from BerriAI/dependabot/npm_and_yarn/litellm-js/spend-logs/hono-4.5.8
build(deps): bump hono from 4.2.7 to 4.5.8 in /litellm-js/spend-logs
2024-08-22 10:08:41 -07:00
Ishaan Jaff a120135dd1 fix allow setting LiteLLM license as .env v1.44.2 2024-08-22 10:05:00 -07:00
Krrish Dholakia f36e7e0754 fix(ollama_chat.py): fix passing assistant message with tool call param
Fixes https://github.com/BerriAI/litellm/issues/5319
2024-08-22 10:00:03 -07:00
Ishaan Jaff 4fe22ec493 fix test_vertexai_multimodal_embedding use magicMock requests 2024-08-22 09:56:24 -07:00
Ishaan Jaff cc8e6f1d44 fix allow setting license in config.yaml 2024-08-22 09:45:15 -07:00
dependabot[bot]andGitHub a3537afbdf build(deps): bump hono from 4.2.7 to 4.5.8 in /litellm-js/spend-logs
Bumps [hono](https://github.com/honojs/hono) from 4.2.7 to 4.5.8.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.2.7...v4.5.8)

---
updated-dependencies:
- dependency-name: hono
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-22 16:44:08 +00:00
Ishaan Jaff 2be984ebee add docstring for /embeddings and /completions 2024-08-22 09:30:47 -07:00
Ishaan Jaff f6e80b0031 add doc string for /chat/completions swagger 2024-08-22 09:27:40 -07:00
Krrish Dholakia 67eb58d9f8 test(test_custom_callback_input.py): skip flaky ci/cd test 2024-08-22 09:19:10 -07:00
Ishaan Jaff 374bef4326 fix /user/delete doc string 2024-08-22 09:09:51 -07:00
Krrish Dholakia cf4574dd65 test(test_custom_callback_input.py): fix test 2024-08-22 08:54:59 -07:00
Krrish Dholakia 25820680eb test: fix test 2024-08-21 22:30:41 -07:00
Krrish Dholakia c5e030481a fix: rerun ci/cd 2024-08-21 22:28:35 -07:00
Krrish Dholakia 4ebacbfafe docs(enterprise.md): add key/team level spend tags to docs 2024-08-21 22:10:18 -07:00
Krrish Dholakia 5a31005b85 test(test_function_calling.py): remove redundant gemini test (causing ratelimit errors) 2024-08-21 21:48:14 -07:00
Krrish Dholakia fd3a6f0870 test(test_image_generation.py): handle azure api error 2024-08-21 21:46:00 -07:00
Krrish Dholakia 6d6ab30ed7 test: test_function_calling.py 2024-08-21 21:12:15 -07:00
Ishaan Jaff 88e1ad6cbc docs vertex 2024-08-21 19:15:23 -07:00
Ishaan Jaff 03c65c889a fix team_member_add 2024-08-21 19:10:37 -07:00
Ishaan Jaff f0f1d50734 fix test_master_key_hashing 2024-08-21 17:56:09 -07:00
Ishaan Jaff 0ea1f367d7 use litellm proxy with vertex ai sdk 2024-08-21 17:47:01 -07:00
Krrish Dholakia f310ce541f docs(vertex.md): add vertex global safety settings to doc 2024-08-21 17:41:49 -07:00
Krrish Dholakia 3c99ad19fa feat(utils.py): support global vertex ai safety settings param 2024-08-21 17:37:50 -07:00
Ishaan Jaff 9078f075f9 docs add example using litellm with vertex python sdk 2024-08-21 17:35:34 -07:00
Ishaan JaffandGitHub 26f4cf8e1b Merge pull request #5327 from BerriAI/litellm_pass_through_vtx_multi_modal
[Feat-Proxy] Make LiteLLM Proxy (Gateway) compatible with VertexAI SDK 🔥
2024-08-21 17:25:23 -07:00
Ishaan JaffandGitHub a174cbdd72 Merge branch 'main' into litellm_pass_through_vtx_multi_modal 2024-08-21 17:23:22 -07:00
Ishaan Jaff bcc0f99476 fix pass through endpoints 2024-08-21 17:21:22 -07:00
Krrish Dholakia 5e707091ee test(test_amazing_vertex_completion.py): handle vertex api instability 2024-08-21 17:09:17 -07:00
Ishaan Jaff 0e1d3804ff refactor vertex endpoints to pass through all routes 2024-08-21 17:08:42 -07:00
Ishaan JaffandGitHub dd524a4f50 Merge pull request #5326 from BerriAI/litellm_Add_vertex_multimodal_embedding
[Feat] add vertex multimodal embedding support
2024-08-21 17:06:43 -07:00
Ishaan Jaff f947cec7fc add test vtx embedding 2024-08-21 17:05:47 -07:00
Krrish Dholakia 3dc75dabd6 docs(logging.md): add standard logging payload to docs 2024-08-21 17:04:57 -07:00