Commit Graph
10876 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 1b35a75245 Merge pull request #3430 from BerriAI/litellm_return_api_base
feat(proxy_server.py): return api base in response headers
2024-05-03 16:25:21 -07:00
Ishaan JaffandGitHub 5333474a6f Merge pull request #3431 from BerriAI/litellm_simplify_docs_prod
docs - simplify best practices for prod
2024-05-03 15:56:03 -07:00
Ishaan Jaff 209baaca02 docs - simplify prod docs 2024-05-03 15:40:05 -07:00
Krrish Dholakia 5b39f8e282 feat(proxy_server.py): return api base in response headers
Closes https://github.com/BerriAI/litellm/issues/2631
2024-05-03 15:27:32 -07:00
Ishaan JaffandGitHub e99edaf4e1 Merge pull request #3426 from BerriAI/litellm_set_db_exceptions_on_ui
UI - set DB Exceptions webhook_url on UI
2024-05-03 14:05:37 -07:00
Ishaan Jaff 776f541f6c fix bug where slack would get inserting several times 2024-05-03 14:04:38 -07:00
Ishaan Jaff fdc9856652 UI - set DB Exceptions webhook_url 2024-05-03 13:33:43 -07:00
Ishaan JaffandGitHub 34bf0b37f5 Merge pull request #3423 from BerriAI/litellm_test_callbacks_proxy
[Test] Assert num Callbacks on Proxy don't increase
2024-05-03 12:44:56 -07:00
Krrish Dholakia b2a0502383 bump: version 1.35.36 → 1.35.37 v1.35.37 2024-05-03 12:42:20 -07:00
Krrish Dholakia defc205348 test(test_alangfuse.py): fix test 2024-05-03 12:39:38 -07:00
Krish DholakiaandGitHub cb1872d7cb Merge pull request #3422 from BerriAI/litellm_lowest_latency_fix
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
v1.35.36-dev2
2024-05-03 10:14:50 -07:00
Krrish Dholakia 2dd9d2f704 test(test_amazing_vertex_completion.py): try-except api errors 2024-05-03 10:09:57 -07:00
Ishaan Jaff 9ba5685722 test active callbacks on proxy 2024-05-03 10:05:06 -07:00
Ishaan Jaff fe6e465466 test - num callbacks on proxy should not increase 2024-05-03 09:59:59 -07:00
Ishaan JaffandGitHub c6a9b460cd Merge pull request #3419 from BerriAI/litellm_fix_lowest_latency_router
[Fix] Ensure callbacks are not added to router when `store_model_in_db=True`
2024-05-03 09:28:35 -07:00
Ishaan Jaff 23d334fe60 proxy - return num callbacks on /health/readiness 2024-05-03 09:14:32 -07:00
Ishaan Jaff a1814a3e4c test - num callbacks on proxy 2024-05-03 09:13:37 -07:00
Krrish Dholakia 0b72904608 fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified) 1.35.36 2024-05-03 09:00:32 -07:00
Ishaan Jaff 540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
Krrish Dholakia 91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 1.35.36.dev1 2024-05-02 17:53:09 -07:00
Krrish Dholakia fdc4fdb91a fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Krrish Dholakia 5baeeec899 fix(openmeter.py): fix get from env 2024-05-02 16:34:22 -07:00
Krish DholakiaandGitHub 2200900ca2 Merge pull request #3393 from Priva28/main
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan JaffandGitHub 0b27f5b3dc Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts
fix - revert init langfuse client on slack alerts
2024-05-02 16:09:23 -07:00
Ishaan Jaff 9edf463c3b fix - revert init langfuse client on slack alerts 2024-05-02 16:02:52 -07:00
Ishaan JaffandGitHub f893f8bc55 Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors
Disambiguate invalid model name errors
2024-05-02 15:09:59 -07:00
Krish DholakiaandGitHub 9e56472a81 Merge pull request #3406 from msabramo/test_proxy_server_mock_improvements
Improve mocking in `test_proxy_server.py`
2024-05-02 15:05:09 -07:00
Marc Abramowitz 6d154e2317 Update tests to reflect new error messages 2024-05-02 15:02:58 -07:00
Marc Abramowitz 988c37fda3 Disambiguate invalid model name errors
because that error can be thrown in several different places, so
knowing the function it's being thrown from can be very useul for debugging.
2024-05-02 15:02:54 -07:00
Krrish Dholakia acda064be6 fix(proxy/utils.py): fix retry logic for generic data request v1.35.36 2024-05-02 14:50:50 -07:00
Krish DholakiaandGitHub e26b39822c Merge pull request #3405 from azohra/patch-1
Vision for Claude 3 Family + Info for Azure/GPT-4-0409
2024-05-02 13:42:01 -07:00
Marc Abramowitz 14e7c9b01c Improve mocking in test_proxy_server
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 13:36:23 -07:00
Justin WattsandGitHub 77098e31e4 Update model_prices_and_context_window.json 2024-05-02 13:21:36 -07:00
Justin WattsandGitHub 39670cd84a Add Vision Support for Claude 3 Family
modified the model info table to add "supports_vision": true, for the claude 3 family (haiku, sonnet, and opus)
2024-05-02 13:09:17 -07:00
Krish DholakiaandGitHub 762a1fbd50 Merge pull request #3375 from msabramo/GH-3372
Fix route `/openai/deployments/{model}/chat/completions` not working properly
2024-05-02 13:00:25 -07:00
Marc Abramowitz a79fd772f4 Simplify mock_patch_acompletion 2024-05-02 12:47:27 -07:00
Marc Abramowitz 6ec058711a Make unnecessary to pass extra arg for mock object
Modify `mock_patch_acompletion` to be a context manager instead of a
function that returns a mock object. This way, the mock object is
created and yielded by the context manager, and the test function
doesn't need to pass the mock object as an argument.
2024-05-02 12:41:30 -07:00
Marc Abramowitz 4dfadb0cf4 mock_patch_acompletion in test_proxy_server.py 2024-05-02 12:24:49 -07:00
Ishaan JaffandGitHub 7ffe410097 Merge pull request #3392 from BerriAI/litellm_fix_langfuse_reinitalized
[Fix] bug where langfuse was reinitialized on every call
v1.35.35.dev1
2024-05-02 10:54:47 -07:00
Marc Abramowitz 152b5c8ceb Add test_openai_deployments_model_chat_completions_azure 2024-05-02 10:27:32 -07:00
Ishaan JaffandGitHub e16ca10ea5 Merge pull request #3278 from greenscale-ai/main
Fix Greenscale Documentation
2024-05-02 08:26:12 -07:00
greenscale-nandeshandGitHub 6009632705 Merge branch 'main' into main 2024-05-02 08:22:11 -07:00
Krrish Dholakia 18cb0bc530 fix(utils.py): revert pydantic object changes 2024-05-02 08:14:45 -07:00
Krrish Dholakia 16522a5351 fix(utils.py): add missing providers + models to validate_environment
Closes https://github.com/BerriAI/litellm/issues/3190
2024-05-02 08:14:45 -07:00
Ishaan JaffandGitHub c8ceab872f Merge pull request #2967 from BerriAI/dependabot/pip/idna-3.7
build(deps): bump idna from 3.6 to 3.7
2024-05-02 07:43:38 -07:00
Ishaan JaffandGitHub 55de1c1c76 Merge pull request #3169 from BerriAI/dependabot/npm_and_yarn/litellm-js/spend-logs/hono/node-server-1.10.1
build(deps): bump @hono/node-server from 1.9.0 to 1.10.1 in /litellm-js/spend-logs
2024-05-02 07:43:01 -07:00
Ishaan JaffandGitHub ee8d0b6d5f Merge pull request #3217 from DomMartin27/litellm_readme
Update contributing instructions in README.md
2024-05-02 07:42:44 -07:00
Ishaan JaffandGitHub 08518240a2 Merge pull request #3349 from nobu007/add_pull_request_template
docs: add .github/pull_request_template.md
2024-05-02 07:39:35 -07:00
Krrish Dholakia caf19478af fix(utils.py): fix pydantic object default values 2024-05-01 22:51:46 -07:00
Christian Privitelli 2d43153efa include methods in init import, add test, fix encode/decode param ordering 2024-05-02 15:49:22 +10:00