tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-16 14:23:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
15,169 Commits 2,072 Branches 1,425 Tags
7d68536763317cf4b8c4e89df2ff081d03cfd0cb
Commit Graph
15169 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan JaffandKrrish Dholakia 7d68536763 docs - add info about routing strategy on load balancing docs 2024-07-25 19:35:48 -07:00
Ishaan JaffandKrrish Dholakia fe3c57e1c1 feat support audio health checks for azure 2024-07-25 19:35:48 -07:00
Ishaan JaffandKrrish Dholakia 5ff0e47f22 docs add example on using text to speech models 2024-07-25 19:35:48 -07:00
Ishaan JaffandKrrish Dholakia 1a89f9e86d feat - support health check audio_speech 2024-07-25 19:35:48 -07:00
Ishaan JaffandKrrish Dholakia 734d0c3643 fix whisper health check with litellm 2024-07-25 19:35:48 -07:00
Krrish Dholakia c23cf1ecc5 fix(router.py): add support for diskcache to router 2024-07-25 19:35:48 -07:00
Krrish Dholakia a5ecf6b1c1 fix(proxy_server.py): check if input list > 0 before indexing into it 
resolves 'list index out of range' error
 2024-07-25 19:35:48 -07:00
David ManouchehriandKrrish Dholakia fb1a805959 Check for converse support first. 2024-07-25 19:35:40 -07:00
David ManouchehriandKrrish Dholakia 2dd30d59ae Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 19:35:40 -07:00
David ManouchehriandKrrish Dholakia 35776d7e73 Add Llama 3.1 405b for Bedrock 2024-07-25 19:35:40 -07:00
Krrish Dholakia 52648ebac6 docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia 24ff9882ee docs(enterprise.md): cleanup docs 2024-07-25 19:35:40 -07:00
Krrish Dholakia 9ec34313b0 docs(caching.md): update caching docs to include ttl info 2024-07-25 19:35:40 -07:00
Krrish Dholakia 86973d6aca fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 19:35:40 -07:00
Krrish Dholakia 9955b1b486 fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-25 19:35:29 -07:00
Ishaan JaffandKrrish Dholakia 993920ca6c docs add mistral api large 2 2024-07-25 19:35:29 -07:00
Ishaan JaffandKrrish Dholakia 53075030ff feat - add mistral large 2 2024-07-25 19:35:29 -07:00
Ishaan JaffandKrrish Dholakia bb44d69152 bump: version 1.42.0 → 1.42.1 2024-07-25 19:35:29 -07:00
Ishaan JaffandKrrish Dholakia 910597fcfa docs groq models 2024-07-25 19:35:29 -07:00
Ishaan JaffandKrrish Dholakia 6579095124 feat - add groq/llama-3.1 2024-07-25 19:35:29 -07:00
Krrish Dholakia 11cdb79fc0 test: cleanup testing 2024-07-25 19:35:29 -07:00
Krrish Dholakia 2c71f6dd04 feat(auth_check.py): support using redis cache for team objects 
Allows team update / check logic to work across instances instantly
 2024-07-25 19:35:29 -07:00
Krish DholakiaandGitHub e6963217ba Merge branch 'main' into litellm_parallel_requests 2024-07-24 19:25:56 -07:00
Krish DholakiaandGitHub 0ac7736b1f Merge pull request #4638 from friendliai/feat/friendli-dedicated-endpoint 
feat: add support for friendliai dedicated endpoint
 2024-07-24 19:23:15 -07:00
wslee 40bb165108 support dynamic api base 2024-07-25 11:14:38 +09:00
wslee dd10da4d46 add support for friendli dedicated endpoint 2024-07-25 11:14:35 +09:00
Krrish Dholakia f35af3bf1c test(test_completion.py): update azure extra headers 2024-07-24 18:42:50 -07:00
Ishaan JaffandGitHub b93b2636a9 Update README.md 2024-07-24 16:51:40 -07:00
Krrish Dholakia b5c5ed2209 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Ishaan JaffandGitHub dc3b39ca71 Merge pull request #4864 from BerriAI/docs_add_using_groq_with_proxy 
doc example using litellm proxy with groq
 2024-07-24 14:34:12 -07:00
Ishaan Jaff fe0b0ddaaa doc example using litellm proxy with groq 2024-07-24 14:33:49 -07:00
Ishaan JaffandGitHub 53dd47c5cb Merge pull request #4862 from BerriAI/litellm_fix_unsupported_params_Error 
[Fix-litellm python] Raise correct error for UnsupportedParams Error
 2024-07-24 14:26:25 -07:00
Krrish Dholakia 65705fde25 test(test_embedding.py): add simple azure embedding ad token test 
Addresses https://github.com/BerriAI/litellm/issues/4859#issuecomment-2248838617
 2024-07-24 13:38:03 -07:00
Krrish Dholakia 77ffee4e2e test(test_completion.py): add basic test to confirm azure ad token flow works as expected 2024-07-24 13:07:25 -07:00
Krrish Dholakia 99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Ishaan Jaff 30c27b3f92 test UnsupportedParamsError 2024-07-24 12:21:22 -07:00
Ishaan Jaff 8ea4b73c27 add UnsupportedParamsError to litellm exceptions 2024-07-24 12:20:14 -07:00
Ishaan Jaff 11512c057d feat use UnsupportedParamsError as litellm error type 2024-07-24 12:19:10 -07:00
Krrish Dholakia d9539e518e build(docker-compose.yml): add prometheus scraper to docker compose 
persists prometheus data across restarts
v1.42.0-stable 		2024-07-24 10:09:23 -07:00
Ishaan JaffandGitHub ac7f6598f3 Merge pull request #4853 from BerriAI/litellm_support_tags 
[Feat] - Support Logging tags on langsmith
 2024-07-24 09:51:56 -07:00
Ishaan JaffandGitHub 9c2c231c7c Merge pull request #4857 from Manouchehri/improve-oidc-tests-5 
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
 2024-07-24 09:48:01 -07:00
Ishaan JaffandGitHub 691c1a5355 Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1 
Add Llama 3.1 for Bedrock
 2024-07-24 09:47:32 -07:00
David Manouchehri ced03d9d7f (test_embedding.py) - Re-enable embedding test with Azure OIDC. 2024-07-24 16:41:24 +00:00
Krish DholakiaandGitHub 035d03c7f2 Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning 
Fix `test_prompt_factory` flake8 warning
v1.42.0 		2024-07-24 09:38:48 -07:00
Marc Abramowitz a50fe3e1ca Fix test_prompt_factory flake8 warning 
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```

Fixed by making the string a raw string, which is equivalent:

```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```

See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
 2024-07-24 09:14:22 -07:00
Ishaan JaffandGitHub d06229d168 Merge pull request #4855 from Manouchehri/improve-oidc-tests-4 
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
 2024-07-24 09:13:48 -07:00
David Manouchehri c364a3129e (test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon. 2024-07-24 16:05:58 +00:00
Ishaan JaffandGitHub f325e29147 Merge pull request #4854 from Manouchehri/oidc-azure-tests-3 
OIDC azure tests 3
 2024-07-24 08:53:53 -07:00
Ishaan JaffandGitHub b5d580752d Merge pull request #4843 from elabbarw/main 
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
 2024-07-24 08:53:29 -07:00
Wanis ElabbarandGitHub 1350ac217d Merge pull request #3 from elabbarw/elabbarw-llamav31prices 
update azure_ai llamav31 prices with sources
 2024-07-24 16:50:35 +01:00