tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-17 14:16:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
15,153 Commits 2,072 Branches 1,425 Tags
5553f84d511fc352dc95cbf49ad752eefbfeefa5
Commit Graph
15153 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
fracapuano 5553f84d51 fix: now supports single tokens prediction 2024-07-25 19:06:07 +02:00
Krrish Dholakia 80800b9ec8 docs(caching.md): update caching docs to include ttl info 2024-07-25 10:01:47 -07:00
Krrish Dholakia 4e51f712f3 fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 09:57:19 -07:00
Krrish Dholakia b376ee71b0 fix(internal_user_endpoints.py): support updating budgets for /user/update 2024-07-24 21:51:46 -07:00
Ishaan JaffandGitHub 5cb58fc3c9 Merge pull request #4873 from BerriAI/litellm_add_mistral-large-2407 
[Feat] -  Add `mistral/mistral-large 2`
 2024-07-24 21:37:08 -07:00
Ishaan Jaff a92a2ca382 docs add mistral api large 2 2024-07-24 21:35:34 -07:00
Ishaan Jaff c77abaa07f feat - add mistral large 2 2024-07-24 21:31:41 -07:00
Ishaan Jaff d5a7c654f1 bump: version 1.42.0 → 1.42.1 v1.42.1 2024-07-24 21:25:31 -07:00
Ishaan JaffandGitHub 7a97bf3aa9 Merge pull request #4871 from BerriAI/litellm_addllama-3.1 
[Feat] Add Groq/llama3.1
 2024-07-24 20:54:59 -07:00
Ishaan Jaff c08d4ca9ec docs groq models 2024-07-24 20:49:28 -07:00
Ishaan Jaff 4cd96976b3 feat - add groq/llama-3.1 2024-07-24 20:46:56 -07:00
Krrish Dholakia 3cd3491920 test: cleanup testing 2024-07-24 19:47:50 -07:00
Krish DholakiaandGitHub 0ac7736b1f Merge pull request #4638 from friendliai/feat/friendli-dedicated-endpoint 
feat: add support for friendliai dedicated endpoint
 2024-07-24 19:23:15 -07:00
wslee 40bb165108 support dynamic api base 2024-07-25 11:14:38 +09:00
wslee dd10da4d46 add support for friendli dedicated endpoint 2024-07-25 11:14:35 +09:00
Krrish Dholakia f35af3bf1c test(test_completion.py): update azure extra headers 2024-07-24 18:42:50 -07:00
Ishaan JaffandGitHub b93b2636a9 Update README.md 2024-07-24 16:51:40 -07:00
Krrish Dholakia b5c5ed2209 fix(key_management_endpoints.py): if budget duration set, set budget_reset_at 2024-07-24 15:02:22 -07:00
Ishaan JaffandGitHub dc3b39ca71 Merge pull request #4864 from BerriAI/docs_add_using_groq_with_proxy 
doc example using litellm proxy with groq
 2024-07-24 14:34:12 -07:00
Ishaan Jaff fe0b0ddaaa doc example using litellm proxy with groq 2024-07-24 14:33:49 -07:00
Ishaan JaffandGitHub 53dd47c5cb Merge pull request #4862 from BerriAI/litellm_fix_unsupported_params_Error 
[Fix-litellm python] Raise correct error for UnsupportedParams Error
 2024-07-24 14:26:25 -07:00
Krrish Dholakia 65705fde25 test(test_embedding.py): add simple azure embedding ad token test 
Addresses https://github.com/BerriAI/litellm/issues/4859#issuecomment-2248838617
 2024-07-24 13:38:03 -07:00
Krrish Dholakia 77ffee4e2e test(test_completion.py): add basic test to confirm azure ad token flow works as expected 2024-07-24 13:07:25 -07:00
Krrish Dholakia 99d8b0ad68 fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
Ishaan Jaff 30c27b3f92 test UnsupportedParamsError 2024-07-24 12:21:22 -07:00
Ishaan Jaff 8ea4b73c27 add UnsupportedParamsError to litellm exceptions 2024-07-24 12:20:14 -07:00
Ishaan Jaff 11512c057d feat use UnsupportedParamsError as litellm error type 2024-07-24 12:19:10 -07:00
Krrish Dholakia d9539e518e build(docker-compose.yml): add prometheus scraper to docker compose 
persists prometheus data across restarts
v1.42.0-stable 		2024-07-24 10:09:23 -07:00
Ishaan JaffandGitHub ac7f6598f3 Merge pull request #4853 from BerriAI/litellm_support_tags 
[Feat] - Support Logging tags on langsmith
 2024-07-24 09:51:56 -07:00
Ishaan JaffandGitHub 9c2c231c7c Merge pull request #4857 from Manouchehri/improve-oidc-tests-5 
(test_embedding.py) - Re-enable embedding test with Azure OIDC.
 2024-07-24 09:48:01 -07:00
Ishaan JaffandGitHub 691c1a5355 Merge pull request #4848 from Manouchehri/llama-3.1-bedrock-1 
Add Llama 3.1 for Bedrock
 2024-07-24 09:47:32 -07:00
David Manouchehri ced03d9d7f (test_embedding.py) - Re-enable embedding test with Azure OIDC. 2024-07-24 16:41:24 +00:00
Krish DholakiaandGitHub 035d03c7f2 Merge pull request #4856 from msabramo/fix-test_prompt_factory-flake8-warning 
Fix `test_prompt_factory` flake8 warning
v1.42.0 		2024-07-24 09:38:48 -07:00
Marc Abramowitz a50fe3e1ca Fix test_prompt_factory flake8 warning 
```shell
$ poetry run flake8 litellm/tests/test_prompt_factory.py
<unknown>:215: SyntaxWarning: invalid escape sequence '\/'
litellm/tests/test_prompt_factory.py:215:21: W605 invalid escape sequence '\/'
```

Fixed by making the string a raw string, which is equivalent:

```
$ python
Python 3.11.6 (main, Oct 25 2023, 19:49:20) [Clang 14.0.0 (clang-1400.0.29.202)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> "data:image\/jpeg;base64,1234" == r"data:image\/jpeg;base64,1234"
True
```

See: https://stackoverflow.com/questions/52335970/how-to-fix-syntaxwarning-invalid-escape-sequence-in-python
 2024-07-24 09:14:22 -07:00
Ishaan JaffandGitHub d06229d168 Merge pull request #4855 from Manouchehri/improve-oidc-tests-4 
(test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon.
 2024-07-24 09:13:48 -07:00
David Manouchehri c364a3129e (test_secret_manager.py) - Improve and add CircleCI v1 test with Amazon. 2024-07-24 16:05:58 +00:00
Ishaan JaffandGitHub f325e29147 Merge pull request #4854 from Manouchehri/oidc-azure-tests-3 
OIDC azure tests 3
 2024-07-24 08:53:53 -07:00
Ishaan JaffandGitHub b5d580752d Merge pull request #4843 from elabbarw/main 
feat - Add Azure_AI Llama v3.1 API deployments to the model prices json file
 2024-07-24 08:53:29 -07:00
Wanis ElabbarandGitHub 1350ac217d Merge pull request #3 from elabbarw/elabbarw-llamav31prices 
update azure_ai llamav31 prices with sources
 2024-07-24 16:50:35 +01:00
Wanis ElabbarandGitHub 77cf1fd600 update azure_ai llamav31 prices with sources 2024-07-24 16:50:07 +01:00
David Manouchehri 4b89397136 (tests) - Skip embedding Azure AD test for now. 2024-07-24 15:42:57 +00:00
David Manouchehri af3a900b4d (tests) - Try azure AD auth directly. 2024-07-24 15:42:40 +00:00
Krish DholakiaandGitHub bd9486501d Merge pull request #4846 from msabramo/speed-up-check_view_exists 
Check existence of multiple views in 1 query
 2024-07-24 08:06:04 -07:00
Krrish Dholakia 41fda47587 test(test_embedding.py): fix base url 2024-07-24 08:04:27 -07:00
Ishaan Jaff cea8fcc3fc test - logging langsmith tags 2024-07-24 07:12:45 -07:00
Ishaan Jaff e378ab8bc9 docs - logging langsmith tags 2024-07-24 07:12:36 -07:00
Ishaan Jaff adfd6ab900 langsmith - support logging tags 2024-07-24 07:08:40 -07:00
Wanis ElabbarandGitHub e370b0cde3 Merge branch 'BerriAI:main' into main 2024-07-24 08:32:49 +01:00
David Manouchehri 609075bd17 Add Llama 3.1 for Bedrock. 2024-07-24 05:48:23 +00:00
Marc Abramowitz 642f1a7bcc Check existence of multiple views in 1 query 
instead of multiple queries. This is more efficient because it lets us check for
all views in one query instead of multiple queries.
 2024-07-23 21:55:02 -07:00