Commit Graph
11302 Commits
Author SHA1 Message Date
Krrish Dholakia 775d28a509 docs(token_auth.md): update docs to show org spend tracking 2024-04-11 23:34:34 -07:00
Krish DholakiaandGitHub a1cb9a51b9 Merge pull request #2978 from BerriAI/litellm_org_spend_tracking
fix(proxy_server.py): support tracking org spend
v1.35.2
2024-04-11 23:19:33 -07:00
Krrish Dholakia c480b5a008 bump: version 1.35.1 → 1.35.2 2024-04-11 23:16:39 -07:00
Krrish Dholakia 7a3821e0f6 fix(gemini.py): log system prompt in verbose output 2024-04-11 23:15:58 -07:00
Krrish Dholakia 77d6b882b8 fix(vertex_ai.py): check if 'response_mime_type' in generation config before passing it in 2024-04-11 23:10:59 -07:00
Krrish Dholakia c377ba0755 fix(utils.py): vertex ai exception mapping
fixes check which caused all vertex errors to be ratelimit errors
2024-04-11 23:04:21 -07:00
Krrish Dholakia f4c7f4f901 fix(proxy_server.py): support tracking org spend
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish DholakiaandGitHub d89644d46c Merge pull request #2970 from BerriAI/litellm_keys
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia 3665b890f8 build(proxy_server_config.yaml): cleanup config 2024-04-11 20:20:09 -07:00
Krrish Dholakia 77097f8e7d test(test_jwt.py): add testing to make sure user api key auth returns the expected values 2024-04-11 20:18:55 -07:00
Krrish Dholakia 67b5634417 fix(auth_checks.py): raise error if user doesn't exist in db 2024-04-11 19:55:04 -07:00
Krrish Dholakia 36ff593c02 feat(proxy_server.py): support cost tracking on user id via JWT-Auth
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Ishaan JaffandGitHub 8ba140b09e Merge pull request #2965 from BerriAI/litellm_fix_key_update
fix - delete key from inMemory Cache after /key/update
2024-04-11 18:18:05 -07:00
Krrish Dholakia e413191493 fix(handle_jwt.py): support firebase public key format
adds support for when the public keys are a json instead of nested inside a json
2024-04-11 18:07:13 -07:00
dependabot[bot]andGitHub 5fd248274a build(deps): bump idna from 3.6 to 3.7
Bumps [idna](https://github.com/kjd/idna) from 3.6 to 3.7.
- [Release notes](https://github.com/kjd/idna/releases)
- [Changelog](https://github.com/kjd/idna/blob/master/HISTORY.rst)
- [Commits](https://github.com/kjd/idna/compare/v3.6...v3.7)

---
updated-dependencies:
- dependency-name: idna
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-04-12 00:52:36 +00:00
Krish DholakiaandGitHub cd834e9d52 Merge pull request #2964 from Manouchehri/gemini-json-mode-2962
Add JSON mode to Gemini (Vertex AI)
2024-04-11 17:51:27 -07:00
Krrish Dholakia 3b803b09d9 fix(langfuse.py): remove print statements 2024-04-11 17:23:41 -07:00
Ishaan Jaff beabec620e fix - delete updated keys from cache 2024-04-11 17:21:44 -07:00
Krrish Dholakia bdfb74f8a5 test(test_openai_endpoints.py): add local test, for proxy concurrency 2024-04-11 17:16:23 -07:00
David Manouchehri 9c55be3e82 (feat) - Bump version for Vertex AI SDK. 2024-04-12 00:03:32 +00:00
David Manouchehri 05350037be (feat) - Extreme dirty hack for response_mime_type in Vertex AI. 2024-04-12 00:03:31 +00:00
David Manouchehri d08674bf2f (feat) - Dirty hack to get response_mime_type working before it's released in the Python SDK. 2024-04-12 00:03:30 +00:00
David Manouchehri 649c3bb0dd (feat) - Add support for JSON mode in Vertex AI 2024-04-12 00:03:29 +00:00
Ishaan Jaff 6e934cb842 docs fix team based routing 2024-04-11 15:23:25 -07:00
Ishaan Jaff 921f6d307e fix - stop printing api_key in debug mode 2024-04-11 15:05:22 -07:00
Ishaan Jaff 68e0c93246 fix - better debugging for adding new models v1.35.1.dev2 2024-04-11 14:49:00 -07:00
Ishaan JaffandGitHub 79451242c8 Merge pull request #2892 from gregnwosu/patch-1
created defaults for response["eval_count"]
2024-04-11 13:40:32 -07:00
Ishaan JaffandGitHub f103f395b5 Merge pull request #2959 from BerriAI/litellm_fix_issue_adding_models_ui
fix - issue when loading models through ui
v1.35.1.dev1
2024-04-11 13:07:58 -07:00
Ishaan Jaff fc832f2196 fix - issue when loading models through ui 2024-04-11 13:06:10 -07:00
Ishaan JaffandGitHub b773133160 Merge pull request #2958 from BerriAI/litellm_ui_add_fallback/_ogin
Litellm UI add fallback-login
2024-04-11 11:49:40 -07:00
Ishaan Jaff 5f95260cf5 ui - show fallback login 2024-04-11 11:48:40 -07:00
Ishaan Jaff f2467ba4e3 fix - show correct fallback login 2024-04-11 11:48:03 -07:00
Ishaan Jaff 0b964ea7ff fix - point to fallback login 2024-04-11 11:41:44 -07:00
Ishaan Jaff 7cb40d3b35 UI - add /fallback/login route 2024-04-11 11:20:41 -07:00
Ishaan JaffandGitHub 64904e2ab1 Merge pull request #2956 from BerriAI/litellm_fix_imghdr
fix - stop using imghdr
2024-04-11 09:55:47 -07:00
Ishaan Jaff 9465288e9e migration script 2024-04-11 09:55:14 -07:00
Ishaan Jaff fb657423ee fix - stop using imghdr 2024-04-11 09:32:42 -07:00
Krrish Dholakia c597d610f3 bump: version 1.35.0 → 1.35.1 v1.35.1 2024-04-11 09:28:26 -07:00
Krrish Dholakia 84d43484c6 fix(router.py): make sure pre call rpm check runs even when model not in model cost map 1.35.1.dev1 2024-04-11 09:27:46 -07:00
Ishaan Jaff 240aaf7af8 fix - show api_base in migration script 2024-04-11 09:26:13 -07:00
Ishaan JaffandGitHub 69c095b768 Merge pull request #2953 from BerriAI/litellm_fix_sec_issue
[security fix - Low Severity] - disable demo accounts
2024-04-11 08:07:24 -07:00
Ishaan Jaff 96cd038a73 security fix - disable demo accounts 2024-04-11 07:40:34 -07:00
Ishaan Jaff 1c1b0f929f fix - migration script for /model/new 2024-04-11 07:34:00 -07:00
Krish DholakiaandGitHub 78571babb3 Merge pull request #2830 from onukura/onukura-patch-1
Update README.md
2024-04-11 06:47:53 -07:00
Krrish Dholakia d999acd20d docs(routing.md): reorder routing strategies 2024-04-10 22:29:24 -07:00
Krrish Dholakia 83a7a9f0b7 docs(routing.md): add calling via proxy tutorial to router docs 2024-04-10 22:24:29 -07:00
Krish DholakiaandGitHub 6749306239 Merge pull request #2945 from ushuz/hotfix
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krrish Dholakia 9f517b2907 docs(routing.md): add async usage based routing to docs 2024-04-10 21:51:36 -07:00
Krrish Dholakia b8bd7bde1e bump: version 1.34.42 → 1.35.0 v1.35.0 2024-04-10 21:45:44 -07:00
Krrish Dholakia 623613203a refactor(main.py): trigger new build
contains fixes for async batch get
2024-04-10 21:45:06 -07:00