Commit Graph
16983 Commits
Author SHA1 Message Date
Krrish Dholakia c7bbfef846 docs(gemini.md): add context caching on google ai studio to docs 2024-08-27 08:02:52 -07:00
Krrish Dholakia e542475f39 build(config.yml): bump anyio version 2024-08-27 07:37:06 -07:00
Krrish Dholakia 6bfcb431cd fix(asyncify.py): fix linting errors 2024-08-27 07:37:06 -07:00
Krrish Dholakia 8d8c961b50 fix(asyncify.py): fix linting errors 2024-08-27 07:37:06 -07:00
Krrish Dholakia 2cf149fbad perf(sagemaker.py): asyncify hf prompt template check
leads to 189% improvement in RPS @ 100 users
2024-08-27 07:37:06 -07:00
Krrish Dholakia b0f01e5b95 test: fix test 2024-08-27 07:14:14 -07:00
Krish DholakiaandGitHub ec2357f1d2 Merge pull request #5384 from miraclebakelaser/fix/cohere-tool-calls-content-field
fix(factory.py): handle missing 'content' in cohere assistant messages
2024-08-27 07:13:28 -07:00
miraclebakelaser 97f714d2b0 fix(factory.py): handle missing 'content' in cohere assistant messages
Update cohere_messages_pt_v2 function to check for 'content' existence
2024-08-27 19:38:37 +09:00
Krrish Dholakia 3ec8a0d25d fix: fix imports 2024-08-26 22:24:30 -07:00
Krish DholakiaandGitHub 81e62aec16 Merge pull request #5381 from BerriAI/litellm_gemini_context_caching
gemini context caching (openai format) support
2024-08-26 22:22:23 -07:00
Krish DholakiaandGitHub 08bd4788dc Merge branch 'main' into litellm_gemini_context_caching 2024-08-26 22:22:17 -07:00
Krrish Dholakia 5aad9d2db7 fix: fix imports 2024-08-26 22:19:01 -07:00
Krrish Dholakia 4868a6cf55 fix: fix unbound var 2024-08-26 22:19:01 -07:00
Krrish Dholakia 0eea01dae9 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 22:19:01 -07:00
Krrish Dholakia b0cc1df2d6 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 22:19:01 -07:00
Krish DholakiaandGitHub c503ff435e Merge pull request #5368 from BerriAI/litellm_vertex_function_support
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
2024-08-26 22:11:42 -07:00
Krrish Dholakia 1a97362b6e fix(types/utils.py): map finish reason to openai compatible 2024-08-26 22:09:02 -07:00
Krish DholakiaandGitHub 3a6412c9c3 Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix
fix(sagemaker.py): support streaming for messages api
2024-08-26 21:36:10 -07:00
Krrish Dholakia 75bb9ff7fe fix: fix imports 2024-08-26 21:36:04 -07:00
Krrish Dholakia 9ba1b78a8f fix(streaming_utils.py): fix generic_chunk_has_all_required_fields 2024-08-26 21:13:02 -07:00
Ishaan Jaff 7655b78623 run ci/cd again v1.44.7 2024-08-26 21:12:42 -07:00
Ishaan Jaff a44596a067 fix created_at and updated_at not existing error 2024-08-26 21:04:39 -07:00
Krrish Dholakia 592d8e933d fix: fix unbound var 2024-08-26 20:49:08 -07:00
Ishaan Jaff ace929b588 ci/cd run again 2024-08-26 20:38:13 -07:00
Ishaan Jaff 95455c8849 fix entrypoint 2024-08-26 20:32:23 -07:00
Krrish Dholakia 5d68f27a57 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 20:28:18 -07:00
Ishaan JaffandGitHub 71e5b2df79 Merge pull request #5380 from BerriAI/dependabot/npm_and_yarn/ui/litellm-dashboard/micromatch-4.0.8
build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui/litellm-dashboard
2024-08-26 19:06:59 -07:00
dependabot[bot]andGitHub 52e8405b40 build(deps): bump micromatch in /ui/litellm-dashboard
Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8.
- [Release notes](https://github.com/micromatch/micromatch/releases)
- [Changelog](https://github.com/micromatch/micromatch/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8)

---
updated-dependencies:
- dependency-name: micromatch
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-08-27 02:04:05 +00:00
Ishaan Jaff 6c7b9dbb59 bump: version 1.44.6 → 1.44.7 2024-08-26 19:02:21 -07:00
Ishaan Jaff f3b3f39eb5 ui new build 2024-08-26 19:01:35 -07:00
Ishaan JaffandGitHub d963de4bf7 Merge pull request #5379 from BerriAI/litellm_regen_keys_ui
[Feat-Proxy] Allow regenerating proxy virtual keys
2024-08-26 18:59:42 -07:00
Ishaan Jaff a043676dc4 fix regen api key flow 2024-08-26 18:59:29 -07:00
Ishaan Jaff 75cbbea071 enforce regenerating keys in enterprise tier 2024-08-26 18:54:50 -07:00
Ishaan Jaff b0ae0101f4 make regenerating api keys enterprise 2024-08-26 18:53:28 -07:00
Krrish Dholakia c83aa801f2 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format)
Closes https://github.com/BerriAI/litellm/issues/5213
2024-08-26 18:47:45 -07:00
Ishaan Jaff 83813af0a2 regenerate key 2024-08-26 18:44:46 -07:00
Ishaan Jaff 5c2c316919 update ui regen key 2024-08-26 18:41:20 -07:00
Ishaan Jaff 4dc2eea58d update key name when regenerating a key 2024-08-26 18:40:51 -07:00
Ishaan Jaff 3527e47b59 ui regenerate an api key 2024-08-26 18:33:18 -07:00
Ishaan Jaff 40c018272c working regenerate key flow 2024-08-26 18:28:26 -07:00
Ishaan Jaff 2615edc468 allow using hashed api keys on regen key 2024-08-26 18:15:52 -07:00
Ishaan Jaff 6b8bb69af3 test test_regenerate_api_key 2024-08-26 18:00:51 -07:00
Ishaan Jaff 7230ee1f55 add regenerate_key_fn 2024-08-26 17:59:44 -07:00
Ishaan JaffandGitHub a77ccea930 Merge pull request #5375 from ushuz/patch-1
docs: Add pricing for imagen-3 and imagen-3-fast
2024-08-26 17:54:45 -07:00
Ishaan JaffandGitHub c02dc761e9 Merge pull request #5374 from BerriAI/litellm_refactor_cohere
[Refactor] Refactor cohere provider to be in a folder
2024-08-26 17:54:32 -07:00
Ishaan Jaff 5745f3d6cc fix schema 2024-08-26 17:27:06 -07:00
Ishaan Jaff cbef0c0a0d add key_state created at to token 2024-08-26 16:52:33 -07:00
Ishaan Jaff fb150f7ce5 update schema 2024-08-26 16:52:19 -07:00
Ishaan Jaff 4f8026f44d fix refactor cohere 2024-08-26 16:33:04 -07:00
Krrish Dholakia 0a15d3b3c3 fix(utils.py): fix message replace 2024-08-26 15:43:30 -07:00