tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-05 22:25:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
17,647 Commits 2,072 Branches 1,425 Tags
d65ba87014a673bca3a4ee1ec4227208eca2ddc8
Commit Graph
17647 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff d65ba87014 add litellm router testing 2024-09-12 08:19:34 -07:00
Krish DholakiaandGitHub 98c34a7e27 LiteLLM Minor Fixes and Improvements (11/09/2024) (#5634) 
* fix(caching.py): set ttl for async_increment cache

fixes issue where ttl for redis client was not being set on increment_cache

Fixes https://github.com/BerriAI/litellm/issues/5609

* fix(caching.py): fix increment cache w/ ttl for sync increment cache on redis

Fixes https://github.com/BerriAI/litellm/issues/5609

* fix(router.py): support adding retry policy + allowed fails policy via config.yaml

* fix(router.py): don't cooldown single deployments

No point, as there's no other deployment to loadbalance with.

* fix(user_api_key_auth.py): support setting allowed email domains on jwt tokens

Closes https://github.com/BerriAI/litellm/issues/5605

* docs(token_auth.md): add user upsert + allowed email domain to jwt auth docs

* fix(litellm_pre_call_utils.py): fix dynamic key logging when team id is set

Fixes issue where key logging would not be set if team metadata was not none

* fix(secret_managers/main.py): load environment variables correctly

Fixes issue where os.environ/ was not being loaded correctly

* test(test_router.py): fix test

* feat(spend_tracking_utils.py): support logging additional usage params - e.g. prompt caching values for deepseek

* test: fix tests

* test: fix test

* test: fix test

* test: fix test

* test: fix test
 2024-09-11 22:36:06 -07:00
Ishaan Jaff 70100d716b bump: version 1.44.24 → 1.44.25 v1.44.25 2024-09-11 21:31:05 -07:00
Ishaan JaffandGitHub 9d2b09099f Merge pull request #5646 from BerriAI/litellm_add_load_testing_logging 
[Feat] Add Load Testing for Langsmith, and OTEL logging
 2024-09-11 21:30:37 -07:00
Ishaan Jaff 88706488f9 fix otel load test 2024-09-11 21:27:31 -07:00
Ishaan Jaff b80f27dce3 fix otel tests 2024-09-11 21:25:27 -07:00
Ishaan Jaff 97ecf86d3d fix langsmith load tests 2024-09-11 21:19:03 -07:00
Ishaan Jaff b01a42ef4f fix langsmith load test 2024-09-11 21:16:16 -07:00
Ishaan Jaff a1f8fcfeed fix load test 2024-09-11 21:06:42 -07:00
Ishaan Jaff da29b070bb print load test results 2024-09-11 20:53:52 -07:00
Ishaan Jaff a08ad0ea70 add load tests to ci/cd 2024-09-11 20:50:57 -07:00
Ishaan Jaff 850b5dbadc add otel load test 2024-09-11 20:47:12 -07:00
Ishaan Jaff e7b047223e add langsmith logging test 2024-09-11 20:35:11 -07:00
Ishaan JaffandGitHub 129113143e Merge pull request #5642 from BerriAI/litellm_otel_fixes 
[Fix-Perf] OTEL use sensible default values for logging
 2024-09-11 18:06:34 -07:00
Ishaan JaffandGitHub 5dac4abd16 Merge branch 'main' into litellm_otel_fixes 2024-09-11 18:06:29 -07:00
Ishaan JaffandGitHub f55318de47 Merge pull request #5638 from BerriAI/litellm_langsmith_perf 
[Langsmith Perf Improvement] Use /batch for Langsmith Logging
 2024-09-11 17:43:26 -07:00
Ishaan Jaff 368a5fd052 fix move logic to custom_batch_logger 2024-09-11 16:19:24 -07:00
steffen-sbtandGitHub de9a39e7c6 Add the option to specify a schema in the postgres DB, also modify docs (#5640) 2024-09-11 14:53:52 -07:00
Ishaan Jaff e681619381 use vars for batch size and flush interval seconds 2024-09-11 14:40:58 -07:00
Ishaan Jaff 3376f151c6 fix otel use sensible defaults 2024-09-11 14:24:04 -07:00
Ishaan Jaff 0070741529 fix vtx test 2024-09-11 14:17:03 -07:00
Ishaan Jaff d84fa05161 fix langsmith tenacity 2024-09-11 13:48:44 -07:00
Ishaan Jaff f339f9614a fix requirements.txt 2024-09-11 13:35:37 -07:00
Ishaan Jaff 1415bdd6fa fix testing + req.txt 2024-09-11 13:30:42 -07:00
Ishaan Jaff ede33230f2 use lock to flush events to langsmith 2024-09-11 13:27:16 -07:00
Ishaan Jaff 7cd7675458 add better debugging for flush interval 2024-09-11 13:02:34 -07:00
Ishaan Jaff a66f03f860 fix installing litellm 2024-09-11 12:45:39 -07:00
Ishaan Jaff 0a6a437e64 use tenacity for langsmith 2024-09-11 12:41:22 -07:00
Ishaan Jaff 15277aff1c fix langsmith clear logged queue on success 2024-09-11 11:56:24 -07:00
Krish DholakiaandGitHub 0295a22561 LiteLLM Minor Fixes and Improvements (09/10/2024) (#5618) 
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error

Fixes https://github.com/BerriAI/litellm/issues/5610

* fix(databricks/cost_calculator.py): Handles model name issues for databricks models

* fix(main.py): fix stream chunk builder for multiple tool calls

Fixes https://github.com/BerriAI/litellm/issues/5591

* fix: correctly set user_alias when passed in

Fixes https://github.com/BerriAI/litellm/issues/5612

* fix(types/utils.py): allow passing role for message object

https://github.com/BerriAI/litellm/issues/5621

* fix(litellm_logging.py): Fix langfuse logging across multiple projects

Fixes issue where langfuse logger was re-using the old logging object

* feat(proxy/_types.py): support adding key-based tags for tag-based routing

Enable tag based routing at key-level

* fix(proxy/_types.py): fix inheritance

* test(test_key_generate_prisma.py): fix test

* test: fix test

* fix(litellm_logging.py): return used callback object
 2024-09-11 11:30:29 -07:00
Christopher ChouandGitHub a451cfc2d6 Add gemini 1.5 flash exp 0827 (#5636) 2024-09-11 11:30:13 -07:00
Ishaan Jaff 860516c843 langsmith use batching for logging 2024-09-11 11:28:27 -07:00
Ishaan Jaff 2f670a16fc fix langsmith_batch_size 2024-09-11 11:25:33 -07:00
Ishaan JaffandGitHub ccda616f2f Merge pull request #5631 from miri-bar/update_ai21_docs 
docs: update ai21 docs
 2024-09-11 09:27:35 -07:00
Ishaan Jaff 2fa9709af0 stash - langsmith use batching for logging 2024-09-11 08:06:56 -07:00
Miri Bar ebf42d6764 docs: update ai21 docs 2024-09-11 13:35:40 +03:00
Ishaan Jaff ce5182710f ci/cd run again 2024-09-10 19:21:13 -07:00
Ishaan JaffandGitHub 720c7c6d08 Merge pull request #5629 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-27a054522e 
Bump body-parser and express in /docs/my-website
 2024-09-10 19:12:57 -07:00
Ishaan JaffandGitHub af960b2138 Merge pull request #5628 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-e639cebc61 
Bump serve-static and express in /docs/my-website
 2024-09-10 19:12:45 -07:00
Ishaan JaffandGitHub 256c72d93b Merge pull request #5626 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-d983993043 
Bump send and express in /docs/my-website
 2024-09-10 19:12:36 -07:00
dependabot[bot]andGitHub 35a81e7b23 Bump body-parser and express in /docs/my-website 
Bumps [body-parser](https://github.com/expressjs/body-parser) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `body-parser` from 1.20.2 to 1.20.3
- [Release notes](https://github.com/expressjs/body-parser/releases)
- [Changelog](https://github.com/expressjs/body-parser/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/body-parser/compare/1.20.2...1.20.3)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: body-parser
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:53 +00:00
dependabot[bot]andGitHub 1b41badb69 Bump serve-static and express in /docs/my-website 
Bumps [serve-static](https://github.com/expressjs/serve-static) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `serve-static` from 1.15.0 to 1.16.0
- [Release notes](https://github.com/expressjs/serve-static/releases)
- [Changelog](https://github.com/expressjs/serve-static/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/serve-static/compare/v1.15.0...1.16.0)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: serve-static
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:51 +00:00
dependabot[bot]andGitHub e48459389c Bump send and express in /docs/my-website 
Bumps [send](https://github.com/pillarjs/send) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `send` from 0.18.0 to 0.19.0
- [Release notes](https://github.com/pillarjs/send/releases)
- [Changelog](https://github.com/pillarjs/send/blob/master/HISTORY.md)
- [Commits](https://github.com/pillarjs/send/compare/0.18.0...0.19.0)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: send
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:46 +00:00
Ishaan Jaff a6f9020884 bump: version 1.44.23 → 1.44.24 v1.44.24 2024-09-10 19:10:27 -07:00
Ishaan JaffandGitHub c1262addbe Merge pull request #5623 from BerriAI/litellm_vertex_use_async_for_getting_token 
[Feat-Vertex Perf] Use async func to get auth credentials
 2024-09-10 18:53:48 -07:00
Ishaan Jaff 9261599ab9 add doc string to vertex llm base 2024-09-10 18:52:43 -07:00
Ishaan Jaff 8d773e66af fix gemini streaming test 2024-09-10 17:50:24 -07:00
Ishaan Jaff 26aa20df73 fix test get token url 2024-09-10 17:38:03 -07:00
Ishaan JaffandGitHub 899eaa9566 Merge pull request #5571 from jalammar/cohere-updated-models 
Add Cohere refresh models and update pricing
 2024-09-10 17:22:51 -07:00
Ishaan Jaff 24474789d7 fix gemini test 2024-09-10 17:20:01 -07:00