tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-13 16:23:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,302 Commits 2,072 Branches 1,425 Tags
83beb41096f69de76a6eef9994de59a8bc335612
Commit Graph
11302 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia 1c55f2ccc5 fix(utils.py): persist system fingerprint across chunks 2024-03-25 19:24:09 -07:00
Krrish Dholakia fa297b67ca fix(test_amazing_vertex_completion.py): fix test to check if content is none 2024-03-25 19:11:39 -07:00
Krish DholakiaandGitHub f702d49e00 Update README.md v1.34.3 2024-03-25 19:03:48 -07:00
Krrish Dholakia bd75498913 fix(utils.py): log success event for streaming 2024-03-25 19:03:10 -07:00
Ishaan Jaff ef93fcaa8e bump: version 1.34.2 → 1.34.3 2024-03-25 18:58:40 -07:00
Ishaan JaffandGitHub ab8e264691 Merge pull request #2695 from BerriAI/litellm_fix_cache_controls 
(test) Using Cache controls with litellm - `no-cache=True`
 2024-03-25 18:58:05 -07:00
Ishaan Jaff 07fe08d8b5 (test) no cache hit 2024-03-25 18:56:36 -07:00
Ishaan JaffandGitHub cf9b3bf462 Merge pull request #2694 from BerriAI/litellm_better_cache_debugging 
[Fix] better cache debugging/error statements
 2024-03-25 18:47:54 -07:00
Ishaan JaffandGitHub 08653aaf27 Merge pull request #2693 from BerriAI/litellm_batch_write_redis_cache 
[FEAT] batch write redis cache
 2024-03-25 18:47:24 -07:00
Krrish Dholakia a5776a3054 test(test_custom_logger.py): cleanup test 2024-03-25 18:32:12 -07:00
Ishaan Jaff 553ac19f9f (feat) improve cache debugging litellm 2024-03-25 18:26:58 -07:00
Krrish Dholakia 1ac641165b fix(utils.py): persist response id across chunks 2024-03-25 18:20:43 -07:00
Ishaan Jaff 3fcab0137a (test) batch writing to cache 2024-03-25 18:04:04 -07:00
Ishaan Jaff 32d4756943 (fix) print verbose in batch writing redis 2024-03-25 18:02:31 -07:00
Krrish Dholakia dc2c4af631 fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
Ishaan JaffandGitHub 7134d66fae Merge branch 'main' into litellm_batch_write_redis_cache 2024-03-25 16:41:29 -07:00
Ishaan Jaff abce689862 (feat) batch write redis cache output 2024-03-25 16:39:47 -07:00
Krrish Dholakia 9e1e97528d fix(utils.py): ensure last chunk is always empty delta w/ finish reason 
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
 2024-03-25 16:33:41 -07:00
Ishaan Jaff 4ae51e9fd5 (fix) locust load test use uuid 2024-03-25 15:36:30 -07:00
Ishaan Jaff 37aadba959 (feat) v0 batch redis cache writes 2024-03-25 15:20:10 -07:00
Krrish Dholakia f153889738 fix(utils.py): allow user to disable streaming logging 
fixes event loop issue for litellm.disable_streaming_logging
 2024-03-25 14:28:46 -07:00
Krrish Dholakia 16ade7e556 docs(proxy/caching.md): add ttl param to proxy/caching.md 2024-03-25 13:46:52 -07:00
Krrish Dholakia 591a0a376e fix(caching.py): support default ttl for caching 2024-03-25 13:40:17 -07:00
dependabot[bot]andGitHub 9323f1439f build(deps): bump express from 4.18.2 to 4.19.2 in /docs/my-website 
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-25 20:31:36 +00:00
Krrish Dholakia e1c75c009f bump: version 1.34.1 → 1.34.2 2024-03-25 13:28:25 -07:00
Krish DholakiaandGitHub f15ba10170 Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2 
Litellm jwt auth fixes
 2024-03-25 13:27:19 -07:00
Krrish Dholakia 2e4e97a48f test(test_jwt.py): add unit tests for jwt auth integration 2024-03-25 13:24:39 -07:00
Krrish Dholakia 03b8444d3c docs(token_auth.md): add renaming jwt scope string to docs 2024-03-25 12:49:44 -07:00
Krish DholakiaandGitHub e5be002adc Merge pull request #2660 from dragosMC91/fix-pip-install-extra-proxy 
Fix pip install 'litellm[extra_proxy]'
v1.34.1 		2024-03-25 12:42:13 -07:00
Krrish Dholakia c2ffb83c71 fix(handle_jwt.py): cache public keys 
caches jwt public keys - reducing need for making http calls on every request
 2024-03-25 12:36:32 -07:00
Ishaan JaffandGitHub 71c3484b93 Merge pull request #2683 from BerriAI/litellm_f_string 
(feat) Perf Improvement - stop eagerly evaluating fstring
 2024-03-25 12:35:30 -07:00
Krrish Dholakia f1b1640a31 fix(handle_jwt.py): support scopes being a list 
allow scopes in jwt to be a list, not just a space-separated string
 2024-03-25 12:30:40 -07:00
Krrish Dholakia 5aa1c10929 fix(handle_jwt.py): don't require kid to be set 2024-03-25 12:28:16 -07:00
Krrish Dholakia 93959ab5aa fix(handle_jwt.py): allow setting proxy admin role string for jwt auth 2024-03-25 12:20:14 -07:00
Krrish Dholakia edd00af6f2 fix(handle_jwt.py): enable user to set jwt admin scope string in config 2024-03-25 11:34:49 -07:00
Dragos Campean 4549a20333 Merge remote-tracking branch 'upstream/main' into fix-pip-install-extra-proxy 2024-03-25 20:22:17 +02:00
Ishaan Jaff 734a51c049 (fix) stop using f strings in verbose logger 2024-03-25 10:55:30 -07:00
Krish DholakiaandGitHub 123e012dc0 Merge pull request #2672 from RoniGurvich/main 
`cryptography` and `python-multipart` version bump
 2024-03-25 10:54:43 -07:00
Krish DholakiaandGitHub 0804d74d13 Merge pull request #2685 from maxdeichmann/log-langfuse-instantiation 
add langfuse logging
 2024-03-25 10:48:16 -07:00
Ishaan Jaff 5d121a9f3c (fix) stop using f strings with logger 2024-03-25 10:47:18 -07:00
Max Deichmann efb43ccd02 push 2024-03-25 17:43:55 +01:00
onukura 2df63cc621 Fix ollama embedding response 2024-03-25 16:26:49 +00:00
onukura ef69eefcdb Fix ollama api_base to enable remote url 2024-03-25 16:26:40 +00:00
Lucca Zenobio 0c4e76ce11 Merge branch 'main' of https://github.com/themrzmaster/litellm 2024-03-25 13:08:26 -03:00
Lucca Zenobio cda78a5da0 update 2024-03-25 13:08:17 -03:00
Ishaan Jaff dad4bd58bc (feat) stop eagerly evaluating fstring 2024-03-25 09:01:42 -07:00
Krrish Dholakia 85ee29ade2 bump: version 1.34.0 → 1.34.1 2024-03-25 08:37:01 -07:00
Krrish Dholakia 53695943e3 docs(instructor.md): tutorial on using litellm with instructor 2024-03-25 08:35:11 -07:00
Krrish Dholakia f98aead602 feat(main.py): support router.chat.completions.create 
allows using router with instructor

https://github.com/BerriAI/litellm/issues/2673
 2024-03-25 08:26:28 -07:00
Krrish Dholakia 9e9de7f6e2 docs(routing.md): add fallbacks being done in order 2024-03-24 12:13:19 -07:00