 Krrish Dholakia
|
2dd2b8a8e3
|
test(test_streaming.py): add unit testing for custom stream wrapper
v1.34.4.dev1
|
2024-03-26 08:57:44 -07:00 |
|
|
Krish DholakiaandGitHub
|
6f11f300fc
|
Merge pull request #2656 from TashaSkyUp/patch-1
fix for: when using ModelResponse.json() to save and then reconstruct a ModelResponse the choices field ends up empty
|
2024-03-26 08:36:55 -07:00 |
|
|
Krrish Dholakia
|
49e8cdbff9
|
fix(router.py): check for context window error when handling 400 status code errors
was causing proxy context window fallbacks to not work as expected
|
2024-03-26 08:08:15 -07:00 |
|
|
Ishaan Jaff
|
995c379a63
|
(fix) prod.md
|
2024-03-25 22:30:22 -07:00 |
|
|
Ishaan Jaff
|
5b2698a9ed
|
(kub) always pull litellm image
v1.34.4
|
2024-03-25 22:29:23 -07:00 |
|
|
Krrish Dholakia
|
a3617a6af6
|
bump: version 1.34.3 → 1.34.4
|
2024-03-25 21:58:49 -07:00 |
|
|
Krish DholakiaandGitHub
|
eb859f5dba
|
Merge pull request #2692 from BerriAI/litellm_streaming_fixes
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
|
2024-03-25 21:57:04 -07:00 |
|
|
Krrish Dholakia
|
643fd6ac96
|
test(test_caching.py): fix test_redis_cache_acompletion_stream
|
2024-03-25 21:36:47 -07:00 |
|
|
Krrish Dholakia
|
4d85387b5a
|
test(test_azure_astreaming_and_function_calling): fix test to handle caching
|
2024-03-25 19:33:57 -07:00 |
|
|
Krrish Dholakia
|
1c55f2ccc5
|
fix(utils.py): persist system fingerprint across chunks
|
2024-03-25 19:24:09 -07:00 |
|
|
Krrish Dholakia
|
fa297b67ca
|
fix(test_amazing_vertex_completion.py): fix test to check if content is none
|
2024-03-25 19:11:39 -07:00 |
|
|
Krish DholakiaandGitHub
|
f702d49e00
|
Update README.md
v1.34.3
|
2024-03-25 19:03:48 -07:00 |
|
|
Krrish Dholakia
|
bd75498913
|
fix(utils.py): log success event for streaming
|
2024-03-25 19:03:10 -07:00 |
|
|
Ishaan Jaff
|
ef93fcaa8e
|
bump: version 1.34.2 → 1.34.3
|
2024-03-25 18:58:40 -07:00 |
|
|
Ishaan JaffandGitHub
|
ab8e264691
|
Merge pull request #2695 from BerriAI/litellm_fix_cache_controls
(test) Using Cache controls with litellm - `no-cache=True`
|
2024-03-25 18:58:05 -07:00 |
|
|
Ishaan Jaff
|
07fe08d8b5
|
(test) no cache hit
|
2024-03-25 18:56:36 -07:00 |
|
|
Ishaan JaffandGitHub
|
cf9b3bf462
|
Merge pull request #2694 from BerriAI/litellm_better_cache_debugging
[Fix] better cache debugging/error statements
|
2024-03-25 18:47:54 -07:00 |
|
|
Ishaan JaffandGitHub
|
08653aaf27
|
Merge pull request #2693 from BerriAI/litellm_batch_write_redis_cache
[FEAT] batch write redis cache
|
2024-03-25 18:47:24 -07:00 |
|
|
Krrish Dholakia
|
a5776a3054
|
test(test_custom_logger.py): cleanup test
|
2024-03-25 18:32:12 -07:00 |
|
|
Ishaan Jaff
|
553ac19f9f
|
(feat) improve cache debugging litellm
|
2024-03-25 18:26:58 -07:00 |
|
|
Krrish Dholakia
|
1ac641165b
|
fix(utils.py): persist response id across chunks
|
2024-03-25 18:20:43 -07:00 |
|
|
Ishaan Jaff
|
3fcab0137a
|
(test) batch writing to cache
|
2024-03-25 18:04:04 -07:00 |
|
|
Ishaan Jaff
|
32d4756943
|
(fix) print verbose in batch writing redis
|
2024-03-25 18:02:31 -07:00 |
|
|
Krrish Dholakia
|
dc2c4af631
|
fix(utils.py): fix text completion streaming
|
2024-03-25 16:47:17 -07:00 |
|
|
Ishaan JaffandGitHub
|
7134d66fae
|
Merge branch 'main' into litellm_batch_write_redis_cache
|
2024-03-25 16:41:29 -07:00 |
|
|
Ishaan Jaff
|
abce689862
|
(feat) batch write redis cache output
|
2024-03-25 16:39:47 -07:00 |
|
|
Krrish Dholakia
|
9e1e97528d
|
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
|
2024-03-25 16:33:41 -07:00 |
|
|
Ishaan Jaff
|
4ae51e9fd5
|
(fix) locust load test use uuid
|
2024-03-25 15:36:30 -07:00 |
|
|
Ishaan Jaff
|
37aadba959
|
(feat) v0 batch redis cache writes
|
2024-03-25 15:20:10 -07:00 |
|
|
Krrish Dholakia
|
f153889738
|
fix(utils.py): allow user to disable streaming logging
fixes event loop issue for litellm.disable_streaming_logging
|
2024-03-25 14:28:46 -07:00 |
|
|
Krrish Dholakia
|
16ade7e556
|
docs(proxy/caching.md): add ttl param to proxy/caching.md
|
2024-03-25 13:46:52 -07:00 |
|
|
Krrish Dholakia
|
591a0a376e
|
fix(caching.py): support default ttl for caching
|
2024-03-25 13:40:17 -07:00 |
|
|
Krrish Dholakia
|
e1c75c009f
|
bump: version 1.34.1 → 1.34.2
|
2024-03-25 13:28:25 -07:00 |
|
|
Krish DholakiaandGitHub
|
f15ba10170
|
Merge pull request #2687 from BerriAI/litellm_jwt_auth_fixes_2
Litellm jwt auth fixes
|
2024-03-25 13:27:19 -07:00 |
|
|
Krrish Dholakia
|
2e4e97a48f
|
test(test_jwt.py): add unit tests for jwt auth integration
|
2024-03-25 13:24:39 -07:00 |
|
|
Krrish Dholakia
|
03b8444d3c
|
docs(token_auth.md): add renaming jwt scope string to docs
|
2024-03-25 12:49:44 -07:00 |
|
|
Krish DholakiaandGitHub
|
e5be002adc
|
Merge pull request #2660 from dragosMC91/fix-pip-install-extra-proxy
Fix pip install 'litellm[extra_proxy]'
v1.34.1
|
2024-03-25 12:42:13 -07:00 |
|
|
Krrish Dholakia
|
c2ffb83c71
|
fix(handle_jwt.py): cache public keys
caches jwt public keys - reducing need for making http calls on every request
|
2024-03-25 12:36:32 -07:00 |
|
|
Ishaan JaffandGitHub
|
71c3484b93
|
Merge pull request #2683 from BerriAI/litellm_f_string
(feat) Perf Improvement - stop eagerly evaluating fstring
|
2024-03-25 12:35:30 -07:00 |
|
|
Krrish Dholakia
|
f1b1640a31
|
fix(handle_jwt.py): support scopes being a list
allow scopes in jwt to be a list, not just a space-separated string
|
2024-03-25 12:30:40 -07:00 |
|
|
Krrish Dholakia
|
5aa1c10929
|
fix(handle_jwt.py): don't require kid to be set
|
2024-03-25 12:28:16 -07:00 |
|
|
Krrish Dholakia
|
93959ab5aa
|
fix(handle_jwt.py): allow setting proxy admin role string for jwt auth
|
2024-03-25 12:20:14 -07:00 |
|
|
Krrish Dholakia
|
edd00af6f2
|
fix(handle_jwt.py): enable user to set jwt admin scope string in config
|
2024-03-25 11:34:49 -07:00 |
|
|
Dragos Campean
|
4549a20333
|
Merge remote-tracking branch 'upstream/main' into fix-pip-install-extra-proxy
|
2024-03-25 20:22:17 +02:00 |
|
|
Ishaan Jaff
|
734a51c049
|
(fix) stop using f strings in verbose logger
|
2024-03-25 10:55:30 -07:00 |
|
|
Krish DholakiaandGitHub
|
123e012dc0
|
Merge pull request #2672 from RoniGurvich/main
`cryptography` and `python-multipart` version bump
|
2024-03-25 10:54:43 -07:00 |
|
|
Krish DholakiaandGitHub
|
0804d74d13
|
Merge pull request #2685 from maxdeichmann/log-langfuse-instantiation
add langfuse logging
|
2024-03-25 10:48:16 -07:00 |
|
|
Ishaan Jaff
|
5d121a9f3c
|
(fix) stop using f strings with logger
|
2024-03-25 10:47:18 -07:00 |
|
|
Max Deichmann
|
efb43ccd02
|
push
|
2024-03-25 17:43:55 +01:00 |
|
|
Ishaan Jaff
|
dad4bd58bc
|
(feat) stop eagerly evaluating fstring
|
2024-03-25 09:01:42 -07:00 |
|