 Krrish Dholakia
|
6b1d2551d1
|
test(test_batch_completions.py): handle overloaded anthropic error
v1.34.4.dev2
|
2024-03-26 13:53:18 -07:00 |
|
|
Krrish Dholakia
|
3a82ff2ef2
|
fix(utils.py): don't send subsequent chunks if last chunk sent
prevents multiple empty finish chunks from being sent
|
2024-03-26 13:49:42 -07:00 |
|
|
Ishaan JaffandGitHub
|
0f432dfb4b
|
Merge pull request #2703 from BerriAI/litellm_remove_litellm_telemetry
[Fix] remove litellm telemetry from proxy server
|
2024-03-26 11:35:18 -07:00 |
|
|
Ishaan JaffandGitHub
|
da503eab18
|
Merge branch 'main' into litellm_remove_litellm_telemetry
|
2024-03-26 11:35:02 -07:00 |
|
|
Ishaan Jaff
|
b6af44c4dc
|
(fix) telemetry = false
|
2024-03-26 11:23:23 -07:00 |
|
|
Ishaan Jaff
|
6b4b05b58f
|
(fix) remove litellm.telemetry
|
2024-03-26 11:21:09 -07:00 |
|
|
Ishaan Jaff
|
4d81df3d6f
|
(docs) switch of litellm telemetry
|
2024-03-26 11:19:55 -07:00 |
|
|
Krish DholakiaandGitHub
|
f3f56204c5
|
Update README.md
|
2024-03-26 10:34:16 -07:00 |
|
|
Krrish Dholakia
|
b4d0a95cff
|
test(test_router_debug_logs.py): add info statement to log test
|
2024-03-26 09:54:26 -07:00 |
|
|
Krrish Dholakia
|
584d187e0e
|
fix(utils.py): check if message is pydantic object or dict before dereferencing
|
2024-03-26 09:47:44 -07:00 |
|
|
Ishaan JaffandGitHub
|
2ecdd92619
|
Merge pull request #2702 from BerriAI/litellm_cache_flush
[Feat] Proxy - /cache/flushall - delete all elements from cache
|
2024-03-26 09:34:39 -07:00 |
|
|
Ishaan Jaff
|
7409dcd222
|
(fix) doc string
|
2024-03-26 09:25:44 -07:00 |
|
|
Ishaan Jaff
|
75ef51b714
|
(fix) undo change from other branch
|
2024-03-26 09:24:12 -07:00 |
|
|
Ishaan Jaff
|
098a03facc
|
(fix) undo changes from other branches
|
2024-03-26 09:22:19 -07:00 |
|
|
Ishaan Jaff
|
b8af946fb9
|
(feat) /cache/flushall
|
2024-03-26 09:18:58 -07:00 |
|
|
Ishaan Jaff
|
151b717ae2
|
(feat) support cache flush on redis
|
2024-03-26 09:12:30 -07:00 |
|
|
Ishaan Jaff
|
ade5d58331
|
(fix) in mem redis reads
|
2024-03-26 09:10:49 -07:00 |
|
|
Krrish Dholakia
|
2dd2b8a8e3
|
test(test_streaming.py): add unit testing for custom stream wrapper
v1.34.4.dev1
|
2024-03-26 08:57:44 -07:00 |
|
|
Krish DholakiaandGitHub
|
6f11f300fc
|
Merge pull request #2656 from TashaSkyUp/patch-1
fix for: when using ModelResponse.json() to save and then reconstruct a ModelResponse the choices field ends up empty
|
2024-03-26 08:36:55 -07:00 |
|
|
Krrish Dholakia
|
49e8cdbff9
|
fix(router.py): check for context window error when handling 400 status code errors
was causing proxy context window fallbacks to not work as expected
|
2024-03-26 08:08:15 -07:00 |
|
|
Ishaan Jaff
|
787c9b7df0
|
(test) claude-1 api is unstable
|
2024-03-26 08:07:16 -07:00 |
|
|
Ishaan Jaff
|
81b716d8da
|
(fix) cache control logic
|
2024-03-26 07:36:45 -07:00 |
|
|
Ishaan Jaff
|
995c379a63
|
(fix) prod.md
|
2024-03-25 22:30:22 -07:00 |
|
|
Ishaan Jaff
|
5b2698a9ed
|
(kub) always pull litellm image
v1.34.4
|
2024-03-25 22:29:23 -07:00 |
|
|
Ishaan Jaff
|
965fb6eb2c
|
(fix) cache control logic
|
2024-03-25 22:19:34 -07:00 |
|
|
Krrish Dholakia
|
a3617a6af6
|
bump: version 1.34.3 → 1.34.4
|
2024-03-25 21:58:49 -07:00 |
|
|
Krish DholakiaandGitHub
|
eb859f5dba
|
Merge pull request #2692 from BerriAI/litellm_streaming_fixes
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
|
2024-03-25 21:57:04 -07:00 |
|
|
Krrish Dholakia
|
643fd6ac96
|
test(test_caching.py): fix test_redis_cache_acompletion_stream
|
2024-03-25 21:36:47 -07:00 |
|
|
Krrish Dholakia
|
4d85387b5a
|
test(test_azure_astreaming_and_function_calling): fix test to handle caching
|
2024-03-25 19:33:57 -07:00 |
|
|
Krrish Dholakia
|
1c55f2ccc5
|
fix(utils.py): persist system fingerprint across chunks
|
2024-03-25 19:24:09 -07:00 |
|
|
Krrish Dholakia
|
fa297b67ca
|
fix(test_amazing_vertex_completion.py): fix test to check if content is none
|
2024-03-25 19:11:39 -07:00 |
|
|
Krish DholakiaandGitHub
|
f702d49e00
|
Update README.md
v1.34.3
|
2024-03-25 19:03:48 -07:00 |
|
|
Krrish Dholakia
|
bd75498913
|
fix(utils.py): log success event for streaming
|
2024-03-25 19:03:10 -07:00 |
|
|
Ishaan Jaff
|
ef93fcaa8e
|
bump: version 1.34.2 → 1.34.3
|
2024-03-25 18:58:40 -07:00 |
|
|
Ishaan JaffandGitHub
|
ab8e264691
|
Merge pull request #2695 from BerriAI/litellm_fix_cache_controls
(test) Using Cache controls with litellm - `no-cache=True`
|
2024-03-25 18:58:05 -07:00 |
|
|
Ishaan Jaff
|
07fe08d8b5
|
(test) no cache hit
|
2024-03-25 18:56:36 -07:00 |
|
|
Ishaan JaffandGitHub
|
cf9b3bf462
|
Merge pull request #2694 from BerriAI/litellm_better_cache_debugging
[Fix] better cache debugging/error statements
|
2024-03-25 18:47:54 -07:00 |
|
|
Ishaan JaffandGitHub
|
08653aaf27
|
Merge pull request #2693 from BerriAI/litellm_batch_write_redis_cache
[FEAT] batch write redis cache
|
2024-03-25 18:47:24 -07:00 |
|
|
Krrish Dholakia
|
a5776a3054
|
test(test_custom_logger.py): cleanup test
|
2024-03-25 18:32:12 -07:00 |
|
|
Ishaan Jaff
|
553ac19f9f
|
(feat) improve cache debugging litellm
|
2024-03-25 18:26:58 -07:00 |
|
|
Krrish Dholakia
|
1ac641165b
|
fix(utils.py): persist response id across chunks
|
2024-03-25 18:20:43 -07:00 |
|
|
Ishaan Jaff
|
3fcab0137a
|
(test) batch writing to cache
|
2024-03-25 18:04:04 -07:00 |
|
|
Ishaan Jaff
|
32d4756943
|
(fix) print verbose in batch writing redis
|
2024-03-25 18:02:31 -07:00 |
|
|
Krrish Dholakia
|
dc2c4af631
|
fix(utils.py): fix text completion streaming
|
2024-03-25 16:47:17 -07:00 |
|
|
Ishaan JaffandGitHub
|
7134d66fae
|
Merge branch 'main' into litellm_batch_write_redis_cache
|
2024-03-25 16:41:29 -07:00 |
|
|
Ishaan Jaff
|
abce689862
|
(feat) batch write redis cache output
|
2024-03-25 16:39:47 -07:00 |
|
|
Krrish Dholakia
|
9e1e97528d
|
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
|
2024-03-25 16:33:41 -07:00 |
|
|
Ishaan Jaff
|
4ae51e9fd5
|
(fix) locust load test use uuid
|
2024-03-25 15:36:30 -07:00 |
|
|
Ishaan Jaff
|
37aadba959
|
(feat) v0 batch redis cache writes
|
2024-03-25 15:20:10 -07:00 |
|
|
Krrish Dholakia
|
f153889738
|
fix(utils.py): allow user to disable streaming logging
fixes event loop issue for litellm.disable_streaming_logging
|
2024-03-25 14:28:46 -07:00 |
|