 Krrish Dholakia
|
7cf0bb475f
|
fix(proxy_server.py): run all endpoints through custom auth
|
2024-01-19 20:24:33 -08:00 |
|
|
Krrish Dholakia
|
b07677c6be
|
fix(gemini.py): support streaming
|
2024-01-19 20:21:34 -08:00 |
|
|
Ishaan JaffandGitHub
|
b59e67f099
|
Merge pull request #1529 from BerriAI/litellm_router_add_type_hints
[Feat] Add typehints for litellm.Router
|
2024-01-19 19:45:54 -08:00 |
|
|
Krish DholakiaandGitHub
|
749f0b7602
|
Merge pull request #1531 from BerriAI/litellm_max_parallel_request_invalid_provider_fix
fix(utils.py): add metadata to logging obj on setup, if exists (fixes max parallel request bug)
v1.18.6
|
2024-01-19 19:25:34 -08:00 |
|
|
Krrish Dholakia
|
2c2163e4e5
|
fix(proxy_server.py): fix key info to handle pydantic v1
|
2024-01-19 18:52:09 -08:00 |
|
|
Krrish Dholakia
|
f2a8ceddc2
|
fix(utils.py): revert exception mapping change
|
2024-01-19 17:39:35 -08:00 |
|
|
Krrish Dholakia
|
f05aba1f85
|
fix(utils.py): add metadata to logging obj on setup, if exists
|
2024-01-19 17:29:47 -08:00 |
|
|
Krrish Dholakia
|
1ec5083542
|
fix(anthropic.py): fix pr for anthropic headers
|
2024-01-19 17:06:24 -08:00 |
|
|
Krrish Dholakia
|
1be4f7d2d1
|
fix(test_key_generate_prisma.py): fix testing
n
|
2024-01-19 16:53:46 -08:00 |
|
|
ishaan-jaff
|
91e57bd039
|
(fix) add router typehints
|
2024-01-19 16:32:43 -08:00 |
|
|
ishaan-jaff
|
a9cf6cec80
|
(feat) add typehints for litellm.acompletion
|
2024-01-19 16:05:26 -08:00 |
|
|
ishaan-jaff
|
b730482aaf
|
v0
|
2024-01-19 15:49:37 -08:00 |
|
|
Ishaan JaffandGitHub
|
6134b655e8
|
Merge pull request #1513 from costly-ai/main
Allow overriding headers for anthropic
|
2024-01-19 15:21:45 -08:00 |
|
|
ishaan-jaff
|
6bc7cc46b4
|
(docs) router debugging
|
2024-01-19 15:18:00 -08:00 |
|
|
Krrish Dholakia
|
95d1557785
|
build(config.yml): fix envrionment variable name
|
2024-01-19 15:11:18 -08:00 |
|
|
Krrish Dholakia
|
89391f84eb
|
build(config.yml): add better logs
|
2024-01-19 15:08:32 -08:00 |
|
|
ishaan-jaff
|
22daf75a35
|
bump: version 1.18.5 → 1.18.6
|
2024-01-19 15:03:30 -08:00 |
|
|
Ishaan JaffandGitHub
|
73684bc93f
|
Merge pull request #1525 from BerriAI/litellm_router_improvements
[Feat] Router improvements
|
2024-01-19 15:02:05 -08:00 |
|
|
ishaan-jaff
|
8a4f2c198b
|
(test) test_usage_based_routing
|
2024-01-19 14:59:56 -08:00 |
|
|
Krrish Dholakia
|
f5ced089d6
|
test(tests/): add unit testing for proxy server endpoints
|
2024-01-19 14:54:29 -08:00 |
|
|
ishaan-jaff
|
f408162449
|
(test) debug logs test - router
|
2024-01-19 14:22:18 -08:00 |
|
|
ishaan-jaff
|
0196ac6376
|
(test) router-fallbacks
|
2024-01-19 14:12:09 -08:00 |
|
|
Ishaan JaffandGitHub
|
b2b41727ce
|
Merge pull request #1524 from timothyasp/langsmith-project-env-bug-fix
Langsmith: Add envs for project/run names; fix bug with None metadata
|
2024-01-19 14:04:16 -08:00 |
|
|
ishaan-jaff
|
d0442ae0f2
|
(feat) router - usage based routing - consider input_tokens
|
2024-01-19 13:59:49 -08:00 |
|
|
ishaan-jaff
|
57a20100e4
|
(test) usage based routing
|
2024-01-19 13:58:08 -08:00 |
|
|
ishaan-jaff
|
8c0b7b1015
|
(feat) - improve router logging/debugging messages
|
2024-01-19 13:57:33 -08:00 |
|
|
ishaan-jaff
|
912e2de364
|
(test) usage based router + fallbacks
|
2024-01-19 12:34:08 -08:00 |
|
|
ishaan-jaff
|
7b2c15aa51
|
(feat) improve litellm.Router logging
|
2024-01-19 12:28:51 -08:00 |
|
|
Tim Asp
|
9d6a8b5de3
|
Cleaner fallback
|
2024-01-19 11:56:45 -08:00 |
|
|
Ishaan JaffandGitHub
|
650036071f
|
Merge pull request #1519 from BerriAI/litellm_proxy_make_success_handler_non_blocking
[Feat] litellm.acompletion() make Langfuse success handler non blocking
|
2024-01-19 11:41:00 -08:00 |
|
|
Tim Asp
|
315fbcd09f
|
update docs
|
2024-01-19 11:39:39 -08:00 |
|
|
ishaan-jaff
|
8cf8da1378
|
(test) langfuse_latency_test_user
|
2024-01-19 11:38:44 -08:00 |
|
|
ishaan-jaff
|
cb99cd18e7
|
(feat) log cache_hit as langfuse tags
|
2024-01-19 11:38:18 -08:00 |
|
|
Tim Asp
|
27087e5662
|
fix error when metadata is none, prevents logging silently
|
2024-01-19 11:37:45 -08:00 |
|
|
Tim Asp
|
141d2219e2
|
Add env for project wide langsmith default project settings
|
2024-01-19 11:37:15 -08:00 |
|
|
ishaan-jaff
|
2f429f37b7
|
(test) test latency added with langfuse call
|
2024-01-19 11:28:10 -08:00 |
|
|
ishaan-jaff
|
cb40f58cd3
|
(fix) return usage in mock_completion
|
2024-01-19 11:25:47 -08:00 |
|
|
Krrish Dholakia
|
b03552790f
|
build(config.yml): add aiohttp to circle ci
|
2024-01-19 10:52:53 -08:00 |
|
|
Krrish Dholakia
|
7a6b2888c2
|
build(config.yml): fix path for test folder
|
2024-01-19 10:49:31 -08:00 |
|
|
Krrish Dholakia
|
77f8db7050
|
build(config.yml): fix config.yml
|
2024-01-19 10:46:24 -08:00 |
|
|
ishaan-jaff
|
6a695477ba
|
(fix) async langfuse logger
|
2024-01-19 10:44:51 -08:00 |
|
|
Krrish Dholakia
|
a0ac815859
|
build(config.yml): upgrade python version in docker build test
|
2024-01-19 10:44:39 -08:00 |
|
|
Krrish Dholakia
|
165bdd2fdf
|
build(config.yml): modify config.yml to use python test script against docker image
v1.18.5
|
2024-01-19 10:39:25 -08:00 |
|
|
Krrish Dholakia
|
326d7856e2
|
bump: version 1.18.4 → 1.18.5
|
2024-01-19 10:23:18 -08:00 |
|
|
Krrish Dholakia
|
1a29272b47
|
fix(parallel_request_limiter.py): handle tpm/rpm limits being null
|
2024-01-19 10:22:27 -08:00 |
|
|
ishaan-jaff
|
f2cfb76920
|
(fix) use asyncio run_in_executor
|
2024-01-19 09:52:51 -08:00 |
|
|
Krrish Dholakia
|
62e35f6a14
|
docs(users.md): add tpm rpm rate limits to docs
|
2024-01-19 08:56:47 -08:00 |
|
|
ishaan-jaff
|
e6b5152e63
|
(chore) update load test
|
2024-01-19 08:52:17 -08:00 |
|
|
ishaan-jaff
|
cd08a02764
|
(test) add blocking callback test
|
2024-01-19 08:51:52 -08:00 |
|
|
ishaan-jaff
|
a9c5b02303
|
(v0) fix
|
2024-01-19 08:51:14 -08:00 |
|