Commit Graph
4238 Commits
Author SHA1 Message Date
David ManouchehriandGitHub a4c79fd116 (pricing) Add Claude v2.1 for Bedrock 2023-12-07 01:12:25 -05:00
ishaan-jaff 7ddc0dad24 (test) fix test_model_group_aliases 2023-12-06 21:25:30 -08:00
ishaan-jaff fa70b1f85b (test) unset model_group_alias_map after test 2023-12-06 20:35:14 -08:00
ishaan-jaff 7b389d10ca (linting) fix 2023-12-06 20:30:33 -08:00
ishaan-jaff 095aa94e71 (fix) linting 2023-12-06 20:26:57 -08:00
ishaan-jaff 900b8d66f3 (feat) proxy use model_group_alias_map 2023-12-06 20:23:24 -08:00
ishaan-jaff ee70c4e822 (feat) router - add model_group_alias_map 2023-12-06 20:13:33 -08:00
Krrish Dholakia 9573123e2b bump: version 1.10.11 → 1.11.0 2023-12-06 19:50:09 -08:00
Krrish Dholakia d3e179e5ad test: fix testing 2023-12-06 19:35:12 -08:00
Krrish Dholakia ac7d0a1632 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
ishaan-jaff 04eecaa493 (test) custom logger on fail 2023-12-06 19:15:08 -08:00
ishaan-jaff f3469fdef8 (test) aembedding on custom logger 2023-12-06 19:09:06 -08:00
ishaan-jaff 7fcd17cbbe (feat) aembedding callback 2023-12-06 19:09:06 -08:00
ishaan-jaff e3b24ec797 (feat) aembedding - add custom logging support 2023-12-06 19:09:06 -08:00
Krrish Dholakia fff0228c20 fix(factory.py): support togethercomputer codellama pt 2023-12-06 19:02:58 -08:00
Krrish Dholakia d4c6cc3920 test: fix testing 2023-12-06 18:52:49 -08:00
Krrish Dholakia c0eedf28fc test: fix proxy server testing 2023-12-06 18:38:53 -08:00
ishaan-jaff 19b1deb200 (feat) proxy: protect health endpoint 2023-12-06 18:14:54 -08:00
ishaan-jaff 1b43c7120c (test) custom logger - check kwargs passed all the way 2023-12-06 18:08:48 -08:00
Krrish Dholakia 0295509b3b fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
ishaan-jaff c8c45ef9c4 (test) async custom logger 2023-12-06 17:53:06 -08:00
Krrish Dholakia 45b4140615 test: fix config import for proxy testing 2023-12-06 17:40:38 -08:00
Krrish Dholakia c789865c87 fix(langfuse.py): metadata none error 2023-12-06 17:24:59 -08:00
ishaan-jaff 8cd9f18b61 (docs) add async success + fail custom logger 2023-12-06 17:24:39 -08:00
Krrish Dholakia d814184bc3 test: fix test imports 2023-12-06 17:21:47 -08:00
Krrish Dholakia d2de7ffe27 test(test_proxy_server_langfuse.py): add langfuse proxy testing 2023-12-06 17:19:17 -08:00
ishaan-jaff b60dc20f4b (fix) proxy edit custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff 8adbf35623 (feat) add async loggers under custom logger 2023-12-06 17:16:24 -08:00
ishaan-jaff b482b9002c (feat) Custom_logger add async success & async failure 2023-12-06 17:16:24 -08:00
ishaan-jaff 1bac052eca (fix) proxy use async logging 2023-12-06 17:16:24 -08:00
ishaan-jaff dfb30d38fa (feat) proxy print set callbacks 2023-12-06 17:16:24 -08:00
Krrish Dholakia 58848841e1 fix(proxy_server.py): make headers json serializable 2023-12-06 17:09:02 -08:00
Krrish Dholakia 51492125b5 test: skip flaky test 2023-12-06 16:50:02 -08:00
Krrish Dholakia caac4f1779 docs(virtual_keys.md): fix import line 2023-12-06 15:12:23 -08:00
Krrish Dholakia ad922b205b fix(proxy_server.py): enable rate limiting concurrent user requests 2023-12-06 15:11:05 -08:00
ishaan-jaff cf1df8204e (docs) proxy - custom async func 2023-12-06 15:04:24 -08:00
ishaan-jaff 0ea6241d3e (docs) use async callback functions 2023-12-06 15:00:16 -08:00
ishaan-jaff 44bf51601a (feat) proxy - custom on failure callback 2023-12-06 14:43:47 -08:00
ishaan-jaff b3f039627e (feat) litellm - add _async_failure_callback 2023-12-06 14:43:47 -08:00
ishaan-jaff 3b17fd3821 (feat) proxy - async_on_fail_logger 2023-12-06 14:43:47 -08:00
Krrish Dholakia f1c1ec8523 fix(bedrock.py): fix embeddings call 2023-12-06 14:16:00 -08:00
ishaan-jaff be15cf20b9 (chore) print verbose 2023-12-06 14:14:20 -08:00
ishaan-jaff e1230627d0 (fix) print statements 2023-12-06 14:11:23 -08:00
ishaan-jaff 0598ab9b63 (fix) proxy /model/new writing to config 2023-12-06 14:11:23 -08:00
Krrish Dholakia 346551da29 fix(proxy_server.py): allow worker config to just be the config filepath 2023-12-06 14:03:25 -08:00
ishaan-jaff 368934d160 (feat) proxy: use async_callback function 2023-12-06 13:51:24 -08:00
Krrish Dholakia b24c9b4cbf refactor: fix linting 2023-12-06 13:27:40 -08:00
Krrish Dholakia d962d5d4c0 fix(bedrock.py): adding support for cohere embeddings 2023-12-06 13:25:18 -08:00
ishaan-jaff cf6ecc03a5 (fix) linting 2023-12-06 13:14:26 -08:00
ishaan-jaff f3c3a9860a (feat) /v1/model/info 2023-12-06 13:03:29 -08:00