Commit Graph

23 Commits

Author SHA1 Message Date
ishaan-jaff d28145f916 (fix) fake openai endpoint 2024-03-13 15:07:50 -07:00
ishaan-jaff acd8f7b48c (fix) example fake openai endpoint 2024-03-13 15:06:44 -07:00
ishaan-jaff 788583a737 (ci/cd) use fake-openai-endpoint in docker builds 2024-03-13 14:57:41 -07:00
Krrish Dholakia f683acda61 build: fix default config 2024-03-11 13:56:10 -07:00
Krrish Dholakia 1369e18e85 build: fix default config.yaml 2024-03-11 13:43:50 -07:00
ishaan-jaff ab48edca78 (fix) default config users use on startup 2024-03-11 11:39:06 -07:00
ishaan-jaff 53c67d302a (fix) fix default dockerfile startup 2024-03-11 11:26:21 -07:00
Krrish Dholakia b9854a99d2 test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia ad55f4dbb5 feat(proxy_server.py): retry if virtual key is rate limited
currently for chat completions
2024-03-05 19:00:03 -08:00
Krrish Dholakia cd419eb8a5 test(test_keys.py): add more duration for testing budget updates 2024-03-05 15:35:13 -08:00
Krrish Dholakia 37ad5efc61 fix(proxy/utils.py): fix resetting budget logic 2024-03-02 20:52:54 -08:00
Krrish Dholakia 5265d9042d test: testing fixes 2024-02-27 20:35:42 -08:00
ishaan-jaff d07846646c (ui) fix build command 2024-02-21 21:02:46 -08:00
Krrish Dholakia ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krrish Dholakia 09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Krrish Dholakia 30d615f442 build(proxy_server_config.yaml): add proxy budget to default yaml 2024-01-24 20:12:03 -08:00
Krrish Dholakia 09b7235b31 fix: support info level logging on pkg + proxy 2024-01-20 17:45:47 -08:00
Krrish Dholakia f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
Krrish Dholakia 21d951f279 build(config.yml): add /key/generate load test 2024-01-10 19:23:42 +05:30
Krrish Dholakia 9f23cf5852 build(config.yml): add keys to ci build 2024-01-10 18:13:34 +05:30
Ishaan Jaff e3d37b9bdc Update proxy_server_config.yaml 2023-11-30 09:30:41 -08:00
Ishaan Jaff a965c4dfb1 Update proxy_server_config.yaml 2023-11-30 09:26:54 -08:00
ishaan-jaff ecdc5bdad6 (dos) config.yaml 2023-11-30 08:34:36 -08:00