Commit Graph
3734 Commits
Author SHA1 Message Date
ishaan-jaff 8e756940dc (tests) remove old replicate stability ai tests 2023-10-12 15:45:09 -07:00
ishaan-jaff 640541f2ce (fix) add bedrock exception mapping for Auth 2023-10-12 15:38:09 -07:00
ishaan-jaff cc2b19b893 (test) fix failing replicate test, catch AuthenticationError 2023-10-12 15:24:33 -07:00
ishaan-jaff 3839be8ed8 (tests) delete old testing files 2023-10-12 15:10:18 -07:00
ishaan-jaff 4b3e4c97b8 (feat) show costs.json in proxy_server.py 2023-10-12 15:07:37 -07:00
ishaan-jaff 78d60f000e (docs) show where the costs are written to 2023-10-12 11:49:25 -07:00
ishaan-jaff 2453628bb3 (docs) update cost display on docs 2023-10-12 11:43:23 -07:00
ishaan-jaff 88679a6d08 (docs) import embedding on litellm hosted cache 2023-10-12 11:38:12 -07:00
ishaan-jaff e5ae870dd5 (feat) proxy_server new cost.json on litellm. Track daily cost & num_requests 2023-10-12 11:37:35 -07:00
ishaan-jaff 171b8fce0a (docs) add import embedding for caching example 2023-10-12 11:25:13 -07:00
ishaan-jaff f8e3c11a38 (test) add logging to replicate test 2023-10-12 10:32:33 -07:00
ishaan-jaff c8d38dce46 (fix) add appdirs as a dependency as a requirements 2023-10-12 09:41:31 -07:00
ishaan-jaff 7a1a65dcdb bump: version 0.7.8 → 0.7.9 2023-10-11 22:32:59 -07:00
ishaan-jaff 67168bf802 (test) openai api currently flaky - leading to failures 2023-10-11 22:32:53 -07:00
ishaan-jaff f949f89071 bump: version 0.7.7 → 0.7.8 2023-10-11 22:11:31 -07:00
ishaan-jaff 60e9433476 (test) flaky cohere endpoint for streaming 2023-10-11 22:11:20 -07:00
ishaan-jaff 3e40ba39bf bump: version 0.7.6 → 0.7.7 2023-10-11 21:32:06 -07:00
ishaan-jaff b9d249ba32 (test) fix streaming test - running into rate limits, set max_tokens 2023-10-11 21:32:00 -07:00
Krrish Dholakia 098a86f678 fix(proxy_cli): prints the location of the config file 2023-10-11 21:19:44 -07:00
Krrish Dholakia 4b0f8825f3 fix(proxy_server): fix prompt template for proxy server 2023-10-11 21:08:42 -07:00
ishaan-jaff 413097f0a7 bump: version 0.7.5 → 0.7.6 2023-10-11 21:07:13 -07:00
ishaan-jaff c3101967b6 (fix) proxy_server linting errors 2023-10-11 20:52:03 -07:00
ishaan-jaff a1c9c80031 (test) add ollama testing 2023-10-11 17:00:39 -07:00
ishaan-jaff fabad3dc42 (fix) Ollama use new streaming format 2023-10-11 17:00:39 -07:00
ishaan-jaff 7b3ee8d129 (feat) ollama raise Exceptions + use LiteLLM stream wrapper 2023-10-11 17:00:39 -07:00
ishaan-jaff 689acb8a08 (feat) add CustomStreamWrapper for Ollama - match OpenAI streaming 2023-10-11 17:00:39 -07:00
ishaan-jaff 897286ec15 (feat) add ollama exception mapping 2023-10-11 17:00:39 -07:00
Krrish Dholakia e1ee2890b9 fix(utils): remove ui to view error message 2023-10-11 16:01:57 -07:00
ishaan-jaff f9f2dcc7ea (fix) set default cost.log 2023-10-11 15:35:53 -07:00
ishaan-jaff 7c81e7449f (feat) proxy_server use fallback port if 8000 occupied 2023-10-11 15:35:14 -07:00
ishaan-jaff 329d27d1fa (feat) proxy_server add /v1 2023-10-11 14:35:05 -07:00
Krrish Dholakia afa68026df bump: version 0.7.4 → 0.7.5 2023-10-11 14:23:58 -07:00
Krrish Dholakia e26f98dce2 fix(utils): don't wait for thread to complete to return response 2023-10-11 14:23:55 -07:00
ishaan-jaff 03c96bbc5f bump: version 0.7.3 → 0.7.4 2023-10-11 12:34:37 -07:00
ishaan-jaff ae096bb18e (test) add testing for litellm callback for supabase 2023-10-11 12:34:10 -07:00
ishaan-jaff cc55bc886a (feat) upgrade supabase callback + support logging streaming on supabase 2023-10-11 12:34:10 -07:00
Krrish Dholakia d0ec844629 fix(proxy_server): import errors 2023-10-11 11:05:31 -07:00
ishaan-jaff 3415471390 bump: version 0.7.2 → 0.7.3 2023-10-11 11:02:10 -07:00
ishaan-jaff 2945918414 (fix) supabase test 2023-10-11 11:02:06 -07:00
ishaan-jaff 52b43ef8c1 bump: version 0.7.1 → 0.7.2 2023-10-11 11:01:10 -07:00
ishaan-jaff ad8ffa9014 (fix) remove print 2023-10-11 10:59:43 -07:00
ishaan-jaff accd6eb97f (docs) move litellm proxy higher up 2023-10-11 10:54:11 -07:00
ishaan-jaff db90f96659 (docs) add ollama higher up in litellm docs 2023-10-11 10:52:56 -07:00
Krrish Dholakia 5e5466dfaf fix(proxy_server.py): use tomli instead of tomllib 2023-10-11 10:43:53 -07:00
ishaan-jaff 6e2e020428 (docs) ollama add mistral, code llama and llama2 2023-10-11 10:18:58 -07:00
ishaan-jaff f84fb8c76d (docs) ollama models 2023-10-11 08:55:38 -07:00
ishaan-jaff 41cd1bbfd6 (docs) add ollama docker image 2023-10-11 08:42:03 -07:00
ishaan-jaff 2694dd34b0 (docs) new ollama_docker image 2023-10-11 08:42:03 -07:00
ishaan-jaff d40aeec131 (fix) proxy_server add LiteLLM: Running 2023-10-11 08:42:03 -07:00
Krrish Dholakia ca7e2f6a05 docs(proxy_server.md): add docker image details to docs 2023-10-11 08:28:08 -07:00