Commit Graph
3710 Commits
Author SHA1 Message Date
Krrish Dholakia a070bee5be fix(utils.py): fix linting issues 2023-11-25 14:11:40 -08:00
Krrish Dholakia 8970f12780 fix(utils.py): fix linting issues 2023-11-25 13:48:50 -08:00
Krrish Dholakia 6d9f7b8f9d fix: fix nlp cloud streaming 2023-11-25 13:45:23 -08:00
ishaan-jaff a688df79b1 (feat) proxy: make chat/completions async 2023-11-25 12:54:03 -08:00
Krrish Dholakia 30f47d3169 bump: version 1.7.0 → 1.7.1 2023-11-25 12:34:28 -08:00
Krrish Dholakia 620633ec28 fix(openai.py): fix linting issues 2023-11-25 12:21:29 -08:00
Krrish Dholakia 69a3b6b8cf docs(simple_proxy.md): improve loading key from vault example 2023-11-25 12:18:35 -08:00
Krrish Dholakia f9ac71a45a docs(simple_proxy.md): add loading api keys from key vault to proxy docs 2023-11-25 12:15:11 -08:00
ishaan-jaff c9fdf25c94 (docs) proxy embedding config 2023-11-25 12:14:19 -08:00
ishaan-jaff f3fff173d2 (docs) custom openai embedding model config 2023-11-25 12:11:25 -08:00
Krrish Dholakia dac76a4861 fix(utils.py): fix embedding response output parsing 2023-11-25 12:06:57 -08:00
ishaan-jaff 62d8f9ad2a (docs) simple proxy - reorder configs 2023-11-25 11:59:57 -08:00
ishaan-jaff c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
ishaan-jaff fed620b202 (test) metadata test in embedding 2023-11-25 11:10:06 -08:00
ishaan-jaff 565d51a4b4 (test) metadata test in litellm.completion 2023-11-25 11:10:06 -08:00
ishaan-jaff 6baaf629e5 (fix) embedding: filter out metadata from optional_params 2023-11-25 11:10:06 -08:00
ishaan-jaff 2e08acba93 (feat) embedding: better logging 2023-11-25 11:10:06 -08:00
ishaan-jaff 77a9eb8a77 (feat) logging: for embedding openai.py 2023-11-25 11:10:06 -08:00
Krrish Dholakia 7cf029d677 docs(simple_proxy.md): update simple proxy docs 2023-11-25 10:18:40 -08:00
ishaan-jaff fbcdbf3a82 (fix) test embedding 2023-11-24 20:46:35 -08:00
ishaan-jaff d9e1267b24 (fix) embedding test 2023-11-24 18:28:38 -08:00
ishaan-jaff 785c024324 (test) fix embedding 2023-11-24 18:14:06 -08:00
ishaan-jaff dca0a5ad0f (test) load test embedding: proxy 2023-11-24 17:14:44 -08:00
ishaan-jaff 1c5b3ad764 (docs) proxy 2023-11-24 17:09:38 -08:00
ishaan-jaff 111c7afaca (docs) proxy performance 2023-11-24 17:07:46 -08:00
ishaan-jaff ad1672b901 (test) fix embedding tests 2023-11-24 17:04:59 -08:00
ishaan-jaff 23466107a7 (feat) 10x faster embeddings 2023-11-24 17:02:57 -08:00
Krrish Dholakia 6738044170 bump: version 1.6.0 → 1.7.0 2023-11-24 16:05:59 -08:00
Krrish Dholakia e732fb8b97 fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
Krrish Dholakia d62da29cbe fix: fix linting issues 2023-11-24 15:46:25 -08:00
Krrish Dholakia fe900966c1 docs(simple_proxy.md): adding tracking spend via proxy to docs 2023-11-24 15:41:52 -08:00
Krrish Dholakia 1a6ea20a0b fix(main.py): fixing linting issues 2023-11-24 15:25:51 -08:00
Krrish Dholakia bc84b38154 feat(proxy_server.py): new /key/info endpoint to access key information (master key only) 2023-11-24 15:24:50 -08:00
Krrish Dholakia 4f22e7de18 feat(proxy_server.py): tracking spend per api key 2023-11-24 15:14:06 -08:00
Krrish Dholakia 2b52e6995c docs(perplexity.md): fix model list
https://github.com/BerriAI/litellm/issues/908
2023-11-24 14:14:47 -08:00
ishaan-jaff 41c6388185 (test) completion with many params 2023-11-24 14:01:21 -08:00
ishaan-jaff a6bea946b3 (fix) completion: when logit bias is None 2023-11-24 14:01:21 -08:00
ishaan-jaff 0f873c756d (fix) completion: OpenAI/Azure filter out None params 2023-11-24 14:01:21 -08:00
Krrish Dholakia f1dbdb58bb docs(simple_proxy.md): add cooldown to docs 2023-11-24 13:37:16 -08:00
Krrish Dholakia 2686894823 fix(router.py): fix retry logic 2023-11-24 13:27:44 -08:00
Krrish Dholakia 16e1070dbe test: refactor testing order 2023-11-24 12:47:28 -08:00
Krrish Dholakia 2a033fd8a2 test(test_router_cooldowns.py): adding logging 2023-11-24 12:30:08 -08:00
Krrish Dholakia 12dbdc4c15 docs(simple_proxy.md): add tutorial for doing fallbacks + retries + timeouts on the proxy 2023-11-24 12:20:38 -08:00
Krrish Dholakia 3dcbf6197a test(test_router.py): reintegrate router testing 2023-11-24 11:48:24 -08:00
Krrish Dholakia c75e90663c test(test_stream_chunk_builder.py): fix setting api key 2023-11-24 11:47:48 -08:00
Krrish Dholakia 2e8d582a34 fix(proxy_server.py): fix linting issues 2023-11-24 11:39:01 -08:00
Krish Dholakia d3d8b86eaa Updated config.yml 2023-11-24 11:34:24 -08:00
Krrish Dholakia 4a5dae3941 fix(main.py): fix streaming_chunk_builder to return usage 2023-11-24 11:27:04 -08:00
ishaan-jaff 8edfcd8e5d (fix) prisma using: secrets.compare_digest 2023-11-24 10:02:08 -08:00
Ishaan JaffandGitHub 86e405c9ab Merge pull request #904 from Manouchehri/fix-auth-1
Fix OpenAPI auth spec.
2023-11-24 09:44:30 -08:00