3933 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Krrish Dholakia	4da20ac0b9	fix(proxy_server.py): accept max tokens as int	2023-12-01 15:19:34 -08:00
Krrish Dholakia	ac4429c35f	test(test_completion.py): commenting out flaky test	2023-12-01 15:06:54 -08:00
Krrish Dholakia	8c1439e910	fix: linting errors	2023-12-01 15:02:22 -08:00
ishaan-jaff	fc40e83783	(fix) linting	2023-12-01 14:51:44 -08:00
ishaan-jaff	455c915b70	(linting) fix	2023-12-01 14:34:15 -08:00
ishaan-jaff	73eb5a7718	(fix) linting	2023-12-01 14:08:19 -08:00
ishaan-jaff	24386c05aa	(fix) proxy: pydantic	2023-12-01 13:58:28 -08:00
ishaan-jaff	e8ae347681	(feat) proxy-pydantic,swagger for chat/completion	2023-12-01 13:50:51 -08:00
ishaan-jaff	e77b7e5a50	(docs) proxy: add tags=chat/completions + add response type	2023-12-01 10:00:48 -08:00
ishaan-jaff	2977d04f56	(fix) proxy: raise exceptions	2023-12-01 09:21:06 -08:00
ishaan-jaff	1e9aa69268	(fix) proxy: use orjson.loads()	2023-11-30 20:24:31 -08:00
ishaan-jaff	fb8ccdd422	(ci/cd) add orjson as a dep	2023-11-30 20:18:18 -08:00
ishaan-jaff	06805c7f47	(fix) formatting	2023-11-30 20:03:56 -08:00
ishaan-jaff	1081d4c766	(feat) aembedding: return raw openai response	2023-11-30 20:02:47 -08:00
ishaan-jaff	10d5ab8643	(feat) proxy: /embedding -> use ORJSON responses	2023-11-30 20:00:35 -08:00
ishaan-jaff	2d55cc753e	(feat) proxy: use orjson	2023-11-30 19:50:47 -08:00
ishaan-jaff	853af29a25	(test) load test embedding	2023-11-30 19:04:51 -08:00
ishaan-jaff	e1fe79e0c0	(docs) add embedding() profile	2023-11-30 19:04:51 -08:00
Krrish Dholakia	aa36bd2784	fix(utils.py): expand openai_token_counter selection	2023-11-30 18:51:51 -08:00
Krrish Dholakia	ff4457e2d2	fix(router.py): back-off if no models available	2023-11-30 18:42:29 -08:00
Krrish Dholakia	7b99cfe6b9	test(test_token_counter.py): include testing for function calls	2023-11-30 18:24:21 -08:00
Krrish Dholakia	7f04758bcb	(fix) support counting tokens for tool calls	2023-11-30 18:24:21 -08:00
Ishaan JaffandGitHub	854ffbe79a	Merge pull request #966 from PSU3D0/proxy_extras ... (feat) Allow installing proxy dependencies explicitly with `pip install litellm[proxy]`	2023-11-30 15:46:25 -08:00
Frank Colson	6fb178dc94	Update docs	2023-11-30 16:43:09 -07:00
Frank Colson	7ddfeb75bc	Add backwards compatability	2023-11-30 16:35:19 -07:00
Frank Colson	d557f3be74	Remove YAML dependency	2023-11-30 16:31:43 -07:00
Ishaan JaffandGitHub	8d39af11d6	Azure Deploy - fix startup command	2023-11-30 15:31:03 -08:00
Frank Colson	5e6913dff2	Use poetry extras for proxy	2023-11-30 16:23:34 -07:00
ishaan-jaff	0da78a64df	bump: version 1.9.3 → 1.9.4	2023-11-30 15:20:29 -08:00
ishaan-jaff	bc2299184b	(fix) proxy - don't overwrite metadata passed	2023-11-30 15:15:47 -08:00
Ishaan Jaff	f305c3aaef	Add or update the Azure App Service build and deployment workflow config	2023-11-30 14:56:41 -08:00
ishaan-jaff	afc1b2209b	(feat) docker - allow user to specify base image	2023-11-30 14:49:21 -08:00
ishaan-jaff	8c1a9f1c4e	(feat) add bedrock:llama2-70bchat	2023-11-30 14:41:19 -08:00
ishaan-jaff	95634bde76	bump: version 1.9.2 → 1.9.3	2023-11-30 14:30:12 -08:00
ishaan-jaff	f565e6249d	(feat) proxy: docker - use wheels for builds	2023-11-30 14:29:30 -08:00
ishaan-jaff	3b2bbc757e	(feat) add pip wheel - faster docker image builds	2023-11-30 14:20:30 -08:00
Krrish Dholakia	c473abde49	fix(azure.py): logging fix	2023-11-30 14:13:40 -08:00
Krrish Dholakia	10c522025f	bump: version 1.9.1 → 1.9.2	2023-11-30 14:09:06 -08:00
Krrish Dholakia	032f71adb2	fix(router.py): support cloudflare ai gateway for azure models on router	2023-11-30 14:09:06 -08:00
ishaan-jaff	936c27c9ee	(fix +test) langfuse log metadata	2023-11-30 13:53:43 -08:00
Krrish Dholakia	6475e0a916	bump: version 1.9.0 → 1.9.1	2023-11-30 13:45:38 -08:00
Krrish Dholakia	a5c99d8594	fix(langfuse.py): fix metadata logging for langfuse	2023-11-30 13:45:34 -08:00
ishaan-jaff	cc0df56bd6	(chore) remove old doc -> this is now Router	2023-11-30 13:33:17 -08:00
Krrish Dholakia	82553e8aac	fix(azure.py): fix linting errors	2023-11-30 13:32:29 -08:00
ishaan-jaff	9a1accfe2a	(chore) proxy: remove junk load test	2023-11-30 13:31:23 -08:00
Krrish Dholakia	1f3ef72a4b	bump: version 1.8.1 → 1.9.0	2023-11-30 13:19:49 -08:00
Krrish Dholakia	4f07c8565a	feat(main.py): add support for azure-openai via cloudflare ai gateway	2023-11-30 13:19:49 -08:00
ishaan-jaff	be8bdb580a	(test) proxy + router: add bursty load test	2023-11-30 13:17:11 -08:00
ishaan-jaff	a8a6838867	(docs) example: azure config.yaml	2023-11-30 13:16:41 -08:00
ishaan-jaff	97ff0caf70	(feat) proxy: config - azure allow users to pass in base_url	2023-11-30 10:56:55 -08:00