Commit Graph

17246 Commits

Author SHA1 Message Date
Ishaan Jaff d4f77832c0 docs add docs on supported params 2024-09-02 12:39:07 -07:00
Ishaan Jaff f28e94827c docs update ai21 doc 2024-09-02 12:26:53 -07:00
Ishaan Jaff 93650db380 fix linting 2024-09-02 12:15:14 -07:00
Ishaan Jaff 263e283126 add ai21 model test 2024-09-02 12:14:13 -07:00
Ishaan Jaff ae25c5695f add streaming test for ai21 2024-09-02 11:58:15 -07:00
Ishaan Jaff 0874885f04 add all ai21 params 2024-09-02 11:54:40 -07:00
Ishaan Jaff 0970475a3b test ai21 2024-09-02 11:47:48 -07:00
Ishaan Jaff af0d2d1f3b refactor ai21 2024-09-02 11:47:04 -07:00
Ishaan Jaff 05d92e34a3 add ai21 provider 2024-09-02 11:45:27 -07:00
Ishaan Jaff 82eacf2106 add ai21_chat as new provider 2024-09-02 11:44:06 -07:00
Ishaan Jaff 40bfb21693 docs - update /health docs to show correct info 2024-09-02 08:54:19 -07:00
David Manouchehri 47e664a5da (gemini): Fix Cloudflare AI Gateway typo. (#5429) 2024-09-02 07:52:18 -07:00
Krrish Dholakia 41114f1c25 docs(security.md): Adds security.md file to project root
Closes https://github.com/BerriAI/litellm/issues/5473
2024-09-02 07:41:29 -07:00
Krish Dholakia e0d81434ed LiteLLM minor fixes + improvements (31/08/2024) (#5464)
* fix(vertex_endpoints.py): fix vertex ai pass through endpoints

* test(test_streaming.py): skip model due to end of life

* feat(custom_logger.py): add special callback for model hitting tpm/rpm limits

Closes https://github.com/BerriAI/litellm/issues/4096
2024-09-01 13:31:42 -07:00
Simon S. Viloria 7778fa0146 fix response_format={'type': 'json_object'} not working for Azure models (#5468) 2024-09-01 13:31:13 -07:00
Krish Dholakia 37f9705d6e Bedrock Embeddings refactor + model support (#5462)
* refactor(bedrock): initial commit to refactor bedrock to a folder

Improve code readability + maintainability

* refactor: more refactor work

* fix: fix imports

* feat(bedrock/embeddings.py): support translating embedding into amazon embedding formats

* fix: fix linting errors

* test: skip test on end of life model

* fix(cohere/embed.py): fix linting error

* fix(cohere/embed.py): fix typing

* fix(cohere/embed.py): fix post-call logging for cohere embedding call

* test(test_embeddings.py): fix error message assertion in test
2024-09-01 13:29:58 -07:00
Krish Dholakia 6fb82aaf75 Minor LiteLLM Fixes and Improvements (#5456)
* fix(utils.py): support 'drop_params' for embedding requests

Fixes https://github.com/BerriAI/litellm/issues/5444

* feat(vertex_ai_non_gemini.py): support function param in messages

* test: skip test - model end of life

* fix(vertex_ai_non_gemini.py): fix gemini history parsing
v1.44.14-stable v1.44.14
2024-08-31 17:58:10 -07:00
Ishaan Jaff 54b60a9afd bump: version 1.44.13 → 1.44.14 2024-08-31 16:55:37 -07:00
Ishaan Jaff d9f3ac5159 Merge pull request #5463 from BerriAI/litellm_track_error_per_model
[Feat - Prometheus] - Track error_code, model metric
2024-08-31 16:36:04 -07:00
Ishaan Jaff 3e4e72ff1b Merge pull request #5461 from BerriAI/litellm_add_cerebras
[Feat] New Provider - Add Cerebras AI API
2024-08-31 16:30:56 -07:00
Ishaan Jaff 56f10224df Merge pull request #5457 from BerriAI/litellm_track_spend_logs_for_vertex_pass_through_endpoints
[Feat-Proxy] track spend logs for vertex pass through endpoints
2024-08-31 16:30:15 -07:00
Ishaan Jaff 4bd85b9d83 add cerebras cost tracking 2024-08-31 16:29:26 -07:00
Ishaan Jaff 9a3873b9ed mark flaky test as flaky 2024-08-31 15:02:56 -07:00
Ishaan Jaff fd4157cf71 docs add cerebras 2024-08-31 14:57:12 -07:00
Krrish Dholakia 336022e97c test: skip test on end of life model 2024-08-31 14:50:52 -07:00
Krish Dholakia 65a9c933ad anthropic prompt caching cost tracking (#5453)
* fix(utils.py): support 'drop_params' for embedding requests

Fixes https://github.com/BerriAI/litellm/issues/5444

* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic

* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out

* fix: fix linting errors

* test: mark flaky test
2024-08-31 14:50:52 -07:00
Krrish Dholakia 017dd88910 test: skip test on end of life model 2024-08-31 14:50:12 -07:00
Krish Dholakia 47ef1f9191 anthropic prompt caching cost tracking (#5453)
* fix(utils.py): support 'drop_params' for embedding requests

Fixes https://github.com/BerriAI/litellm/issues/5444

* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic

* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out

* fix: fix linting errors

* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff 2e0ee8c72f skip end of life model in test 2024-08-31 14:48:52 -07:00
Ishaan Jaff e6faaba56e docs add litellm_error_code_metric_total 2024-08-31 14:46:41 -07:00
Krrish Dholakia f450b99368 test: skip test on end of life model 2024-08-31 14:34:16 -07:00
Krish Dholakia 9c8f1d7815 anthropic prompt caching cost tracking (#5453)
* fix(utils.py): support 'drop_params' for embedding requests

Fixes https://github.com/BerriAI/litellm/issues/5444

* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic

* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out

* fix: fix linting errors

* test: mark flaky test
2024-08-31 14:09:35 -07:00
Ishaan Jaff 6ab601432b feat prometheus add metric for failure / model 2024-08-31 10:05:23 -07:00
Ishaan Jaff b8bc448479 ci/cd run again 2024-08-31 09:42:58 -07:00
Ishaan Jaff 9e557ed072 fix test 2024-08-31 08:39:52 -07:00
Ishaan Jaff de9efe76ca add cerebras api 2024-08-31 08:35:23 -07:00
Ishaan Jaff cb6a0f0237 add cerebras config 2024-08-31 08:34:46 -07:00
Ishaan Jaff b35bfb0302 fix cost tracking for vertex ai native 2024-08-31 08:22:27 -07:00
Ishaan Jaff 3a72197e77 Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping
[Feat] Vertex embeddings - map `input_type` to `text_type`
v1.44.13-stable v1.44.13
2024-08-30 17:03:04 -07:00
Ishaan Jaff 745bf3245a Merge pull request #5458 from BerriAI/litellm_fix_allow_passthrough_as_llm_api
[Fix-Proxy-Auth] allow pass through routes as LLM API routes
2024-08-30 17:02:42 -07:00
Ishaan Jaff 06857d108d fix /spend logs call 2024-08-30 17:02:24 -07:00
Ishaan Jaff 2c86a62474 fix vertex ai test 2024-08-30 16:50:23 -07:00
Ishaan Jaff f43060e8df mark as async 2024-08-30 16:40:41 -07:00
Ishaan Jaff 11776dcda5 bump: version 1.44.12 → 1.44.13 2024-08-30 16:37:14 -07:00
Ishaan Jaff 414d2dcb52 call spend logs endpoint 2024-08-30 16:35:07 -07:00
Ishaan Jaff c86d1cb391 fix tests 2024-08-30 16:29:32 -07:00
Ishaan Jaff f3f85f6141 add test for vertex basic pass throgh 2024-08-30 16:26:00 -07:00
Ishaan Jaff 8ed0ffea54 fix use existing custom_auth.py 2024-08-30 16:22:28 -07:00
Ishaan Jaff 36fda54970 allow pass through routes as LLM API routes 2024-08-30 16:08:44 -07:00
Ishaan Jaff 9f18aa4588 fix test_vertexai_embedding_embedding_latest_input_type 2024-08-30 15:57:44 -07:00