fd4157cf71
docs add cerebras
2024-08-31 14:57:12 -07:00
017dd88910
test: skip test on end of life model
2024-08-31 14:50:12 -07:00
47ef1f9191
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
de9efe76ca
add cerebras api
2024-08-31 08:35:23 -07:00
cb6a0f0237
add cerebras config
2024-08-31 08:34:46 -07:00
3a72197e77
Merge pull request #5455 from BerriAI/litellm_vtx_add_input_type_mapping
...
[Feat] Vertex embeddings - map `input_type` to `text_type`
2024-08-30 17:03:04 -07:00
745bf3245a
Merge pull request #5458 from BerriAI/litellm_fix_allow_passthrough_as_llm_api
...
[Fix-Proxy-Auth] allow pass through routes as LLM API routes
2024-08-30 17:02:42 -07:00
11776dcda5
bump: version 1.44.12 → 1.44.13
2024-08-30 16:37:14 -07:00
36fda54970
allow pass through routes as LLM API routes
2024-08-30 16:08:44 -07:00
9f18aa4588
fix test_vertexai_embedding_embedding_latest_input_type
2024-08-30 15:57:44 -07:00
69dea613ca
ci/cd run again
2024-08-30 14:03:00 -07:00
9f87481ef0
docs add task type for vertex ai
2024-08-30 13:31:24 -07:00
541033ec7e
add VertexAITextEmbeddingConfig
2024-08-30 12:53:43 -07:00
bc45114c53
Merge pull request #5454 from BerriAI/litellm_refactor
...
[Refactor] Refactor vertex text to speech to be in vertex directory
2024-08-30 12:28:14 -07:00
518aa639fa
fix map input_type to task_type for vertex ai
2024-08-30 12:09:07 -07:00
7f303db955
Merge pull request #5450 from BerriAI/litellm_load_config_from_gcs
...
[Feat-Proxy] Load config.yaml from GCS Bucket
2024-08-30 12:08:54 -07:00
281b183c7c
Merge pull request #5452 from BerriAI/litellm_allow_qdrant_api_key_to_be_optional
...
[Fix-Proxy] - Allow Qdrant API Key to be optional
2024-08-30 12:07:57 -07:00
5056e1e400
Merge pull request #5451 from BerriAI/litellm_fix_vertex
...
[Fix-Proxy] Vertex SDK pass through - pass all relevant vertex creds
2024-08-30 11:45:16 -07:00
570a5a2825
fix dir structure for tts
2024-08-30 11:44:23 -07:00
15296b4fb7
fix allow qdrant api key to be optional
2024-08-30 11:13:23 -07:00
50014aa78e
vertex forward all headers from vertex
2024-08-30 11:05:23 -07:00
fcdfaac84b
Merge pull request #5419 from Manouchehri/gemini-1.5-pro-exp-0827-pricing
...
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-30 10:50:10 -07:00
a842723bb0
Merge pull request #5439 from BerriAI/litellm_use_correct_ai21_pricing
...
[Fix] Use correct Vertex AI AI21 Cost tracking
2024-08-30 10:49:42 -07:00
6109501274
update doc
2024-08-30 10:47:40 -07:00
c781fbcc55
doc using gcs bucket config.yaml
2024-08-30 10:44:41 -07:00
7d746064ab
add gcs bucket base
2024-08-30 10:41:39 -07:00
051ac50fca
use helper to get_config_file_contents_from_gcs
2024-08-30 10:26:42 -07:00
1bd2b2fc92
Merge pull request #5449 from BerriAI/litellm_Fix_vertex_multimodal
...
[Fix-Proxy] Allow running /health checks on vertex multimodal embedding requests
2024-08-30 10:21:42 -07:00
a6273a29fe
add test for test_vertexai_multimodal_embedding_text_input
2024-08-30 09:19:48 -07:00
8d6a0bdc81
- merge - fix TypeError: 'CompletionUsage' object is not subscriptable #5441 ( #5448 )
...
* fix TypeError: 'CompletionUsage' object is not subscriptable (#5441 )
* test(test_team_logging.py): mark flaky test
---------
Co-authored-by: yafei lee <yafei@dao42.com >
2024-08-30 08:54:42 -07:00
5b1d9712c5
chore: Clarify support-related Exceptions in utils.py ( #5447 )
...
Improved the clarity of Exceptions in supports_system_messages, supports_response_schema, supports_function_calling, and supports_parallel_function_calling. Previously, it was difficult to determine the cause of Exception logs due to vague messaging. Each case now includes a more specific and appropriate Exception message.
2024-08-30 08:29:05 -07:00
7f1531006c
docs(routing.md): add weight-based shuffling to docs
2024-08-30 08:24:12 -07:00
94db4ec830
test: mark flaky tests
2024-08-30 07:53:04 -07:00
fdaaea9b0d
add tests to check ai21 models cost is calculated correct
2024-08-30 07:30:16 -07:00
a9ca183021
Merge pull request #5438 from BerriAI/litellm_show_error_types_swagger
...
[Feat-Proxy] Show all exceptioons types on swagger for LiteLLM Proxy
2024-08-30 07:21:23 -07:00
ef7835f7f3
Merge pull request #5442 from kiriloman/main
...
[Pricing] Add pricing for Openai ft:gpt-4o
2024-08-30 07:19:30 -07:00
a100b01b90
Add pricing for Openai ft:gpt-4o
2024-08-30 08:16:24 +01:00
856ed40a07
bump: version 1.44.11 → 1.44.12
2024-08-29 22:41:10 -07:00
dd7b008161
fix: Minor LiteLLM Fixes + Improvements (29/08/2024) ( #5436 )
...
* fix(model_checks.py): support returning wildcard models on `/v1/models`
Fixes https://github.com/BerriAI/litellm/issues/4903
* fix(bedrock_httpx.py): support calling bedrock via api_base
Closes https://github.com/BerriAI/litellm/pull/4587
* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked
Fixes https://github.com/BerriAI/litellm/issues/5433
* feat(router.py): support setting 'weight' param for models on router
Closes https://github.com/BerriAI/litellm/issues/5410
* test(test_bedrock_completion.py): add unit test for custom api base
* fix(model_checks.py): handle no "/" in model
2024-08-29 22:40:25 -07:00
f70b7575d2
update docs
2024-08-29 21:00:10 -07:00
6bd6c956a5
use correct vtx ai21 pricing
2024-08-29 19:04:05 -07:00
26c03c9c8b
add pricing for vertex ai 21
2024-08-29 19:03:38 -07:00
ad88c7d0a8
show all error types on swagger
2024-08-29 18:50:41 -07:00
ef47b2bc87
mark test_cost_tracking_with_caching as flaky
2024-08-29 17:44:21 -07:00
d57f5a955e
bump: version 1.44.10 → 1.44.11
2024-08-29 17:37:01 -07:00
9444b34711
Merge pull request #5432 from BerriAI/litellm_add_tag_control_team
...
[Feat-Proxy] Set tags per team - (use tag based routing for team)
2024-08-29 17:34:58 -07:00
e329c4509a
Merge branch 'main' into litellm_add_tag_control_team
2024-08-29 17:34:40 -07:00
ef16738720
Merge pull request #5435 from BerriAI/litellm_fwd_vtx_sdk_headers
...
[Feat-Proxy] Pass through Vertex Endpoint - allow forwarding vertex credentials
2024-08-29 17:24:35 -07:00
010f526226
Merge branch 'main' into litellm_fwd_vtx_sdk_headers
2024-08-29 17:24:31 -07:00
a4b88c16dc
fix indentation
2024-08-29 17:01:23 -07:00
Ishaan Jaff