Krish Dholakia 3a73309006 Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) ...

* build(model_prices_and_context_window.json): add bedrock llama4 models to model cost map

* fix template conversion for Llama 4 models in Bedrock (#10557)

* test: add testing to repro https://github.com/BerriAI/litellm/pull/10557

* test: add unit testing

* test(test_main.py): refactor where test is kept

---------

Co-authored-by: aswny <87371411+aswny@users.noreply.github.com>

2025-05-06 16:06:24 -07:00

..

anthropic_interface

docs anthropic messages interface

2025-03-31 16:53:39 -07:00

assistants

Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423)

2025-04-29 21:27:37 -07:00

batch_completion

…

batches

Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423)

2025-04-29 21:27:37 -07:00

caching

Add customer + model per key level multi-instance tpm/rpm limiting (#10518)

2025-05-03 10:28:55 -07:00

experimental_mcp_client

fix types on tools.py

2025-03-29 16:48:15 -07:00

files

Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423)

2025-04-29 21:27:37 -07:00

fine_tuning

Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423)

2025-04-29 21:27:37 -07:00

integrations

fix typo (#10535)

2025-05-03 11:39:40 -07:00

litellm_core_utils

Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582)

2025-05-06 16:06:24 -07:00

llms

fix issue when databrick use external model, the delta could be empty content (#10540)

2025-05-05 21:18:45 -07:00

proxy

Add litellm-proxy CLI (#10478) (#10578)

2025-05-05 21:29:57 -07:00

realtime_api

Realtime API: Support 'base_model' cost tracking + show response in spend logs (if enabled) (#9897)

2025-04-10 21:24:45 -07:00

rerank_api

build(pyproject.toml): add new dev dependencies - for type checking (#9631)

2025-03-29 11:02:13 -07:00

responses

[Bug Fix] Responses API - fix for handling multiturn responses API sessions (#10415)

2025-04-29 17:22:47 -07:00

router_strategy

Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458)

2025-04-30 21:32:31 -07:00

router_utils

[Feat] Add Support for DELETE /v1/responses/{response_id} on OpenAI, Azure OpenAI (#10205)

2025-04-22 18:27:03 -07:00

secret_managers

Squashed commit of the following: (#9709)

2025-04-02 21:24:54 -07:00

types

[Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538)

2025-05-03 16:29:03 -07:00

vector_stores

[Docs] Using LiteLLM with vector stores / knowledge bases (#10534)

2025-05-03 11:28:33 -07:00

__init__.py

[Feat] v2 Custom Logger API Endpoints (#10575)

2025-05-05 16:57:55 -07:00

_logging.py

fix debug logs

2025-05-06 14:28:20 -07:00

_redis.py

Squashed commit of the following: (#9709)

2025-04-02 21:24:54 -07:00

_service_logger.py

clean up service metrics

2025-04-02 17:50:41 -07:00

_version.py

Virtual key based policies in Aim Guardrails (#9499)

2025-04-01 21:57:23 -07:00

budget_manager.py

Squashed commit of the following: (#9709)

2025-04-02 21:24:54 -07:00

constants.py

[Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538)

2025-05-03 16:29:03 -07:00

cost_calculator.py

Litellm dev 04 30 2025 p1 (#10462)

2025-04-30 22:11:12 -07:00

cost.json

…

exceptions.py

Litellm dev 04 30 2025 p1 (#10462)

2025-04-30 22:11:12 -07:00

main.py

[QA] Bedrock Vector Stores Integration - Allow using with registry + in OpenAI API spec with tools (#10516)

2025-05-03 08:30:38 -07:00

model_prices_and_context_window_backup.json

Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582)

2025-05-06 16:06:24 -07:00

mypy.ini

mypy tweaks (#10490)

2025-05-01 22:13:14 -07:00

py.typed

…

router.py

[Feat] Add GET, DELETE Responses endpoints on LiteLLM Proxy (#10297)

2025-04-24 17:34:26 -07:00

scheduler.py

Squashed commit of the following: (#9709)

2025-04-02 21:24:54 -07:00

timeout.py

…

utils.py

[Feat] v2 Custom Logger API Endpoints (#10575)

2025-05-05 16:57:55 -07:00