Georg WölfleinandGitHub dbfa8ec921 Fix end user cost tracking in the responses API (#15124) ...

#13860

2025-10-02 15:13:57 -07:00

..

anthropic_interface

…

assistants

…

batch_completion

…

batches

…

caching

[Performance] Reduce complexity of InMemoryCache.evict_cache from O(n*log(n)) to O(log(n)) (#15000)

2025-09-30 16:49:35 -07:00

completion_extras

…

endpoints/speech/speech_to_completion_bridge

…

experimental_mcp_client

fix: resolve regression with duplicate Mcp-Protocol-Version header

2025-09-30 07:12:56 +09:00

files

…

fine_tuning

…

google_genai

fix mypy check issues

2025-09-30 10:37:21 +08:00

images

…

integrations

Merge pull request #14799 from tyler-liner/chore/generation-name-opentelemetry

2025-10-01 21:39:38 -07:00

litellm_core_utils

Gitlab based Prompt manager (#14988)

2025-10-01 18:13:11 -07:00

llms

Add support for GPT 5 codex models (#14841)

2025-09-30 18:44:35 -07:00

passthrough

…

proxy

[Security Fix] fix: don't log JWT SSO token on .info() log (#15145)

2025-10-02 15:07:37 -07:00

realtime_api

…

rerank_api

…

responses

[Feat] Return Cost for Responses API Streaming requests (#15053)

2025-09-29 19:47:04 -07:00

router_strategy

fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046)

2025-09-29 15:49:46 -07:00

router_utils

…

secret_managers

fix: use fastuuid helper (#14903)

2025-09-25 15:47:01 -07:00

types

[Feat] Fixes to dynamic rate limiter v3 - add saturatation detection (#15119)

2025-10-01 18:35:34 -07:00

vector_stores

…

__init__.py

Gitlab based Prompt manager (#14988)

2025-10-01 18:13:11 -07:00

_logging.py

…

_redis.py

…

_service_logger.py

…

_uuid.py

Fix: revert fastuuid optional dependency, always use fastuuid in .__uid helper (#14941)

2025-09-26 09:14:20 -07:00

_version.py

…

budget_manager.py

…

constants.py

Initial addition of Lemonade provider.

2025-09-30 12:12:24 -06:00

cost_calculator.py

Removing get_model_info from Lemonade provider. Implemented get_models which gets hooked into get_valid_models litellm utility. Also, added a simple cost calculator implementation for Lemonade so calling cost_calculator.completion_cost() doesn't return an error when a model is not found in the model_cost json.

2025-09-30 12:12:24 -06:00

cost.json

…

exceptions.py

Revert "[Feature]: Replace HTTPException with ParallelRequestLimitError in pa…" (#15095)

2025-09-30 21:17:04 -07:00

main.py

Merge branch 'BerriAI:main' into gemini-adapter-fixes

2025-10-01 09:53:51 +08:00

model_prices_and_context_window_backup.json

[Security Fix] fix: don't log JWT SSO token on .info() log (#15145)

2025-10-02 15:07:37 -07:00

mypy.ini

fix mypy

2025-09-27 12:21:32 -07:00

py.typed

…

router.py

Merge branch 'BerriAI:main' into gemini-adapter-fixes

2025-10-01 09:53:51 +08:00

scheduler.py

…

timeout.py

…

utils.py

Fix end user cost tracking in the responses API (#15124)

2025-10-02 15:13:57 -07:00