Krish Dholakia 4330ef8e81 Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077) ...

* feat(batches/): fix batch cost calculation - ensure it's accurate

use the correct cost value - prev. defaulting to non-batch cost

* feat(batch_utils.py): log batch models to spend logs + standard logging payload

makes it easy to understand how cost was calculated

* fix: fix stored payload for test

* test: fix test

2025-03-08 11:47:25 -08:00

..

gcs_pub_sub_body

Fix batches api cost tracking + Log batch models in spend logs / standard logging payload (#9077)

2025-03-08 11:47:25 -08:00

langfuse_expected_request_body

(Bug Fix - Langfuse) - fix for when model response has choices=[] (#8339)

2025-02-06 18:02:26 -08:00

base_test.py

Litellm dev 11 11 2024 (#6693)

2024-11-12 00:16:35 +05:30

conftest.py

(refactor) use helper function _assemble_complete_response_from_streaming_chunks to assemble complete responses in caching and logging callbacks (#6220)

2024-10-15 12:45:12 +05:30

create_mock_standard_logging_payload.py

(fixes) datadog logging - handle 1MB max log size on DD (#6996)

2024-12-02 23:01:42 -08:00

gettysburg.wav

(Testing) - Add e2e testing for langfuse logging with tags (#7922)

2025-01-22 09:09:25 -08:00

test_alerting.py

(Feat) soft budget alerts on keys (#7623)

2025-01-07 21:36:34 -08:00

test_amazing_s3_logs.py

(Feat) Add x-litellm-overhead-duration-ms and "x-litellm-response-duration-ms" in response from LiteLLM (#7899)

2025-01-21 20:27:55 -08:00

test_assemble_streaming_responses.py

[Bug Fix]: ImportError: cannot import name 'T' from 're' (#7314)

2024-12-19 13:09:30 -08:00

test_azure_blob_storage.py

(feat) Add Azure Blob Storage Logging Integration (#7265)

2024-12-16 22:18:22 -08:00

test_custom_guardrail.py

test: update test

2025-02-10 22:13:58 -08:00

test_datadog_llm_obs.py

Litellm dev bedrock anthropic 3 7 v2 (#8843)

2025-02-26 16:05:33 -08:00

test_datadog.py

(Feat) datadog_llm_observability callback - emit request_tags on logs (#7883)

2025-01-20 20:36:27 -08:00

test_gcs_pub_sub.py

(Feat) - Add GCS Pub/Sub Logging integration for sending DB SpendLogs to BigQuery (#7976)

2025-01-24 20:57:20 -08:00

test_humanloop_unit_tests.py

HumanLoop integration for Prompt Management (#7479)

2024-12-30 22:26:03 -08:00

test_langfuse_e2e_test.py

(Bug Fix - Langfuse) - fix for when model response has choices=[] (#8339)

2025-02-06 18:02:26 -08:00

test_langfuse_unit_tests.py

Litellm dev bedrock anthropic 3 7 v2 (#8843)

2025-02-26 16:05:33 -08:00

test_langsmith_unit_test.py

(Bug fix) - don't log messages in model_parameters in StandardLoggingPayload (#8932)

2025-03-01 13:39:45 -08:00

test_log_db_redis_services.py

LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037)

2024-12-05 00:02:31 -08:00

test_logging_redaction_e2e_test.py

Litellm dev 01 02 2025 p1 (#7516)

2025-01-03 14:40:57 -08:00

test_opentelemetry_unit_tests.py

Litellm dev 11 11 2024 (#6693)

2024-11-12 00:16:35 +05:30

test_otel_logging.py

Improved wildcard route handling on /models and /model_group/info (#8473)

2025-02-11 19:37:43 -08:00

test_pagerduty_alerting.py

(Feat) - Add PagerDuty Alerting Integration (#7478)

2025-01-01 07:12:51 -08:00

test_prometheus_unit_tests.py

build: merge branch

2025-03-02 08:31:57 -08:00

test_spend_logs.py

(UI) Error Logs improvements - Store Raw proxy server request for success and failure (#8917)

2025-03-01 16:26:47 -08:00

test_standard_logging_payload.py

(Feat) - Show Error Logs on LiteLLM UI (#8904)

2025-02-28 20:10:09 -08:00

test_token_counting.py

(Bug Fix) - Accurate token counting for /anthropic/ API Routes on LiteLLM Proxy (#8880)

2025-02-27 15:43:03 -08:00

test_unit_test_litellm_logging.py

(performance improvement - litellm sdk + proxy) - ensure litellm does not create unnecessary threads when running async functions (#7680)

2025-01-10 17:57:22 -08:00

test_unit_tests_init_callbacks.py

Support arize phoenix on litellm proxy (#7756) (#8715)

2025-02-22 20:55:11 -08:00

test_view_request_resp_logs.py

(Feat) - Allow viewing Request/Response Logs stored in GCS Bucket (#8449)

2025-02-10 20:38:55 -08:00