tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-16 16:17:26 +00:00
Code Issues Packages Projects Releases Wiki Activity
26,119 Commits 2,072 Branches 1,425 Tags
ff4eda0ea67730da3363f2d151decb9ee3ce4e9c
Commit Graph
88 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 54095a256a Merge pull request #15015 from anthony-liner/fix/langfuse-total-tokens 
fix: set usage_details.total in langfuse integration
 2025-10-02 17:33:43 -07:00
Krish DholakiaandGitHub f6b67fd9bd Merge pull request #14799 from tyler-liner/chore/generation-name-opentelemetry 
fix (opentelemetry): use generation_name for span naming in logging method
 2025-10-01 21:39:38 -07:00
Deepanshu LullaGitHubdeepanshu
 		68adca04c8 Gitlab based Prompt manager (#14988) 
* add prompt

* add prompt

* add prompt

* add prompt

* add prompt management via gitlab

* gitlab client

* gitlab client

* gitlab client

* fix lint issues

* fix lint issues

* remove router changes

---------

Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
 2025-10-01 18:13:11 -07:00
anthony-liner 9ca73d5504 fix: set usage_details.total in langfuse integration 2025-09-29 16:30:44 +09:00
Sameer KankuteandGitHub 1681bf7175 (Feat) Add BitBucket Integration for Prompt Management (#14882) 
* Add bitbucket integration for prompt management

* remove not needed file

* remove not needed file

* Add the correct readme

* Add the correct readme

* fix test for bitbucket

* fix test for bitbucket
 2025-09-25 15:51:00 -07:00
Alexsander HamirandGitHub eaa04cd8ce fix: use fastuuid helper (#14903) 
* fix: use fastuuid helper across the codebase

First batch of changes, simple drop in replacement.

* second batch of changes

* fixed: script mistake on helper file
 2025-09-25 15:47:01 -07:00
tyler-liner 47800757fd feat(opentelemetry): use generation_name for span naming in logging method 2025-09-23 15:53:41 +09:00
Fabrício CeschinandGitHub f0490ab60d Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-19 13:54:56 -04:00
Krish DholakiaandGitHub 664c83cfb5 Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2 2025-09-18 19:50:55 -07:00
katsuhiro mutoandGitHub ec61a7152a Support for is_streamed_request widh datadog (#14673) 2025-09-18 15:55:16 -07:00
Krrish Dholakia adc71ad2e7 fix(langsmith.py): add langsmith_sampling_rate as a dynamic param 
Closes LIT-879
 2025-09-17 17:32:26 -07:00
Fabrício CeschinandGitHub 9fdbdaf846 Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-17 09:36:08 -04:00
Krish DholakiaandGitHub fcf84027e8 Merge pull request #14555 from mubashir1osmani/dd_spend_metric 
DataDog shows spend metrics
 2025-09-16 22:44:47 -07:00
Mubashir OsmaniandGitHub 0fde408e35 added langfuse logging for responses api (#14597) 
* added langfuse logging for responses api

* tests added
 2025-09-16 21:43:19 -07:00
mubashir1osmani e56b11cb54 added tests 2025-09-17 00:19:03 -04:00
mubashir1osmani f5f00043ce fixed tests 2025-09-16 00:14:48 -04:00
Fabrício CeschinandGitHub c5aa6f540f Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-15 15:51:38 -04:00
Mubashir OsmaniandGitHub 321d5299b2 s3_endpoint_url returned 404 (#14559) 
* added spend metrics

* feat: Add Spend metrics in datadog

* fix: lint errors

* fix: s3 endpoint url logging

* fixed lint errors

* remove from branch

This reverts commit e123cae06e.

* Remove from branch

This reverts commit e694cc102a.

* remove "added spend metrics"

This reverts commit 6156590190.
 2025-09-15 12:08:18 -07:00
Fabrício CeschinandGitHub 1a715b2eb3 Merge branch 'BerriAI:main' into LangfuseUsageDetails 2025-09-15 09:20:27 -04:00
mubashir1osmani e694cc102a feat: Add Spend metrics in datadog 2025-09-14 14:42:26 -04:00
Krish DholakiaandGitHub 510332b886 Merge pull request #14491 from Rasmusafj/main 
Resolve cache key collision issue where all soft budget alerts use identical cache keys
 2025-09-14 00:51:27 -07:00
Krish DholakiaandGitHub dc4bbba0a5 Merge pull request #14520 from boopesh07/email_prometheus 
Added user_email labels to the prometheus monitoring.
 2025-09-13 23:19:46 -07:00
mubashir1osmani 6156590190 added spend metrics 2025-09-13 01:38:08 -04:00
mubashir1osmani fd11159148 fix: DD tool calls passed in metadata 2025-09-13 00:11:18 -04:00
boopesh07 36299dbc73 Added user_email labels to the prometheus monitoring. 2025-09-12 15:38:23 -07:00
rasmus.arpe@gmail.comandruek b8c362e443 add tests for the fix 2025-09-12 12:07:08 +02:00
Fabricio Ceschin faaae888f1 Merge conflicts 2025-09-08 11:34:45 -04:00
Ishaan Jaff b1552cae46 fix mocked CZ tests 2025-09-06 14:33:02 -07:00
Ishaan Jaff fc7accad74 test_dry_run_export_usage_data_cbf_transformation_failure 2025-09-06 13:59:28 -07:00
Ishaan JaffandGitHub 5310bba35b [Feat] Litellm x CloudZero Integration - Cost Tracking (#14296) 
* fix: just pull LiteLLM_DailyUserSpend

* get the team_id from user daily spend table

* cloudzero_dry_run_export

* fix CZ endpoints

* trace entity_id

* fix: get_usage_data

* fix get_usage_data

* fix _create_cbf_record

* fix get_usage_data

* ensure start and end time is used for exporting data

* fix init_cloudzero_background_job

* fix CloudZeroExportRequest

* fix initialize_cloudzero_export_job

* fix initialize_cloudzero_export_job

* allow init with env + config.yaml for cloudzero

* fix: init CZ through config.yaml

* fix DRY run on CZ

* TestCloudZeroDryRunEndpoint

* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES

* fix init_cloudzero_background_job

* fix exporting data

* fix transform

* stash cloudzero docs

* docs: CloudZero

* ruff fix

* fix rendering key alias

* fix polars
 2025-09-05 21:29:41 -07:00
Ishaan Jaff 0a60390521 Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table (#12922)" 
This reverts commit e3b752d3dc.
 2025-09-05 10:04:07 -07:00
Krish DholakiaandGitHub 62d4623d1c Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic 
feat: Add guardrail to the Anthropic API endpoint
 2025-09-04 20:50:43 -07:00
Ishaan JaffandGitHub 1352545617 [Fix] DD LLM Observability - Ensure apm_id is set on traces (#14272) 
* add apm_id for DD LLM

* feat: add _get_apm_trace_id
 2025-09-04 14:35:41 -07:00
Krish DholakiaandGitHub 35b501b8d5 Merge pull request #14176 from mjmendo/feat/alert_type_in_slack_message 
feat: added alert type to alert messate to slack for easier handling
 2025-09-02 23:05:41 -07:00
Marcelo Mendoza db1b418b15 fix: update alert type formatting to handle enum names in Slack messages 2025-09-02 17:54:54 +02:00
Keith Decker 5dcdbb35da add metrics and logs (events) with semconv attributes 2025-09-02 09:20:25 -06:00
Marcelo Mendoza 92f631d57c fix: correct formatting of alert messages in Slack notifications 2025-09-02 15:12:11 +00:00
Krrish Dholakia 4a422ca897 fix: support logging dynamic metadata values to braintrust 2025-09-01 17:38:15 -07:00
Yuta Saito d83c420d48 feat: Add guardrail for the Anthropic API endpoint 2025-08-31 16:44:01 +09:00
Krish DholakiaandGitHub ead7e7259b Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token 
[Bug]: Set user from token user_id for OpenMeter integration
 2025-08-29 22:21:26 -07:00
Ishaan JaffandGitHub 165242e31f [Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host (#14013) 
* feat - add _get_langfuse_otel_host

* test_get_langfuse_otel_config_with_otel_host_priority

* docs: LANGFUSE_OTEL_HOST
 2025-08-27 14:43:47 -07:00
Cole FrenchandGitHub 6696955506 [Bug]: Fix tests to reference moved attributes in braintrust_logging module (#13978) 
* Mock instance attribute moved from globals

* Support looking up mock message on mock choice
 2025-08-26 18:58:16 -07:00
Krish DholakiaandGitHub ae678a6642 Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata 
Feature/braintrust span name metadata
 2025-08-25 23:19:56 -07:00
Tomu Hirata 5879f6e930 comment 2025-08-20 15:46:53 +09:00
Tomu Hirata d64b579131 Include predicted output in tracing 
Signed-off-by: Tomu Hirata <tomu.hirata@gmail.com>
 2025-08-20 15:39:32 +09:00
Ishaan JaffandGitHub 195ea6515e [Feat] Datadog LLM Observability - Add support for tracing guardrail input/output (#13767) 
* add guardrail information on DD LLM Obs

* test_guardrail_information_in_metadata
 2025-08-19 10:26:25 -07:00
Ishaan JaffandGitHub ba1d2e8749 [Feat] DD LLM Observability - Add time to first token, litellm overhead, guardrail overhead latency metrics (#13734) 
* fixes for DDLLMObsLatencyMetrics

* use _get_latency_metrics

* DD LLM Obs - track latency metrics

* fixes for bedrock guardrails

* DD unit tests

* test DD
 2025-08-18 17:38:04 -07:00
Ishaan JaffandGitHub ef08e18c66 [Feat] Datadog LLM Observability - Add support for Failure Logging (#13726) 
* add async_log_failure_event for DD LLM Obs

* update types

* DataDogLLMObsLogger  add failure logging support

* test_async_log_failure_event

* dd test failure
 2025-08-18 15:19:48 -07:00
TomuHirataandGitHub f6e53deacd Update mlflow logger usage span attributes (#13561) 
* test: sync mlflow request tags

* fix test
 2025-08-14 15:20:50 -07:00
nielsbosma fe54da79a1 test(braintrust-logging): add span_name tests for events 
Add tests to verify custom and default span_name in BraintrustLogger,
including async, metadata merging, and span name behavior.
 2025-08-13 12:26:14 +02:00