fbe3c58372
Added a guide for users who want to use LiteLLM with AI/ML API. ( #7058 )
...
* Added a guide for users who want to use LiteLLM with AI/ML.
* Minor changes
* Minor changes
* Fix sidebars.js
---------
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
2025-02-05 06:20:35 -08:00
3f053fc99c
Update MLflow calllback and documentation ( #7809 )
...
* Update MLlfow tracer
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* doc update
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* doc update
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* image rename
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
---------
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
2025-01-21 20:56:48 -08:00
bc31d8ed6b
typo fix README.md ( #7879 )
2025-01-20 10:50:35 -08:00
c4780479a9
Litellm dev 01 10 2025 p2 ( #7679 )
...
* test(test_basic_python_version.py): assert all optional dependencies are marked as extras on poetry
Fixes https://github.com/BerriAI/litellm/issues/7677
* docs(secret.md): clarify 'read_and_write' secret manager usage on aws
* docs(secret.md): fix doc
* build(ui/teams.tsx): add edit/delete button for updating user / team membership on ui
allows updating user role to admin on ui
* build(ui/teams.tsx): display edit member component on ui, when edit button on member clicked
* feat(team_endpoints.py): support updating team member role to admin via api endpoints
allows team member to become admin post-add
* build(ui/user_dashboard.tsx): if team admin - show all team keys
Fixes https://github.com/BerriAI/litellm/issues/7650
* test(config.yml): add tomli to ci/cd
* test: don't call python_basic_testing in local testing (covered by python 3.13 testing)
2025-01-10 21:50:53 -08:00
30a90a07b2
Update README.md
2024-12-16 08:36:57 -08:00
f4b5a491b6
docs: document code quality ( #7149 )
...
* docs: document code quality
* build(readme.md): cleanup
2024-12-10 15:44:59 -08:00
6bb934c0ac
fix(key_management_endpoints.py): override metadata field value on up… ( #7008 )
...
* fix(key_management_endpoints.py): override metadata field value on update
allow user to override tags
* feat(__init__.py): expose new disable_end_user_cost_tracking_prometheus_only metric
allow disabling end user cost tracking on prometheus - fixes cardinality issue
* fix(litellm_pre_call_utils.py): add key/team level enforced params
Fixes https://github.com/BerriAI/litellm/issues/6652
* fix(key_management_endpoints.py): allow user to pass in `enforced_params` as a top level param on /key/generate and /key/update
* docs(enterprise.md): add docs on enforcing required params for llm requests
* Add support of Galadriel API (#7005 )
* fix(router.py): robust retry after handling
set retry after time to 0 if >0 healthy deployments. handle base case = 1 deployment
* test(test_router.py): fix test
* feat(bedrock/): add support for 'nova' models
also adds explicit 'converse/' route for simpler routing
* fix: fix 'supports_pdf_input'
return if model supports pdf input on get_model_info
* feat(converse_transformation.py): support bedrock pdf input
* docs(document_understanding.md): add document understanding to docs
* fix(litellm_pre_call_utils.py): fix linting error
* fix(init.py): fix passing of bedrock converse models
* feat(bedrock/converse): support 'response_format={"type": "json_object"}'
* fix(converse_handler.py): fix linting error
* fix(base_llm_unit_tests.py): fix test
* fix: fix test
* test: fix test
* test: fix test
* test: remove duplicate test
---------
Co-authored-by: h4n0 <4738254+h4n0@users.noreply.github.com >
2024-12-03 23:03:50 -08:00
3beecfb0d4
LiteLLM Minor Fixes & Improvements (11/13/2024) ( #6729 )
...
* fix(utils.py): add logprobs support for together ai
Fixes
https://github.com/BerriAI/litellm/issues/6724
* feat(pass_through_endpoints/): add anthropic/ pass-through endpoint
adds new `anthropic/` pass-through endpoint + refactors docs
* feat(spend_management_endpoints.py): allow /global/spend/report to query team + customer id
enables seeing spend for a customer in a team
* Add integration with MLflow Tracing (#6147 )
* Add MLflow logger
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* Streaming handling
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* lint
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* address comments and fix issues
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* address comments and fix issues
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* Move logger construction code
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* Add docs
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* async handlers
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* new picture
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
---------
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
* fix(mlflow.py): fix ruff linting errors
* ci(config.yml): add mlflow to ci testing
* fix: fix test
* test: fix test
* Litellm key update fix (#6710 )
* fix(caching): convert arg to equivalent kwargs in llm caching handler
prevent unexpected errors
* fix(caching_handler.py): don't pass args to caching
* fix(caching): remove all *args from caching.py
* fix(caching): consistent function signatures + abc method
* test(caching_unit_tests.py): add unit tests for llm caching
ensures coverage for common caching scenarios across different implementations
* refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one
* fix(router.py): drop redis password requirement
* fix(proxy_server.py): fix faulty slack alerting check
* fix(langfuse.py): avoid copying functions/thread lock objects in metadata
fixes metadata copy error when parent otel span in metadata
* test: update test
* fix(key_management_endpoints.py): fix /key/update with metadata update
* fix(key_management_endpoints.py): fix key_prepare_update helper
* fix(key_management_endpoints.py): reset value to none if set in key update
* fix: update test
'
* Litellm dev 11 11 2024 (#6693 )
* fix(__init__.py): add 'watsonx_text' as mapped llm api route
Fixes https://github.com/BerriAI/litellm/issues/6663
* fix(opentelemetry.py): fix passing parallel tool calls to otel
Fixes https://github.com/BerriAI/litellm/issues/6677
* refactor(test_opentelemetry_unit_tests.py): create a base set of unit tests for all logging integrations - test for parallel tool call handling
reduces bugs in repo
* fix(__init__.py): update provider-model mapping to include all known provider-model mappings
Fixes https://github.com/BerriAI/litellm/issues/6669
* feat(anthropic): support passing document in llm api call
* docs(anthropic.md): add pdf anthropic call to docs + expose new 'supports_pdf_input' function
* fix(factory.py): fix linting error
* add clear doc string for GCS bucket logging
* Add docs to export logs to Laminar (#6674 )
* Add docs to export logs to Laminar
* minor fix: newline at end of file
* place laminar after http and grpc
* (Feat) Add langsmith key based logging (#6682 )
* add langsmith_api_key to StandardCallbackDynamicParams
* create a file for langsmith types
* langsmith add key / team based logging
* add key based logging for langsmith
* fix langsmith key based logging
* fix linting langsmith
* remove NOQA violation
* add unit test coverage for all helpers in test langsmith
* test_langsmith_key_based_logging
* docs langsmith key based logging
* run langsmith tests in logging callback tests
* fix logging testing
* test_langsmith_key_based_logging
* test_add_callback_via_key_litellm_pre_call_utils_langsmith
* add debug statement langsmith key based logging
* test_langsmith_key_based_logging
* (fix) OpenAI's optional messages[].name does not work with Mistral API (#6701 )
* use helper for _transform_messages mistral
* add test_message_with_name to base LLMChat test
* fix linting
* add xAI on Admin UI (#6680 )
* (docs) add benchmarks on 1K RPS (#6704 )
* docs litellm proxy benchmarks
* docs GCS bucket
* doc fix - reduce clutter on logging doc title
* (feat) add cost tracking stable diffusion 3 on Bedrock (#6676 )
* add cost tracking for sd3
* test_image_generation_bedrock
* fix get model info for image cost
* add cost_calculator for stability 1 models
* add unit testing for bedrock image cost calc
* test_cost_calculator_with_no_optional_params
* add test_cost_calculator_basic
* correctly allow size Optional
* fix cost_calculator
* sd3 unit tests cost calc
* fix raise correct error 404 when /key/info is called on non-existent key (#6653 )
* fix raise correct error on /key/info
* add not_found_error error
* fix key not found in DB error
* use 1 helper for checking token hash
* fix error code on key info
* fix test key gen prisma
* test_generate_and_call_key_info
* test fix test_call_with_valid_model_using_all_models
* fix key info tests
* bump: version 1.52.4 → 1.52.5
* add defaults used for GCS logging
* LiteLLM Minor Fixes & Improvements (11/12/2024) (#6705 )
* fix(caching): convert arg to equivalent kwargs in llm caching handler
prevent unexpected errors
* fix(caching_handler.py): don't pass args to caching
* fix(caching): remove all *args from caching.py
* fix(caching): consistent function signatures + abc method
* test(caching_unit_tests.py): add unit tests for llm caching
ensures coverage for common caching scenarios across different implementations
* refactor(litellm_logging.py): move to using cache key from hidden params instead of regenerating one
* fix(router.py): drop redis password requirement
* fix(proxy_server.py): fix faulty slack alerting check
* fix(langfuse.py): avoid copying functions/thread lock objects in metadata
fixes metadata copy error when parent otel span in metadata
* test: update test
* bump: version 1.52.5 → 1.52.6
* (feat) helm hook to sync db schema (#6715 )
* v0 migration job
* fix job
* fix migrations job.yml
* handle standalone DB on helm hook
* fix argo cd annotations
* fix db migration helm hook
* fix migration job
* doc fix Using Http/2 with Hypercorn
* (fix proxy redis) Add redis sentinel support (#6154 )
* add sentinel_password support
* add doc for setting redis sentinel password
* fix redis sentinel - use sentinel password
* Fix: Update gpt-4o costs to that of gpt-4o-2024-08-06 (#6714 )
Fixes #6713
* (fix) using Anthropic `response_format={"type": "json_object"}` (#6721 )
* add support for response_format=json anthropic
* add test_json_response_format to baseLLM ChatTest
* fix test_litellm_anthropic_prompt_caching_tools
* fix test_anthropic_function_call_with_no_schema
* test test_create_json_tool_call_for_response_format
* (feat) Add cost tracking for Azure Dall-e-3 Image Generation + use base class to ensure basic image generation tests pass (#6716 )
* add BaseImageGenTest
* use 1 class for unit testing
* add debugging to BaseImageGenTest
* TestAzureOpenAIDalle3
* fix response_cost_calculator
* test_basic_image_generation
* fix img gen basic test
* fix _select_model_name_for_cost_calc
* fix test_aimage_generation_bedrock_with_optional_params
* fix undo changes cost tracking
* fix response_cost_calculator
* fix test_cost_azure_gpt_35
* fix remove dup test (#6718 )
* (build) update db helm hook
* (build) helm db pre sync hook
* (build) helm db sync hook
* test: run test_team_logging firdst
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
Co-authored-by: Dinmukhamed Mailibay <47117969+dinmukhamedm@users.noreply.github.com >
Co-authored-by: Kilian Lieret <kilian.lieret@posteo.de >
* test: update test
* test: skip anthropic overloaded error
* test: cleanup test
* test: update tests
* test: fix test
* test: handle gemini overloaded model error
* test: handle internal server error
* test: handle anthropic overloaded error
* test: handle claude instability
---------
Signed-off-by: B-Step62 <yuki.watanabe@databricks.com >
Co-authored-by: Yuki Watanabe <31463517+B-Step62@users.noreply.github.com >
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
Co-authored-by: Dinmukhamed Mailibay <47117969+dinmukhamedm@users.noreply.github.com >
Co-authored-by: Kilian Lieret <kilian.lieret@posteo.de >
2024-11-15 11:18:31 +05:30
310669e3bc
(docs) add instructions on how to contribute to docker image
2024-11-13 20:52:17 -08:00
68fdf9de2d
docs readme
2024-08-08 17:06:29 -07:00
5bc8b59b11
docs - use consistent name for LiteLLM proxy server
2024-08-03 12:49:35 -07:00
4bf9681df4
Update README.md
2024-07-25 20:12:32 -07:00
50bf488b58
read me link to using litellm
2024-07-25 20:10:02 -07:00
b93b2636a9
Update README.md
2024-07-24 16:51:40 -07:00
b38f470135
docs on litellm docker compose
2024-07-18 13:08:06 -07:00
1362a91d66
Merge pull request #4612 from colegottdank/main
...
Update Helicone Docs
2024-07-11 22:00:30 -07:00
cb025a7f26
Merge branch 'main' into empower-functions-v1
2024-07-08 17:01:15 -07:00
f414bafd4a
Add Helicone
2024-07-08 15:41:35 -07:00
705c498641
revert readme
2024-07-08 15:35:50 -07:00
20561bcaaf
Update key name
2024-07-08 14:17:30 -07:00
a3d9e34b26
Fix 2
2024-07-08 13:56:53 -07:00
e2a50b66f2
Update README.md
2024-06-25 09:24:00 -07:00
e354840f90
Update README.md
2024-06-25 09:23:19 -07:00
9e52fd0ba6
fix provider name
2024-06-11 16:23:08 +09:00
fe8d59f5eb
add friendli_ai provider
2024-06-10 17:27:15 +09:00
2e25416c02
Table format fix and Typo
...
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
2024-06-06 22:29:59 +09:30
edf296fb5b
Update README.md
2024-06-01 16:53:06 -07:00
6a004b9211
add document
2024-05-31 18:55:22 -07:00
beb51f5271
Update README.md
2024-05-24 09:19:48 -07:00
41d564857c
Update README.md
2024-05-24 09:19:28 -07:00
16331b438f
Update README.md
2024-05-24 09:07:32 -07:00
35c48c7c24
Update README.md
2024-05-18 19:06:09 -07:00
a43cfa1770
Update README.md
2024-05-18 12:58:22 -07:00
90eb0ea022
Added support for the deepseek api
2024-05-07 11:44:03 -07:00
ee8d0b6d5f
Merge pull request #3217 from DomMartin27/litellm_readme
...
Update contributing instructions in README.md
2024-05-02 07:42:44 -07:00
63e8209fe5
(docs) added watsonx to the list of supported providers
2024-04-27 16:43:17 +02:00
6464a1b067
Update contributing instructions in README.md
2024-04-22 19:35:08 +01:00
e52e4cc1a9
Update README.md
2024-04-20 09:48:49 -07:00
78571babb3
Merge pull request #2830 from onukura/onukura-patch-1
...
Update README.md
2024-04-11 06:47:53 -07:00
5d2734479d
Update README.md
2024-04-09 18:03:09 -07:00
a101591f74
Update README.md
2024-04-06 16:11:33 -07:00
e6263fd31a
Fix link to providers
2024-04-04 15:04:07 +01:00
f3fdae6e30
Update README.md
2024-04-04 14:30:52 +09:00
1b84dfac91
Merge branch 'main' into main
2024-03-30 13:21:53 +09:00
f3f56204c5
Update README.md
2024-03-26 10:34:16 -07:00
f702d49e00
Update README.md
2024-03-25 19:03:48 -07:00
1cbfd312fe
Merge branch 'main' into main
2024-03-19 12:50:04 +09:00
796b912883
Update README.md
2024-03-13 21:32:09 -07:00
7c38f992dc
Merge branch 'main' into main
2024-03-11 12:36:41 +09:00
ea6f42216c
(docs) use port 4000
2024-03-08 21:59:00 -08:00
waterstark