d37cc63250
Add new model provider Novita AI ( #7582 ) ( #9527 )
...
* Add new model provider Novita AI (#7582 )
* feat: add new model provider Novita AI
* feat: use deepseek r1 model for examples in Novita AI docs
* fix: fix tests
* fix: fix tests for novita
* fix: fix novita transformation
* ci: fix ci yaml
* fix: fix novita transformation and test (#10056 )
---------
Co-authored-by: Jason <ggbbddjm@gmail.com >
2025-05-12 21:49:30 -07:00
2cc4a87861
[Docs] Using litellm with Google ADK ( #10777 )
...
* docs litellm ADK usage
* docs litellm google adk
* docs litellm ADK
* docs litellm with ADK usage examples
* docs litellm proxy with ADK
* cookbook litellm ADK
2025-05-12 16:41:49 -07:00
65b99d6bc3
feat(grafana_dashboard): enable datasource selection via templating ( #10257 )
...
This commit updates the Grafana dashboard configuration to include a datasource template variable. This allows users to dynamically select the datasource directly within the Grafana dashboard, improving flexibility and user experience.
2025-04-25 08:49:29 -07:00
34bdf36eab
Add inference providers support for Hugging Face ( #8258 ) ( #9738 ) ( #9773 )
...
* Add inference providers support for Hugging Face (#8258 )
* add first version of inference providers for huggingface
* temporarily skipping tests
* Add documentation
* Fix titles
* remove max_retries from params and clean up
* add suggestions
* use llm http handler
* update doc
* add suggestions
* run formatters
* add tests
* revert
* revert
* rename file
* set maxsize for lru cache
* fix embeddings
* fix inference url
* fix tests following breaking change in main
* use ChatCompletionRequest
* fix tests and lint
* [Hugging Face] Remove outdated chat completion tests and fix embedding tests (#9749 )
* remove or fix tests
* fix link in doc
* fix(config_settings.md): document hf api key
---------
Co-authored-by: célina <hanouticelina@gmail.com >
2025-04-05 10:50:15 -07:00
5965680176
fix dev release.txt
2025-04-01 12:02:51 -07:00
8f35bdffb0
build(deps): bump litellm in /cookbook/litellm-ollama-docker-image
...
Bumps [litellm](https://github.com/BerriAI/litellm ) from 1.55.3 to 1.61.15.
- [Release notes](https://github.com/BerriAI/litellm/releases )
- [Commits](https://github.com/BerriAI/litellm/commits )
---
updated-dependencies:
- dependency-name: litellm
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com >
2025-03-20 21:03:29 +00:00
e1c0025a55
docs litellm x langfuse cookbook
2025-02-14 09:31:51 -08:00
a551f978fb
update cookbook
2025-02-14 09:23:04 -08:00
9511cdddcd
docs litellm langfuse cookbook
2025-02-14 08:16:27 -08:00
1e423cadf4
cookbook litellm proxy langfuse ( #8541 )
2025-02-14 08:07:59 -08:00
85491a0bab
Add Arize Cookbook for Turning on LiteLLM Proxy ( #8336 )
...
* Add files via upload
* Update arize_integration.md
2025-02-06 16:16:28 -08:00
6f6c651ee0
(Feat) Add input_cost_per_token_batches, output_cost_per_token_batches for OpenAI cost tracking Batches API ( #7391 )
...
* add input_cost_per_token_batches
* input_cost_per_token_batches
2024-12-23 17:42:58 -08:00
c7f14e936a
(code quality) run ruff rule to ban unused imports ( #7313 )
...
* remove unused imports
* fix AmazonConverseConfig
* fix test
* fix import
* ruff check fixes
* test fixes
* fix testing
* fix imports
2024-12-19 12:33:42 -08:00
e332e93786
Litellm security fixes ( #7282 )
...
* build(Dockerfile): bump node version
* build(Dockerfile): bump python version
fix critical errors
* build(requirements.txt): fix snyk errors
2024-12-18 09:38:52 -08:00
7a5f997fc9
(refactor) remove berrispendLogger - unused logging integration ( #6363 )
...
* fix remove berrispendLogger
* remove unused clickhouse logger
2024-10-22 16:53:25 +05:30
f252350881
LiteLLM Minor Fixes & Improvements (10/17/2024) ( #6293 )
...
* fix(ui_sso.py): fix faulty admin only check
Fixes https://github.com/BerriAI/litellm/issues/6286
* refactor(sso_helper_utils.py): refactor /sso/callback to use helper utils, covered by unit testing
Prevent future regressions
* feat(prompt_factory): support 'ensure_alternating_roles' param
Closes https://github.com/BerriAI/litellm/issues/6257
* fix(proxy/utils.py): add dailytagspend to expected views
* feat(auth_utils.py): support setting regex for clientside auth credentials
Fixes https://github.com/BerriAI/litellm/issues/6203
* build(cookbook): add tutorial for mlflow + langchain + litellm proxy tracing
* feat(argilla.py): add argilla logging integration
Closes https://github.com/BerriAI/litellm/issues/6201
* fix: fix linting errors
* fix: fix ruff error
* test: fix test
* fix: update vertex ai assumption - parts not always guaranteed (#6296 )
* docs(configs.md): add argila env var to docs
2024-10-17 22:09:11 -07:00
4d1b4beb3d
(refactor) caching use LLMCachingHandler for async_get_cache and set_cache ( #6208 )
...
* use folder for caching
* fix importing caching
* fix clickhouse pyright
* fix linting
* fix correctly pass kwargs and args
* fix test case for embedding
* fix linting
* fix embedding caching logic
* fix refactor handle utils.py
* fix test_embedding_caching_azure_individual_items_reordered
2024-10-14 16:34:01 +05:30
b1e9d344b2
Update readme.md
2024-10-07 18:15:15 +05:30
a0cbf31fcf
Update readme.md
2024-10-07 18:12:43 +05:30
1bafbf8382
(feat proxy) add v2 maintained LiteLLM grafana dashboard ( #6098 )
...
* add new grafana dashboard litellm
* add v2 grafana dashboard
2024-10-07 18:11:20 +05:30
b2d62f00a3
update cookbook
...
simplify
2024-08-28 17:19:48 +02:00
5bc8b59b11
docs - use consistent name for LiteLLM proxy server
2024-08-03 12:49:35 -07:00
c5ee6fe4b9
build: cookbook on migrating to litellm proxy from openai/azure sdk
2024-07-27 16:09:50 -07:00
c99a5a58ec
docs grafana dashboard litellm
2024-07-05 14:08:55 -07:00
9c6080be1a
Create readme.md
2024-07-05 14:04:47 -07:00
8b741f5efc
add example grafana dashboard
2024-07-05 14:02:05 -07:00
166eb24c54
script to add new models
2024-07-04 20:52:58 -07:00
778b41cea5
fix - update migration script to ensure api_key in script
2024-05-22 12:22:23 -07:00
723ef9963e
Clarifai - Added streaming and async completion support
2024-05-03 14:03:38 +00:00
d770df2259
Merge branch 'main' into main
2024-04-30 22:48:52 +05:30
318b4813f2
Clarifai-LiteLLM integration ( #1 )
...
* intg v1 clarifai-litellm
* Added more community models and testcase
* Clarifai-updated markdown docs
2024-04-30 22:38:33 +05:30
72cbe369be
(docs) updated watsonx cookbook
2024-04-24 17:19:02 +02:00
f9a7456eaa
(docs) updated cookbook
2024-04-23 16:22:41 +02:00
e64aceea91
(feat) Update WatsonX credentials and variable names
2024-04-23 12:16:04 +02:00
7cbe9835c9
(docs) updated litellm watsonx cookbook
2024-04-23 12:01:13 +02:00
ca0807d8ab
(docs) added watsonx cookbook
2024-04-20 20:52:25 +02:00
a06a0e7b81
docs(cookbook/proxy_batch_users.ipynb): update cookbook with better instructions
2024-04-13 10:34:00 -07:00
ae7230cf71
docs(cookbook/proxy_batch_users.ipynb): cookbook for batch creating users on proxy with keys + max budgets
2024-04-13 10:31:39 -07:00
9465288e9e
migration script
2024-04-11 09:55:14 -07:00
240aaf7af8
fix - show api_base in migration script
2024-04-11 09:26:13 -07:00
1c1b0f929f
fix - migration script for /model/new
2024-04-11 07:34:00 -07:00
a36c2f8e92
feat - migration script to hosted proxy
2024-04-10 18:21:57 -07:00
be265fbb15
initial
2024-04-04 16:58:51 -03:00
7c38f992dc
Merge branch 'main' into main
2024-03-11 12:36:41 +09:00
4b717810ec
(feat) endpoint router
2024-03-09 16:10:04 -08:00
6707ddefa5
remove keys
2024-02-28 22:30:10 -08:00
40eebc6bea
support templates
2024-02-28 22:18:39 -08:00
a9648613dc
feat: LLMonitor is now Lunary
2024-02-27 22:07:13 -08:00
c591b3d9f3
(feat) insert clickhouse logs
2024-02-26 16:39:32 -08:00
78c847ec5e
(misc) clickhouse cookbook
2024-02-26 07:37:44 -08:00
Krish Dholakia