tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-08-02 12:21:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3a7330900670b3800a69ea4538bb6010237eef4e
litellm/tests/llm_translation
T
History
Krish DholakiaGitHubaswny
 3a73309006 Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 
* build(model_prices_and_context_window.json): add bedrock llama4 models to model cost map

* fix template conversion for Llama 4 models in Bedrock (#10557)

* test: add testing to repro https://github.com/BerriAI/litellm/pull/10557

* test: add unit testing

* test(test_main.py): refactor where test is kept

---------

Co-authored-by: aswny <87371411+aswny@users.noreply.github.com>
2025-05-06 16:06:24 -07:00
..
test_llm_response_utils
Support caching on reasoning content + other fixes (#8973)
2025-03-04 21:12:16 -08:00
base_audio_transcription_unit_tests.py
Litellm dev 12 25 2025 p2 (#7420)
2024-12-25 18:35:34 -08:00
base_embedding_unit_tests.py
Litellm dev 12 25 2025 p2 (#7420)
2024-12-25 18:35:34 -08:00
base_llm_unit_tests.py
Fix return finish_reason = "tool_calls" for gemini tool calling (#10485)
2025-05-01 22:02:56 -07:00
base_rerank_unit_tests.py
Add cost tracking for rerank via bedrock (#8691)
2025-02-20 21:00:18 -08:00
conftest.py
aiohttp_openai/ fixes - allow using aiohttp_openai/gpt-4o (#7598)
2025-01-06 21:39:11 -08:00
dog.wav
(feat) Support audio param in responses streaming (#6312)
2024-10-18 19:16:14 +05:30
duck.png
fix vertex ai multimodal embedding translation (#9471)
2025-03-24 23:23:28 -07:00
gettysburg.wav
Litellm dev 12 25 2025 p2 (#7420)
2024-12-25 18:35:34 -08:00
guinea.png
fix vertex ai multimodal embedding translation (#9471)
2025-03-24 23:23:28 -07:00
log.xt
Litellm dev 04 05 2025 p2 (#9774)
2025-04-07 21:02:52 -07:00
Readme.md
LiteLLM Minor Fixes & Improvements (11/29/2024) (#6965)
2024-12-01 05:24:11 -08:00
test_aiohttp_openai.py
(proxy - RPS) - Get 2K RPS at 4 instances, minor fix aiohttp_openai/ (#7659)
2025-01-09 17:24:18 -08:00
test_anthropic_completion.py
test: mark flaky test
2025-04-29 06:40:26 -07:00
test_anthropic_text_completion.py
Easier user onboarding via SSO (#8187)
2025-02-02 23:02:33 -08:00
test_aws_base_llm.py
(fix) BaseAWSLLM - cache IAM role credentials when used (#7775)
2025-01-14 20:16:22 -08:00
test_azure_ai.py
test: update tests to new deployment model (#10142)
2025-04-18 14:22:12 -07:00
test_azure_o_series.py
test azure o series
2025-04-02 09:46:45 -07:00
test_azure_openai.py
test: update tests to new deployment model (#10142)
2025-04-18 14:22:12 -07:00
test_bedrock_completion.py
fix(converse_transformation.py): support all bedrock - openai params for arn models (#10256)
2025-04-23 21:56:05 -07:00
test_bedrock_dynamic_auth_params_unit_tests.py
(Bug Fix) - Bedrock completions with aws_region_name (#8384)
2025-02-08 16:33:17 -08:00
test_bedrock_embedding.py
fix: remove aws params from bedrock embedding request body (#8618) (#8696)
2025-02-24 10:04:58 -08:00
test_bedrock_invoke_tests.py
Fix calling claude via invoke route + response_format support for claude on invoke route (#8908)
2025-02-28 17:56:26 -08:00
test_bedrock_llama.py
Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582)
2025-05-06 16:06:24 -07:00
test_bedrock_nova_json.py
test_bedrock_nova_json.py
2025-04-03 08:37:59 -07:00
test_clarifai_completion.py
(Refactor) Code Quality improvement - Use Common base handler for clarifai/ (#7125)
2024-12-09 21:04:48 -08:00
test_cloudflare.py
(Refactor) Code Quality improvement - Use Common base handler for cloudflare/ provider (#7127)
2024-12-10 10:12:22 -08:00
test_cohere_generate_api.py
fix(acompletion): support fallbacks on acompletion (#7184)
2024-12-11 19:20:54 -08:00
test_cohere.py
test_cohere_request_body_with_allowed_params
2025-04-01 21:30:24 -07:00
test_convert_dict_to_image.py
fix ImageObject conversion (#6584)
2024-11-04 15:46:43 -08:00
test_databricks.py
fix(databricks/chat/transformation.py): handle empty headers case
2025-04-05 08:33:56 -07:00
test_deepgram.py
Litellm dev 12 28 2024 p3 (#7464)
2024-12-28 19:18:58 -08:00
test_deepseek_completion.py
[Bug]: Deepseek error on proxy after upgrading to 1.61.13-stable (#8860)
2025-02-26 21:11:06 -08:00
test_fireworks_ai_translation.py
Handle fireworks ai tool calling response (#10130)
2025-04-19 09:37:45 -07:00
test_gemini.py
Gemini-2.5-flash improvements (#10198)
2025-04-21 22:48:00 -07:00
test_gpt4o_audio.py
Add gemini audio input support + handle special tokens in sagemaker response (#9640)
2025-03-29 19:23:09 -07:00
test_groq.py
fix(spend_tracking_utils.py): revert api key pass through fix (#7977)
2025-01-24 21:04:36 -08:00
test_huggingface_chat_completion.py
VertexAI non-jsonl file storage support (#9781)
2025-04-09 14:01:48 -07:00
test_infinity.py
[Feat] Add infinity embedding support (contributor pr) (#10196)
2025-04-21 20:01:29 -07:00
test_jina_ai.py
Litellm 12 02 2024 (#6994)
2024-12-02 22:00:01 -08:00
test_litellm_proxy_provider.py
fix(transformation.py): correctly translate 'thinking' param for lite… (#9904)
2025-04-11 23:25:13 -07:00
test_max_completion_tokens.py
Allow passing thinking param to litellm proxy via client sdk + Code QA Refactor on get_optional_params (get correct values) (#9386)
2025-04-07 21:04:11 -07:00
test_mistral_api.py
test_multilingual_requests
2024-12-03 20:52:19 -08:00
test_nvidia_nim.py
fix(nvidia_nim/embed.py): add 'dimensions' support (#8302)
2025-02-07 16:19:32 -08:00
test_openai_o1.py
test: override flaky test
2025-04-29 18:54:49 -07:00
test_openai.py
fixes for web search tests
2025-05-03 18:10:30 -07:00
test_optional_params.py
test: update tests to new deployment model (#10142)
2025-04-18 14:22:12 -07:00
test_prompt_caching.py
(feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039)
2024-10-03 23:31:10 +05:30
test_prompt_factory.py
Add DBRX Anthropic w/ thinking + response_format support (#9744)
2025-04-04 22:13:32 -07:00
test_rerank.py
test: update tests to new deployment model (#10142)
2025-04-18 14:22:12 -07:00
test_router_llm_translation_tests.py
test_prompt_caching
2025-02-26 09:29:15 -08:00
test_snowflake.py
added mock_tests
2025-03-11 16:32:15 -04:00
test_text_completion_unit_tests.py
huggingface/mistralai/Mistral-7B-Instruct-v0.3
2025-01-13 18:42:36 -08:00
test_text_completion.py
Add inference providers support for Hugging Face (#8258) (#9738) (#9773)
2025-04-05 10:50:15 -07:00
test_together_ai.py
LiteLLM Minor Fixes & Improvements (12/05/2024) (#7037)
2024-12-05 00:02:31 -08:00
test_triton.py
fix(triton/completion/transformation.py): remove bad_words / stop wor… (#10163)
2025-04-19 11:23:37 -07:00
test_unit_test_bedrock_invoke.py
Add Google AI Studio /v1/files upload API support (#9645)
2025-04-02 08:56:58 -07:00
test_vertex.py
Add vertex ai meta llama 4 support + handle tool call result in content for vertex ai (#10492)
2025-05-01 22:47:06 -07:00
test_voyage_ai.py
Add unit test
2025-03-14 18:14:41 +01:00
test_watsonx.py
Deepseek r1 support + watsonx qa improvements (#7907)
2025-01-21 23:13:15 -08:00
test_xai.py
[Feat] Add reasoning_effort support for xai/grok-3-mini-beta model family (#9932)
2025-04-11 19:17:09 -07:00

Readme.md

Unit tests for individual LLM providers.

Name of the test file is the name of the LLM provider - e.g. test_openai.py is for OpenAI.

Reference in New Issue View Git Blame Copy Permalink