Commit Graph
37 Commits
Author SHA1 Message Date
Rashmi PawarandGitHub 986c463983 (doc) Add nvidia as provider (#8023)
* add nvidia as provider in docs

* fixes for closing tag

* review changes
2025-01-27 21:18:34 -08:00
Igor Ribeiro LimaandGitHub 11932d0576 Add Gemini embedding doc (#7436) 2024-12-27 15:27:26 -08:00
7e5085dc7b Litellm dev 11 21 2024 (#6837)
* Fix Vertex AI function calling invoke: use JSON format instead of protobuf text format. (#6702)

* test: test tool_call conversion when arguments is empty dict

Fixes https://github.com/BerriAI/litellm/issues/6833

* fix(openai_like/handler.py): return more descriptive error message

Fixes https://github.com/BerriAI/litellm/issues/6812

* test: skip overloaded model

* docs(anthropic.md): update anthropic docs to show how to route to any new model

* feat(groq/): fake stream when 'response_format' param is passed

Groq doesn't support streaming when response_format is set

* feat(groq/): add response_format support for groq

Closes https://github.com/BerriAI/litellm/issues/6845

* fix(o1_handler.py): remove fake streaming for o1

Closes https://github.com/BerriAI/litellm/issues/6801

* build(model_prices_and_context_window.json): add groq llama3.2b model pricing

Closes https://github.com/BerriAI/litellm/issues/6807

* fix(utils.py): fix handling ollama response format param

Fixes https://github.com/BerriAI/litellm/issues/6848#issuecomment-2491215485

* docs(sidebars.js): refactor chat endpoint placement

* fix: fix linting errors

* test: fix test

* test: fix test

* fix(openai_like/handler): handle max retries

* fix(streaming_handler.py): fix streaming check for openai-compatible providers

* test: update test

* test: correctly handle model is overloaded error

* test: update test

* test: fix test

* test: mark flaky test

---------

Co-authored-by: Guowang Li <Guowang@users.noreply.github.com>
2024-11-22 01:53:52 +05:30
Krish DholakiaandGitHub c03e5da41f LiteLLM Minor Fixes & Improvements (10/24/2024) (#6421)
* fix(utils.py): support passing dynamic api base to validate_environment

Returns True if just api base is required and api base is passed

* fix(litellm_pre_call_utils.py): feature flag sending client headers to llm api

Fixes https://github.com/BerriAI/litellm/issues/6410

* fix(anthropic/chat/transformation.py): return correct error message

* fix(http_handler.py): add error response text in places where we expect it

* fix(factory.py): handle base case of no non-system messages to bedrock

Fixes https://github.com/BerriAI/litellm/issues/6411

* feat(cohere/embed): Support cohere image embeddings

Closes https://github.com/BerriAI/litellm/issues/6413

* fix(__init__.py): fix linting error

* docs(supported_embedding.md): add image embedding example to docs

* feat(cohere/embed): use cohere embedding returned usage for cost calc

* build(model_prices_and_context_window.json): add embed-english-v3.0 details (image cost + 'supports_image_input' flag)

* fix(cohere_transformation.py): fix linting error

* test(test_proxy_server.py): cleanup test

* test: cleanup test

* fix: fix linting errors
2024-10-25 15:55:56 -07:00
Ishaan Jaff b054dd0e45 docs fix 2024-08-22 19:04:14 -07:00
Ishaan Jaff 25609a94ad docs moderation 2024-08-22 18:57:54 -07:00
Krrish Dholakia d0971dd50e docs(supported_embedding.md): add specifying input_type for huggingface embedding calls 2024-07-30 13:45:38 -07:00
Krrish Dholakia 5f279c937c docs(supported_embedding.md): cleanup 2024-07-09 12:41:24 -07:00
Krrish Dholakia 58ac2a7e2b docs(supported_embeddings.md): add doc on provider-specific params for embedding models 2024-07-09 12:39:10 -07:00
Ishaan Jaff e0001a9121 docs - add using vertex embedding models 2024-05-06 07:56:17 -07:00
Dev Khant 531eef359d add vertex_ai/text-embedding-preview-0409 2024-04-13 13:00:12 +05:30
ishaan-jaff ea6f42216c (docs) use port 4000 2024-03-08 21:59:00 -08:00
Krrish Dholakia 468995b288 docs(supported_embeddings.md): add vertex ai embeddings to docs 2024-03-02 09:34:01 -08:00
Krrish Dholakia d3a742efc8 docs(supported_embedding.md): add vertex ai embeddings to docs 2024-03-01 20:57:23 -08:00
ishaan-jaff 65fd405bd4 (docs) dimensions embedding param 2024-01-26 13:33:11 -08:00
ishaan-jaff b3853c3a53 (docs) new OpenAI embedding models 2024-01-25 14:38:03 -08:00
ishaan-jaff a1484171b5 (docs) voyage ai embeddings 2023-12-28 17:15:16 +05:30
ishaan-jaff 01f7e85057 (docs) add mistral embeddings 2023-12-28 16:54:26 +05:30
Krrish Dholakia db12ca4ecb docs(bedrock.md): add cohere embeddings to bedrock docs 2023-12-07 11:35:08 -08:00
ishaan-jaff 6f8765125b (docs) embedding: add api_base for HF 2023-12-04 11:57:41 -08:00
ishaan-jaff c12d6c3fe8 (docs) custom openai embedding 2023-11-25 11:52:59 -08:00
ishaan-jaff d0f11e7a13 (docs) input params for litellm.embedding() 2023-11-22 14:40:52 -08:00
ishaan-jaff 3239ec80c9 (docs) embedding models 2023-11-07 21:43:02 -08:00
ishaan-jaff 764ba41224 (docs) embedding 2023-11-02 10:57:57 -07:00
ishaan-jaff f24e1cb133 (docs) embedding cohere 2023-11-02 10:56:24 -07:00
ishaan-jaff 9cfd218101 (feat) detect amazon.titan-embed-text-v1 as bedrock embedding model 2023-11-01 14:46:33 -07:00
ishaan-jaff 59b3a64e64 (docs) add bedrock embeddings() 2023-11-01 14:12:48 -07:00
ishaan-jaff ea0c65d146 (docs) add async embeddings 2023-10-23 15:23:23 -07:00
ishaan-jaff fbac910436 (fix) openai proxy set langfuse as callback 2023-10-23 14:42:04 -07:00
ishaan-jaff 7641729657 (docs) update embedding docs 2023-10-14 10:27:22 -07:00
ishaan-jaff 680bf6f110 (docs) add example of using Azure with passing api_key, api_base, api_version 2023-10-13 21:27:01 -07:00
ishaan-jaff 860dd53561 docs for hf embedding llms 2023-09-29 13:57:11 -07:00
ishaan-jaff 8afa7700bf add docs 2023-09-29 10:05:49 -07:00
ishaan-jaff 122a457533 docs add moderation 2023-09-19 21:47:31 -07:00
ishaan-jaff a86ec0f916 docs 2023-09-19 21:43:37 -07:00
ishaan-jaff d57a1fb764 fix docs 2023-08-21 07:27:45 -07:00
Krrish Dholakia dc6e93f0d0 updating docs 2023-08-12 11:30:32 -07:00