mirror of
https://github.com/tiennm99/litellm.git
synced 2026-07-18 00:17:00 +00:00
Camille FarineauandGitHub
b88e56ebde
* fix(embeddings): use non default tokenizer when passing list of lists of tokens (int) * feat(embeddings): allow for passthrough of list of lists of tokens to hosted_vllm models * Revert "fix(embeddings): use non default tokenizer when passing list of lists of tokens (int)" This reverts commit a48acd95f860c4fc85853e20668eabffff07cae7. * refactor(embeddings): use a list to verify if provider accept as input a list of tokens * fix(embeddings): verify the model name before validating if provider accept a arrays of tokens as input When passing a list of tokens as input, verify the provider of the model by going through the list of models (`llm_model_list`). First, it check for model name then get the provider and verify if it accept or not arrays of tokens. If yes, then pass, else decode. Previously, it was verifying provider and model name at the same time resulting in decoding even if the current model checked was not the target one (looping onto `llm_model_list`) * test(embedding): add unit test to bypass decode for some providers with input as array of tokens Ref: https://github.com/BerriAI/litellm/issues/10113
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/litellm
This folder can only run mock tests.