Ishaan Jaff afe159bb8b [Feat] GEMINI CLI Integration - Add /countTokens endpoint support (#13545) ...

* stash changes for token counter

* working TokenCountRequest

* working acount_tokens

* add GoogleAIStudioTokenCounter

* re-use validate_environment

* fixes count_tokens

* fixes google_count_tokens

* fixes token counter base class

* fix TokenCountResponse

* fix - use BaseTokenCounter

* add should_use_token_counting_api

* fixes for GoogleAIStudioTokenCounter

* fixes for should_use_token_counting_api

* fixes for google_count_tokens

* fixes for /messages count_tokens

* fixes for should_use_token_counting_api

* working e2e gemini token counter

* ruff check fixes

* fixes for token counter

* fixes for TokenCountResponse

* cleanup TokenCountRequest

* add TokenCountDetailsResponse

* fix use well typed Responses

* fix typing for TokenCountDetailsResponse

* test_vertex_ai_gemini_token_counting_with_contents

* fixes for TokenCountDetailsResponse

* test fixes

* test_factory_registration

* test_proxy_token_counter.py

* TestGoogleAIStudioTokenCounter

* fix token_counter

2025-08-12 16:19:58 -07:00

..

example_config_yaml

test: update tests to new deployment model (#10142)

2025-04-18 14:22:12 -07:00

test_configs

test: update tests to new deployment model (#10142)

2025-04-18 14:22:12 -07:00

test_model_response_typing

…

adroit-crow-413218-bc47f303efc9.json

vertex testing use pathrise-convert-1606954137718

2025-01-05 14:00:17 -08:00

azure_fine_tune.jsonl

…

batch_job_results_furniture.jsonl

…

conftest copy.py

…

conftest.py

…

data_map.txt

…

eagle.wav

…

gettysburg.wav

…

large_text.py

…

messages_with_counts.py

…

model_cost.json

…

openai_batch_completions_router.jsonl

…

openai_batch_completions.jsonl

…

speech_vertex.mp3

…

test_aproxy_startup.py

(Security fix) - Upgrade to fastapi==0.115.5 (#7447)

2024-12-28 17:08:19 -08:00

test_audit_logs_proxy.py

[Feat] Add /image/edits on LiteLLM (#11123)

2025-05-24 10:18:01 -07:00

test_auth_checks.py

Exclude none fields on /chat/completion - fixes n8n bug + Allow calling /v1/models when end user over budget (#13320)

2025-08-05 21:39:46 -07:00

test_banned_keyword_list.py

…

test_custom_callback_input.py

…

test_custom_logger_s3_gcs.py

[Feat] Allow reading custom logger python scripts from s3 (#12623)

2025-07-16 15:07:01 -07:00

test_db_schema_changes.py

test: initial test to enforce all functions in user_api_key_auth.py h… (#7797)

2025-01-15 21:52:45 -08:00

test_db_schema_migration.py

install prisma migration files - connects litellm proxy to litellm's prisma migration files (#9637)

2025-03-29 15:27:09 -07:00

test_deployed_proxy_keygen.py

…

test_e2e_pod_lock_manager.py

[⚡️ Python SDK import] - reduce python sdk import time by .3s (#12140)

2025-06-28 14:57:10 -07:00

test_jwt.py

[Security Fix] - Dont show pure JWT in "Logs" page on UI (#12524)

2025-07-11 15:33:57 -07:00

test_key_generate_dynamodb.py

…

test_key_generate_prisma.py

test: update test

2025-08-01 09:07:53 -07:00

test_models_fallback_endpoint.py

feat: extended /v1/models endpoint, now it returns with fallbacks on demand (#12811)

2025-07-22 23:16:46 -07:00

test_proxy_config_unit_test.py

(fix) - proxy reliability, ensure duplicate callbacks are not added to proxy (#8067)

2025-01-28 21:01:56 -08:00

test_proxy_custom_auth.py

…

test_proxy_custom_logger.py

[Feat] Use aiohttp transport by default - 97% lower median latency (#11097)

2025-05-23 22:55:35 -07:00

test_proxy_encrypt_decrypt.py

test: fix test

2025-07-27 09:52:22 -07:00

test_proxy_exception_mapping.py

Litellm fix proxy unit testing p2 (#12779)

2025-07-19 16:35:05 -07:00

test_proxy_gunicorn.py

…

test_proxy_pass_user_config.py

test: update tests to new deployment model (#10142)

2025-04-18 14:22:12 -07:00

test_proxy_reject_logging.py

[Security Bug Fix] Ensure only LLM API route fails get logged on Langfuse (and other loggers) (#12308)

2025-07-04 14:42:42 -07:00

test_proxy_routes.py

[Bug fix]: Proxy Auth Layer - Allow Azure Realtime routes as llm_api_routes (#7684)

2025-01-10 20:38:06 -08:00

test_proxy_server_caching.py

…

test_proxy_server_keys.py

test: update tests to new deployment model (#10142)

2025-04-18 14:22:12 -07:00

test_proxy_server_langfuse.py

(Security fix) - Upgrade to fastapi==0.115.5 (#7447)

2024-12-28 17:08:19 -08:00

test_proxy_server_spend.py

…

test_proxy_server.py

[Feat] Background Health Checks - Allow disabling background health checks for a specific (#13186)

2025-07-31 13:48:35 -07:00

test_proxy_setting_guardrails.py

…

test_proxy_token_counter.py

[Feat] GEMINI CLI Integration - Add /countTokens endpoint support (#13545)

2025-08-12 16:19:58 -07:00

test_proxy_utils.py

test: update test

2025-07-29 21:35:44 -07:00

test_unit_test_max_model_budget_limiter.py

Support budget/rate limit tiers for keys (#7429)

2024-12-26 19:05:27 -08:00

test_unit_test_proxy_hooks.py

test fixes

2025-03-31 19:33:10 -07:00

test_update_spend.py

test_long_term_spend_accuracy_with_bursts

2025-03-31 19:17:13 -07:00

test_user_api_key_auth.py

[Feat] Allow using query_params for setting API Key for generateContent routes (#13100)

2025-07-29 14:11:06 -07:00

vertex_key.json

ci/cd update vertex acct

2025-01-05 13:43:32 -08:00