* Add management client docs
* Docs enhancements
* Add "proxy/management_cli" to sidebar
* Small formatting changes
* Add overview table
* Wrap long line
* Add "Quick Start" section
* Document uv tool upgrade and uninstall
* Add blank lines to eliminate yellow squigglies in VS Code
* For each section link to section on swagger used
* Wrap some long command examples
* Break long http request command on to multiple lines
* Add support for nscale provider
* Add image generation support and fix unit tests
* Add docs for nscale
* Fix unit test import issues
* Minor doc improvement
* Remove redundant null tokens from model cost map
* Address PR review comments for doc updates
* Revert changes to large text
* fixes for generic api logger
* tests for generic api logger
* test_generic_api_callback_multiple_logs
* allow health checking generic api endpoints
* docs generic api endpoint for logging
* allow setting headers for generic api callback
* fix for test_init_custom_logger_compatible_class_as_callback
* fix linting
* Support Llama-api as an LLM provider (#10451)
* init: support llama-api as a llm provider
* docs: fix endpoint url
* fix: rename meta dir to meta-llama
* docs: add meta-llama info
* fix: mv LlamaAPIConfig under chat directory
* feat: add LlamaAPIConfig in ProviderConfigManager
* fix: provider_config from ProviderConfigManager
* feat: add supports_tool_choice param
* fix: remove optional_params using model_info
* fix: rename meta-llama to meta_llama
* init: test for meta_llama
* fix: model names
---------
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
* fix file naming convention
* fix file naming convention for meta_llama
* docs meta llama api litellm
---------
Co-authored-by: Young Han <110819238+seyeong-han@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>
documentation includes outdated example of configuration of realtime
model that does not comply with current healthcheck:
https://github.com/BerriAI/litellm/pull/7453. Provide proper model info
mode in example
* Update docs for OpenAI compatible providers, add Llamafile docs, include Llamafile in the sidebar
* Add Llamafile as an LlmProviders enum
* Add llamafile as a OpenAI compatible provider (in the list of compatible providers)
* Add Llamafile chat config and tests
* Wire up Llamafile
Co-authored-by: Peter Wilson <peter@mozilla.ai>
* init vector store configs
* working kb init
* add vector store endpoints
* use litellm_credential_name
* working CRUD vector stores litellm
* working creds with vector DB
* ui cleanup
* clean up vector store id
* fix delete button
* refactored vector store component
* working selector for KBs
* ui vector stores
* add vector store tool calls usage on chat ui
* fixes for vector stores litellm
* test fix
* docs Knowledge Bases
* fixes for vector stores litellm
* fix linting
* add managed vectorstores
* fix orjson ci/cd test
* fix linting
* add types.tsx file
* Schedule budget resets at expectable times (#10331)
* Enhance budget reset functionality with timezone support and standardized reset times
- Added `get_next_standardized_reset_time` function to calculate budget reset times based on specified durations and timezones.
- Introduced `timezone_utils.py` to manage timezone retrieval and budget reset time calculations.
- Updated budget reset logic in `reset_budget_job.py`, `internal_user_endpoints.py`, `key_management_endpoints.py`, and `team_endpoints.py` to utilize the new timezone-aware reset time calculations.
- Added unit tests for the new reset time functionality in `test_duration_parser.py`.
- Updated `.gitignore` to include `test.py` and made minor formatting adjustments in `docker-compose.yml` for consistency.
* Fixed linting
* Fix for mypy
* Fixed testcase for reset
* fix(duration_parser.py): move off zoneinfo - doesn't work with python 3.8
* test: update test
* refactor: improve budget reset time calculation and update related tests for accuracy
* clean up imports in team_endpoints.py
* test: update budget remaining hours assertions to reflect new reset time logic
* build(model_prices_and_context_window.json): update model
---------
Co-authored-by: Prathamesh Saraf <pratamesh1867@gmail.com>
Ishaan Jaff