Krish DholakiaandGitHub b0b4c07e89 Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics ...

Litellm prometheus service metrics

2024-04-13 19:34:22 -07:00

..

deprecated_litellm_server

…

integrations

fix(prometheus_services.py): add better import error statement

2024-04-13 19:03:32 -07:00

llms

fix(gemini.py): log system prompt in verbose output

2024-04-11 23:15:58 -07:00

proxy

Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics

2024-04-13 19:34:22 -07:00

router_strategy

fix(lowest_tpm_rpm_v2.py): don't fail calls if redis fails to connect

2024-04-12 19:36:59 -07:00

tests

fix(caching.py): don't decode a string

2024-04-13 18:48:03 -07:00

types

feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)

2024-04-13 18:15:02 -07:00

__init__.py

feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)

2024-04-13 18:15:02 -07:00

_logging.py

fix(parallel_request_limiter.py): handle metadata being none

2024-03-14 10:02:41 -07:00

_redis.py

fix(redis.py): fix instantiating redis client from url

2024-02-15 17:48:00 -08:00

_service_logger.py

feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)

2024-04-13 18:15:02 -07:00

_version.py

(fix) ci/cd don't let importing litellm._version block starting proxy

2024-02-01 16:23:16 -08:00

budget_manager.py

…

caching.py

fix(caching.py): don't decode a string

2024-04-13 18:48:03 -07:00

cost.json

…

exceptions.py

fix(main.py): map list input to ollama prompt input format

2024-02-16 11:54:12 -08:00

main.py

fix(main.py): automatically infer mode for text completion models

2024-04-12 14:16:21 -07:00

model_prices_and_context_window_backup.json

Feature: add gemini-1.0-pro-001 and gemini-1.0-pro-002 to models list

2024-04-10 21:48:56 +00:00

requirements.txt

…

router.py

test(test_openai_endpoints.py): add concurrency testing for user defined rate limits on proxy

2024-04-12 18:56:13 -07:00

timeout.py

…

utils.py

feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)

2024-04-13 18:15:02 -07:00