tiennm99/litellm
1
0
Fork 0
mirror of https://github.com/tiennm99/litellm.git synced 2026-07-12 01:05:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
14,523 Commits 2,072 Branches 1,425 Tags
2163434ff3bf2e482d6dca31d0673c191976a935
Commit Graph

14523 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia 2163434ff3 fix(llm_cost_calc/google.py): fix google embedding cost calculation 
Fixes https://github.com/BerriAI/litellm/issues/4630
 2024-07-11 11:55:48 -07:00
Ishaan Jaff e3470d8e91 Merge pull request #4658 from BerriAI/litellm_check_otel_spans 
[Test-Proxy] Otel Traces
 2024-07-11 10:41:51 -07:00
Ishaan Jaff 6e86e4291a fix pytest 2024-07-11 10:34:28 -07:00
Ishaan Jaff 8d7db56deb fix Local only test. WIP 2024-07-11 10:30:40 -07:00
Ishaan Jaff 07ae8c6059 fix not clause on ci/cd tests 2024-07-11 10:25:34 -07:00
Ishaan Jaff b124d9414b fix build and test test 2024-07-11 10:22:12 -07:00
Ishaan Jaff 73d19451bd fix test otel 2024-07-11 10:16:05 -07:00
Ishaan Jaff 77dcae6979 fix test otel tracing 2024-07-11 10:07:39 -07:00
Ishaan Jaff bda9eb7faa fix build and test test 2024-07-11 10:04:05 -07:00
Ishaan Jaff ab400d24f5 reduce deps in ci/cd test 2024-07-11 10:02:15 -07:00
Ishaan Jaff 775ce119b6 test otel 2024-07-11 10:01:36 -07:00
Ishaan Jaff b4f8c7304f Merge pull request #4652 from msabramo/shorter-success_callbacks-in-health-readiness-response 
Shorter success callbacks from `/health/readiness`
 2024-07-11 09:57:52 -07:00
Ishaan Jaff 79f409b21e Merge pull request #4656 from BerriAI/litellm_otel_fix 
[Proxy - OTEL] Fix logging DB, Redis Cache Reads
 2024-07-11 09:55:51 -07:00
Ishaan Jaff 15d35cd62f test otel 2024-07-11 09:54:23 -07:00
Krrish Dholakia 070ab9f469 docs(model_management.md): update docs to clarify calling /model/info 2024-07-11 09:47:50 -07:00
Krrish Dholakia 8fa2cf15ee fix(watsonx.py): fix watson process response 
Fixes https://github.com/BerriAI/litellm/issues/4654
 2024-07-11 09:34:46 -07:00
Krrish Dholakia b5a00722bc docs(assistants.md): add openai-compatible assistants api example to docs 2024-07-11 09:20:55 -07:00
Ishaan Jaff e2c3b2b694 fix add master key in requests 2024-07-11 09:05:08 -07:00
Krrish Dholakia 57607dfc47 test(test_alangfuse.py): fix test to expect correct response object 2024-07-11 09:00:31 -07:00
Ishaan Jaff 42ae3d494d fix otel_test_config 2024-07-11 08:59:33 -07:00
Ishaan Jaff 5cc725078d ci/cd run otel test 2024-07-11 08:53:38 -07:00
Ishaan Jaff 02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Ishaan Jaff cb6ddaf1f9 test - otel spans 2024-07-11 08:01:18 -07:00
Ishaan Jaff a5b8db7f3a Merge pull request #4625 from lowjiansheng/js/update-helm-chart-package 
Create helm package and move index.yaml file location
 2024-07-11 07:32:44 -07:00
Ishaan Jaff 19d993e120 add otel in callbacks 2024-07-11 07:24:48 -07:00
Ishaan Jaff 498d7d4228 fix - otel log db / redis calls 2024-07-11 07:22:45 -07:00
Krrish Dholakia 4b0181c79c docs(anthropic_completion.md): add doc on anthropic /v1/messages endpoint support 2024-07-10 22:56:33 -07:00
Krrish Dholakia 03e15d020e bump: version 1.41.16 → 1.41.17 2024-07-10 22:43:26 -07:00
Krish Dholakia dacce3d78b Merge pull request #4635 from BerriAI/litellm_anthropic_adapter 
Anthropic `/v1/messages` endpoint support
 2024-07-10 22:41:53 -07:00
Krrish Dholakia 22bcbac9ea fix: fix linting error 2024-07-10 22:14:23 -07:00
Krrish Dholakia 1019355527 fix(types/utils.py): fix streaming function name 2024-07-10 21:56:47 -07:00
Marc Abramowitz 434953b38c More updates to health.md docs 2024-07-10 19:08:48 -07:00
Marc Abramowitz 6ccd635216 Update doc: health.md 2024-07-10 19:02:48 -07:00
Krrish Dholakia 31829855c0 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Marc Abramowitz 3d86c4f515 Shorter success callbacks from /health/readiness 
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
 2024-07-10 18:45:42 -07:00
Ishaan Jaff b2f4cd9b56 bump: version 1.41.15 → 1.41.16 2024-07-10 18:34:30 -07:00
Krrish Dholakia 2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Ishaan Jaff f49837df19 ci/cd run again 2024-07-10 18:06:09 -07:00
Ishaan Jaff dc5adbb0ca docs - control allowed ip address 2024-07-10 18:03:54 -07:00
Ishaan Jaff b4a96e81c6 docs gdpr regions cloud 2024-07-10 18:00:16 -07:00
Ishaan Jaff da73f3abda docs security cloud litellm 2024-07-10 17:54:54 -07:00
Ishaan Jaff ca76d2fd72 fix test_completion_bedrock_httpx_models v1.41.15 2024-07-10 17:42:40 -07:00
Ishaan Jaff 9590d63a38 docs - Security Measures 2024-07-10 17:40:30 -07:00
Ishaan Jaff d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff 7efe9beac5 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Ishaan Jaff de0dacc42d fix test proxy routes 2024-07-10 16:58:53 -07:00
Ishaan Jaff 7b8670f883 add /files/{file_id}/content as openai route 2024-07-10 16:55:09 -07:00
Ishaan Jaff 265ec00d0f fix test routes on litellm proxy 2024-07-10 16:51:47 -07:00
Ishaan Jaff 0cb4dabaf0 Merge pull request #4642 from BerriAI/litellm_safe_access_slack 
[fix] slack alerting reports - add validation for safe access into attributes
 2024-07-10 16:46:08 -07:00
Ishaan Jaff a313174ecb Merge pull request #4648 from BerriAI/litellm_add_remaining_file_endpoints 
[Feat] Add LIST, DELETE, GET `/files`
 2024-07-10 16:42:05 -07:00