Ishaan Jaff
fe6e465466
test - num callbacks on proxy should not increase
2024-05-03 09:59:59 -07:00
Ishaan Jaff
23d334fe60
proxy - return num callbacks on /health/readiness
2024-05-03 09:14:32 -07:00
Ishaan Jaff
a1814a3e4c
test - num callbacks on proxy
2024-05-03 09:13:37 -07:00
Ishaan Jaff
540a35ed5e
fix update router logic
2024-05-03 08:48:11 -07:00
Krrish Dholakia
91971fa9e0
feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id
2024-05-02 17:53:09 -07:00
Krrish Dholakia
fdc4fdb91a
fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions
...
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
2024-05-02 17:18:21 -07:00
Krrish Dholakia
5baeeec899
fix(openmeter.py): fix get from env
2024-05-02 16:34:22 -07:00
Krish Dholakia and GitHub
2200900ca2
Merge pull request #3393 from Priva28/main
...
Add Llama3 tokenizer and allow custom tokenizers.
2024-05-02 16:32:41 -07:00
Ishaan Jaff and GitHub
0b27f5b3dc
Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts
...
fix - revert init langfuse client on slack alerts
2024-05-02 16:09:23 -07:00
Ishaan Jaff
9edf463c3b
fix - revert init langfuse client on slack alerts
2024-05-02 16:02:52 -07:00
Ishaan Jaff and GitHub
f893f8bc55
Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors
...
Disambiguate invalid model name errors
2024-05-02 15:09:59 -07:00
Krish Dholakia and GitHub
9e56472a81
Merge pull request #3406 from msabramo/test_proxy_server_mock_improvements
...
Improve mocking in `test_proxy_server.py`
2024-05-02 15:05:09 -07:00
Marc Abramowitz
6d154e2317
Update tests to reflect new error messages
2024-05-02 15:02:58 -07:00
Marc Abramowitz
988c37fda3
Disambiguate invalid model name errors
...
because that error can be thrown in several different places, so
knowing the function it's being thrown from can be very useul for debugging.
2024-05-02 15:02:54 -07:00
Krrish Dholakia
acda064be6
fix(proxy/utils.py): fix retry logic for generic data request
2024-05-02 14:50:50 -07:00
Krish Dholakia and GitHub
e26b39822c
Merge pull request #3405 from azohra/patch-1
...
Vision for Claude 3 Family + Info for Azure/GPT-4-0409
2024-05-02 13:42:01 -07:00
Marc Abramowitz
14e7c9b01c
Improve mocking in test_proxy_server
...
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
2024-05-02 13:36:23 -07:00
Justin Watts and GitHub
77098e31e4
Update model_prices_and_context_window.json
2024-05-02 13:21:36 -07:00
Justin Watts and GitHub
39670cd84a
Add Vision Support for Claude 3 Family
...
modified the model info table to add "supports_vision": true, for the claude 3 family (haiku, sonnet, and opus)
2024-05-02 13:09:17 -07:00
Krish Dholakia and GitHub
762a1fbd50
Merge pull request #3375 from msabramo/GH-3372
...
Fix route `/openai/deployments/{model}/chat/completions` not working properly
2024-05-02 13:00:25 -07:00
Marc Abramowitz
a79fd772f4
Simplify mock_patch_acompletion
2024-05-02 12:47:27 -07:00
Marc Abramowitz
6ec058711a
Make unnecessary to pass extra arg for mock object
...
Modify `mock_patch_acompletion` to be a context manager instead of a
function that returns a mock object. This way, the mock object is
created and yielded by the context manager, and the test function
doesn't need to pass the mock object as an argument.
2024-05-02 12:41:30 -07:00
Marc Abramowitz
4dfadb0cf4
mock_patch_acompletion in test_proxy_server.py
2024-05-02 12:24:49 -07:00
Ishaan Jaff and GitHub
7ffe410097
Merge pull request #3392 from BerriAI/litellm_fix_langfuse_reinitalized
...
[Fix] bug where langfuse was reinitialized on every call
2024-05-02 10:54:47 -07:00
Marc Abramowitz
152b5c8ceb
Add test_openai_deployments_model_chat_completions_azure
2024-05-02 10:27:32 -07:00
Ishaan Jaff and GitHub
e16ca10ea5
Merge pull request #3278 from greenscale-ai/main
...
Fix Greenscale Documentation
2024-05-02 08:26:12 -07:00
greenscale-nandesh and GitHub
6009632705
Merge branch 'main' into main
2024-05-02 08:22:11 -07:00
Krrish Dholakia
18cb0bc530
fix(utils.py): revert pydantic object changes
2024-05-02 08:14:45 -07:00
Krrish Dholakia
16522a5351
fix(utils.py): add missing providers + models to validate_environment
...
Closes https://github.com/BerriAI/litellm/issues/3190
2024-05-02 08:14:45 -07:00
Ishaan Jaff and GitHub
c8ceab872f
Merge pull request #2967 from BerriAI/dependabot/pip/idna-3.7
...
build(deps): bump idna from 3.6 to 3.7
2024-05-02 07:43:38 -07:00
Ishaan Jaff and GitHub
55de1c1c76
Merge pull request #3169 from BerriAI/dependabot/npm_and_yarn/litellm-js/spend-logs/hono/node-server-1.10.1
...
build(deps): bump @hono/node-server from 1.9.0 to 1.10.1 in /litellm-js/spend-logs
2024-05-02 07:43:01 -07:00
Ishaan Jaff and GitHub
ee8d0b6d5f
Merge pull request #3217 from DomMartin27/litellm_readme
...
Update contributing instructions in README.md
2024-05-02 07:42:44 -07:00
Ishaan Jaff and GitHub
08518240a2
Merge pull request #3349 from nobu007/add_pull_request_template
...
docs: add .github/pull_request_template.md
2024-05-02 07:39:35 -07:00
Krrish Dholakia
caf19478af
fix(utils.py): fix pydantic object default values
2024-05-01 22:51:46 -07:00
Christian Privitelli
2d43153efa
include methods in init import, add test, fix encode/decode param ordering
2024-05-02 15:49:22 +10:00
Krrish Dholakia
29aefaa7d7
fix(utils.py): fix default values
2024-05-01 22:24:37 -07:00
Krrish Dholakia
f7d7d34261
bump: version 1.35.35 → 1.35.36
2024-05-01 21:59:33 -07:00
Krrish Dholakia
0251543e7a
refactor(main.py): trigger new build
2024-05-01 21:59:33 -07:00
Christian Privitelli
3449a5e446
update docs, allow use with encode/decode
2024-05-02 14:56:38 +10:00
Ishaan Jaff
761aa7e5c8
ui - new build
2024-05-01 21:43:00 -07:00
Krish Dholakia and GitHub
24fc934622
Merge pull request #3379 from elisalimli/main
...
[chore] Improve type-safety in Message & Delta classes
2024-05-01 21:19:52 -07:00
Krish Dholakia and GitHub
be8d01974b
Merge pull request #3389 from BerriAI/litellm_openmeter_integration
...
feat(openmeter.py): add support for user billing
2024-05-01 21:19:35 -07:00
Krish Dholakia and GitHub
fffbb73465
Merge branch 'main' into litellm_openmeter_integration
2024-05-01 21:19:29 -07:00
Krrish Dholakia
cdd3e1eef3
build(ui): enable adding openmeter via proxy ui
2024-05-01 21:16:23 -07:00
Ishaan Jaff
3d9287602e
ci/cd run again
2024-05-01 21:13:14 -07:00
Christian Privitelli
b4d4b42cfa
fix docs
2024-05-02 14:11:03 +10:00
Christian Privitelli
2fd2e811fd
add llama3 tokenizer and support for custom tokenizer
2024-05-02 14:05:38 +10:00
Ishaan Jaff
17a5a09028
ci/cd bump langfuse testing version
2024-05-01 21:04:31 -07:00
Ishaan Jaff and GitHub
f3dfe5f2ab
Merge pull request #3262 from Manouchehri/update-langfuse-py-1
...
Update langfuse in `requirements.txt`
2024-05-01 21:03:23 -07:00
Ishaan Jaff
8a3d8f8ee4
fix bug where langfuse was reinitialized
2024-05-01 20:47:25 -07:00
Ishaan Jaff