Paul Lang
97fce022e4
Fixes the tool_use chunk mapping
2024-08-15 15:44:09 -04:00
Krrish Dholakia
eb6a0a32f1
docs(bedrock.md): add guardrails on config.yaml to docs
2024-08-14 22:11:19 -07:00
Krrish Dholakia
c7fd626805
docs(team_logging.md): add key-based logging to docs
2024-08-14 21:49:55 -07:00
Krrish Dholakia
3487d84fcc
docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy
2024-08-14 21:43:31 -07:00
Ishaan Jaff
d8ef882905
fix langfuse log_provider_specific_information_as_span
2024-08-14 17:54:18 -07:00
Krish Dholakia and GitHub
970892fea7
Merge pull request #5209 from BerriAI/litellm_azure_ai_openai_support
...
fix(utils.py): support calling openai models via `azure_ai/`
2024-08-14 17:53:33 -07:00
Krish Dholakia and GitHub
435d39bb24
Merge branch 'main' into litellm_azure_ai_openai_support
2024-08-14 17:53:27 -07:00
Ishaan Jaff
9c039a9064
bump: version 1.43.12 → 1.43.13
2024-08-14 17:47:20 -07:00
Ishaan Jaff and GitHub
1f631606a5
Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
...
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
912acb1cae
docs using proxy with context caaching anthropic
2024-08-14 17:42:48 -07:00
Krish Dholakia and GitHub
c5647ac596
Merge pull request #5211 from msabramo/use-AZURE_API_VERSION-as-default-azure-openai-version
...
Use `AZURE_API_VERSION` env var as default azure openai version
2024-08-14 17:37:55 -07:00
Ishaan Jaff
2267b8a59f
docs add examples with litellm proxy
2024-08-14 17:13:26 -07:00
Ishaan Jaff
fd122aa7a3
docs add examples doing context caching anthropic sdk
2024-08-14 17:07:51 -07:00
Ishaan Jaff
78a2013e51
add test for large context in system message for anthropic
2024-08-14 17:03:10 -07:00
Ishaan Jaff
76a5f5d433
move claude prompt caching to diff file
2024-08-14 16:28:12 -07:00
Ishaan Jaff
e0ff4823d0
add test for caching tool calls
2024-08-14 16:19:14 -07:00
Marc Abramowitz
ac9aa1ab67
Use AZURE_API_VERSION as default azure openai version
...
Without this change, the default version of the Azure OpenAI API is hardcoded in
the code as an old version, `"2024-02-01"`. This change allows the user to set
the default version of the Azure OpenAI API by setting the environment variable
`AZURE_API_VERSION` or by using the command-line parameter `--api_version`.
2024-08-14 15:47:57 -07:00
Krrish Dholakia
6333b04be3
fix(factory.py): handle assistant null content
2024-08-14 15:44:38 -07:00
Ishaan Jaff
fccc6dc928
fix bedrock test
2024-08-14 15:27:20 -07:00
Ishaan Jaff
45e367d4d4
docs Caching - Continuing Multi-Turn Convo
2024-08-14 15:26:25 -07:00
Ishaan Jaff
54102a660d
pass cache_control in tool call
2024-08-14 15:18:11 -07:00
Ishaan Jaff
96f9655a02
test test_anthropic_api_prompt_caching_basic
2024-08-14 15:06:10 -07:00
Krish Dholakia and GitHub
75ed22d391
Merge pull request #5192 from BerriAI/litellm_fix_pass_through_endpoints
...
feat(user_api_key_auth.py): support calling langfuse with litellm user_api_key_auth
2024-08-14 14:59:46 -07:00
Ishaan Jaff
69a640e9c4
test amnthropic prompt caching
2024-08-14 14:59:46 -07:00
Krish Dholakia and GitHub
aa2267bddb
Merge branch 'main' into litellm_fix_pass_through_endpoints
2024-08-14 14:59:38 -07:00
Ishaan Jaff
b0651bd481
add anthropic cache controls
2024-08-14 14:56:49 -07:00
Krrish Dholakia
179dd7b893
docs(model_management.md): add section on adding additional model information to proxy config
2024-08-14 14:39:48 -07:00
Krrish Dholakia
9b46ec05b0
fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
...
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krrish Dholakia
10f27bb1b5
test(test_pass_through_endpoints.py): fix langfuse base
2024-08-14 14:13:21 -07:00
Krish Dholakia and GitHub
eb5f0a8da2
Merge pull request #5148 from fabceolin/main
...
Enable follow redirects in ollama_chat
2024-08-14 14:08:45 -07:00
Krrish Dholakia
1faa931f26
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to all vertex ai anthropic models
2024-08-14 14:08:12 -07:00
Ishaan Jaff
9791352dc6
add testing for test_anthropic_cache_controls_pt
2024-08-14 14:07:48 -07:00
Krish Dholakia and GitHub
4c6b14c301
Merge pull request #5203 from paul-gauthier/main
...
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 14:06:20 -07:00
Krrish Dholakia
1e78b3bf54
fix(utils.py): fix is_azure_openai_model helper function
2024-08-14 14:04:39 -07:00
Ishaan Jaff
68e24fbf14
test passing cache controls through anthropic msg
2024-08-14 13:49:07 -07:00
Krrish Dholakia
583a3b330d
fix(utils.py): support calling openai models via azure_ai/
2024-08-14 13:41:04 -07:00
Ishaan Jaff
209c91ac03
feat - anthropic api context caching v0
2024-08-14 13:08:03 -07:00
Krish Dholakia and GitHub
22243c6571
Merge pull request #5176 from BerriAI/litellm_key_logging
...
Allow specifying langfuse project for logging in key metadata
2024-08-14 12:55:07 -07:00
Krish Dholakia and GitHub
1766b61616
Merge pull request #5206 from bachya/bachya/perplexity-cost-updates
...
Update prices/context windows for Perplexity Llama 3.1 models
2024-08-14 12:53:40 -07:00
Aaron Bach
9d42dfb417
Update prices/context windows for Perplexity Llama 3.1 models
2024-08-14 13:20:22 -06:00
Krrish Dholakia
5af9794b9d
test(test_pass_through_endpoints.py): correctly reset test
2024-08-14 10:48:42 -07:00
Ishaan Jaff
066ed20eb0
bump: version 1.43.11 → 1.43.12
2024-08-14 10:42:08 -07:00
Ishaan Jaff
f0ea00d4ab
bump: version 1.43.10 → 1.43.11
2024-08-14 10:42:06 -07:00
Paul Gauthier
6a32b05bb1
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 10:14:19 -07:00
Krrish Dholakia
edbe9e0741
test(test_function_call_parsing.py): fix test
2024-08-14 09:59:13 -07:00
Krrish Dholakia
6bcfa90ba8
test(test_pass_through_endpoints.py): fix test
2024-08-14 09:53:19 -07:00
Ishaan Jaff and GitHub
98ea24aab0
Merge pull request #5202 from BerriAI/litellm_prom_prefix_litellm
...
[Fix] Prometheus use 'litellm_' prefix for new deployment metrics
2024-08-14 09:50:36 -07:00
Ishaan Jaff and GitHub
38b6196413
Merge pull request #5200 from BerriAI/litellm_gcs_failure_callback
...
[Feat-Proxy] Add failure logging for GCS bucket
2024-08-14 09:50:29 -07:00
Ishaan Jaff and GitHub
69f6952597
Merge pull request #5186 from BerriAI/litellm_prisma_issues
...
[Fix-Proxy] Fix prisma non-root user issues
2024-08-14 09:29:57 -07:00
Ishaan Jaff
47afbfcbaa
allow running as non-root user
2024-08-14 09:26:47 -07:00
Paul Lang