Ishaan Jaff
4bd85b9d83
add cerebras cost tracking
2024-08-31 16:29:26 -07:00
Krish Dholakia and Ishaan Jaff
47ef1f9191
anthropic prompt caching cost tracking ( #5453 )
...
* fix(utils.py): support 'drop_params' for embedding requests
Fixes https://github.com/BerriAI/litellm/issues/5444
* feat(anthropic/cost_calculation.py): Support calculating cost for prompt caching on anthropic
* feat(types/utils.py): allows us to migrate to openai's equivalent, once that comes out
* fix: fix linting errors
* test: mark flaky test
2024-08-31 14:50:12 -07:00
Ishaan Jaff and GitHub
fcdfaac84b
Merge pull request #5419 from Manouchehri/gemini-1.5-pro-exp-0827-pricing
...
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-30 10:50:10 -07:00
Kyrylo Yefimenko
a100b01b90
Add pricing for Openai ft:gpt-4o
2024-08-30 08:16:24 +01:00
Ishaan Jaff
26c03c9c8b
add pricing for vertex ai 21
2024-08-29 19:03:38 -07:00
David Manouchehri
19db80ffeb
(bedrock): Add new cross-region inference support for Bedrock.
2024-08-29 17:49:16 +00:00
Krish Dholakia and GitHub
a857f4a8ee
Merge branch 'main' into litellm_main_staging
2024-08-28 18:05:27 -07:00
David Manouchehri
824a8b557b
(models): Add gemini-1.5-pro-exp-0827 pricing.
2024-08-28 22:04:34 +00:00
Krrish Dholakia
17646b50ec
build(model_prices_and_context_window.json): bedrock/llama3 models - region-based pricing
2024-08-28 13:07:56 -07:00
Krrish Dholakia
023d0f7664
build(model_prices_and_context_window.json): fix bedrock/llama3-1 pricing
2024-08-28 12:54:24 -07:00
Karl Leswing
ec57490585
Also have pricing details
2024-08-28 14:43:35 -04:00
Karl Leswing
b5ce54c202
Support for gemini experimental models
2024-08-28 14:33:18 -04:00
Krrish Dholakia
76c38c6d4b
build(model_prices_and_context_window.json): add bedrock mistral small
2024-08-28 10:12:16 -07:00
Ishaan Jaff
3dee98dc47
add jamba-1.5
2024-08-27 14:20:06 -07:00
Ishaan Jaff
e9808346a7
add jamba-1.5-mini models
2024-08-27 14:02:02 -07:00
John HU and GitHub
9a18106745
Add pricing for imagen-3 and imagen-3-fast
2024-08-26 14:41:47 -07:00
Krish Dholakia and GitHub
b2e182a42c
Merge pull request #5314 from thiswillbeyourgithub/fix_missing_openrouter_claude_sonnet_beta
...
fix/docs: was missing a beta model from openrouter of claude sonnet
2024-08-21 08:31:21 -07:00
Paul Gauthier
2432cbc912
openrouter/anthropic/claude-3.5-sonnet: supports_assistant_prefill:true
2024-08-21 05:55:10 -07:00
thiswillbeyourgithub
00f7238c64
fix: was missing openrouter beta model from claude sonnet
2024-08-21 14:45:09 +02:00
Krish Dholakia and GitHub
5731287f1b
Merge pull request #5221 from kiriloman/adjust-pricing-file
...
[PRICING] Use specific llama2 and llama3 model names in Ollama
2024-08-17 14:03:20 -07:00
Kyrylo Yefimenko
e3cd8e169b
Use sepecific llama2 and llama3 model names in Ollama
2024-08-15 12:27:51 +01:00
Krrish Dholakia
1faa931f26
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to all vertex ai anthropic models
2024-08-14 14:08:12 -07:00
Krish Dholakia and GitHub
4c6b14c301
Merge pull request #5203 from paul-gauthier/main
...
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 14:06:20 -07:00
Aaron Bach
9d42dfb417
Update prices/context windows for Perplexity Llama 3.1 models
2024-08-14 13:20:22 -06:00
Paul Gauthier
6a32b05bb1
vertex_ai/claude-3-5-sonnet@20240620 support prefill
2024-08-14 10:14:19 -07:00
David Manouchehri
9617e578f3
(models): Add chatgpt-4o-latest.
2024-08-14 03:03:22 +00:00
Krrish Dholakia
19bb95f781
build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map
...
Closes https://github.com/BerriAI/litellm/issues/4881
2024-08-10 14:15:12 -07:00
Ishaan Jaff
c8997e3986
add cohere embed-multilingual-v2.0
2024-08-09 11:30:07 -07:00
Krrish Dholakia
5d664c0441
build(model_prices_and_context_window.json): Fixes https://github.com/BerriAI/litellm/issues/5113
2024-08-08 09:11:59 -07:00
Sam and GitHub
8459046585
Add deepseek-coder-v2(-lite), mistral-large, codegeex4 to ollama
2024-08-08 10:51:59 +12:00
Ishaan Jaff
5743640250
feat add ft:gpt-4o-mini-2024-07-18
2024-08-07 07:46:23 -07:00
Krrish Dholakia
bc8857ca23
build(model_prices_and_context_window.json): remove duplicate entries
2024-08-06 22:50:41 -07:00
Krish Dholakia and GitHub
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds
2024-08-06 22:47:13 -07:00
Ishaan Jaff
51ffbbb3fa
fix pricing
2024-08-06 11:39:20 -07:00
Ishaan Jaff
79100e44fd
add gpt-4o-2024-08-06
2024-08-06 11:37:43 -07:00
Krrish Dholakia
e0c986c000
build(model_prices_and_context_window.json): update gpt-4o-mini max_output_tokens
...
Fixes https://github.com/BerriAI/litellm/issues/5045
2024-08-05 09:30:18 -07:00
Ishaan Jaff
e3119cef38
add sample spec to model cost map
2024-08-05 09:27:26 -07:00
Krrish Dholakia
57644be857
build(model_prices_and_context_window.json): add deepseek cache hit pricing
2024-08-03 08:56:25 -07:00
Ishaan Jaff
fc3463e178
fix model prices formatting
2024-08-01 17:28:31 -07:00
Krish Dholakia and GitHub
caf11ce7da
Merge pull request #5002 from Manouchehri/gemini-1.5-pro-exp-0801-gemini-1
...
Add new model for gemini-1.5-pro-exp-0801.
2024-08-01 17:27:49 -07:00
Ishaan Jaff
a52ffb9365
add correct context window
2024-08-01 16:50:11 -07:00
Ishaan Jaff
be7e6b1c53
add new dbrx models
2024-08-01 16:46:41 -07:00
Krrish Dholakia
246b3227a9
fix(vertex_ai_partner.py): add /chat/completion codestral support
...
Closes https://github.com/BerriAI/litellm/issues/4984
2024-08-01 16:12:05 -07:00
David Manouchehri
e6f18fdc62
Add new model for gemini-1.5-pro-exp-0801.
2024-08-01 22:20:19 +00:00
Krrish Dholakia
63735c9a54
build(model_prices_and_context_window.json): add mistral nemo latest to model cost map
2024-08-01 15:17:22 -07:00
Krrish Dholakia
d02d3d9712
build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map
2024-08-01 09:44:40 -07:00
Krrish Dholakia
8e24c3c945
build(model_prices_and_context_window.json): update model info for llama3.1 on bedrock - supports tool calling, not tool choice
2024-07-29 15:43:16 -07:00
Krish Dholakia and GitHub
e3a94ac013
Merge pull request #4925 from BerriAI/litellm_vertex_mistral
...
feat(vertex_ai_partner.py): Vertex AI Mistral Support
2024-07-27 21:51:26 -07:00
Krish Dholakia and GitHub
9efebc490d
Merge pull request #4730 from danielbichuetti/fireworks-fix-cost-map
...
[Feature]: Allow using custom and on-demand models in Fireworks AI + update data to model_prices_and_context_window.json
2024-07-27 16:43:48 -07:00
Krrish Dholakia
5b71421a7b
feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
...
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Ishaan Jaff