ca098d1bf9
Fix typo gemini.md
2025-03-27 14:53:02 +01:00
3ca34a181c
docs(openai.md): add gpt-4o-transcribe to docs
2025-03-26 23:23:35 -07:00
6ba31e1d84
Allow viewing keyinfo on request logs ( #9568 )
...
* feat(view_logs.tsx): show model id + api base in request logs
easier debugging
* fix(index.tsx): fix length of api base
easier viewing
* build(ui/): initial commit allowing user to click into key from request logs
allows easier debugging of 'what key is this?
2025-03-26 23:11:15 -07:00
c0845fec1f
Add OpenAI gpt-4o-transcribe support ( #9517 )
...
* refactor: introduce new transformation config for gpt-4o-transcribe models
* refactor: expose new transformation configs for audio transcription
* ci: fix config yml
* feat(openai/transcriptions): support provider config transformation on openai audio transcriptions
allows gpt-4o and whisper audio transformation to work as expected
* refactor: migrate fireworks ai + deepgram to new transform request pattern
* feat(openai/): working support for gpt-4o-audio-transcribe
* build(model_prices_and_context_window.json): add gpt-4o-transcribe to model cost map
* build(model_prices_and_context_window.json): specify what endpoints are supported for `/audio/transcriptions`
* fix(get_supported_openai_params.py): fix return
* refactor(deepgram/): migrate unit test to deepgram handler
* refactor: cleanup unused imports
* fix(get_supported_openai_params.py): fix linting error
* test: update test
2025-03-26 23:10:25 -07:00
109add7946
build(model_prices_and_context_window.json): add gemini multimodal embedding cost
2025-03-26 23:04:24 -07:00
7097ce544e
Merge pull request #9569 from BerriAI/litellm_fix_db_unavailable
...
[Reliability Fix] - Allow Pods to startup + passing /health/readiness when `allow_requests_on_db_unavailable: True` and DB is down
2025-03-26 21:18:52 -07:00
05c38049fe
docs prod.md
2025-03-26 21:04:36 -07:00
b6506f7bda
test_db_health_readiness_check_with_prisma_error
2025-03-26 20:56:39 -07:00
87f0201f84
test_handle_db_exception_with_connection_error
2025-03-26 20:44:25 -07:00
34e58be36d
fix order of _setup_prisma_client
2025-03-26 20:42:01 -07:00
427580eff5
fix _setup_prisma_client
2025-03-26 20:35:27 -07:00
15c04da735
refactor tests
2025-03-26 20:00:10 -07:00
88ef97b9d1
allow proxy to startup on DB unavailable
2025-03-26 19:50:57 -07:00
497570b2a6
bug fix - allow pods to startup when DB is unavailable
2025-03-26 19:49:51 -07:00
7142b0b610
refactor PrismaDBExceptionHandler
2025-03-26 19:22:24 -07:00
0155b0eba2
Merge pull request #9533 from BerriAI/litellm_stability_fixes
...
[Reliability Fixes] - Gracefully handle exceptions when DB is having an outage
2025-03-26 18:57:38 -07:00
485aa87e65
allow_requests_on_db_unavailable
2025-03-26 18:48:18 -07:00
763f853a9f
docs fix
2025-03-26 18:32:58 -07:00
5242c5fbab
test - auth exception handler
2025-03-26 18:28:28 -07:00
15b1a8afb0
test_is_database_connection_error_prisma_errors
2025-03-26 18:27:39 -07:00
4351c77253
Support Gemini audio token cost tracking + fix openai audio input token cost tracking ( #9535 )
...
* fix(vertex_and_google_ai_studio_gemini.py): log gemini audio tokens in usage object
enables accurate cost tracking
* refactor(vertex_ai/cost_calculator.py): refactor 128k+ token cost calculation to only run if model info has it
Google has moved away from this for gemini-2.0 models
* refactor(vertex_ai/cost_calculator.py): migrate to usage object for more flexible data passthrough
* fix(llm_cost_calc/utils.py): support audio token cost tracking in generic cost per token
enables vertex ai cost tracking to work with audio tokens
* fix(llm_cost_calc/utils.py): default to total prompt tokens if text tokens field not set
* refactor(llm_cost_calc/utils.py): move openai cost tracking to generic cost per token
more consistent behaviour across providers
* test: add unit test for gemini audio token cost calculation
* ci: bump ci config
* test: fix test
2025-03-26 17:26:25 -07:00
04490c99d7
test: fix test
2025-03-26 17:12:09 -07:00
72c0ad419f
build(migration.sql): add migration file for new dailyusertable
...
documents prisma db changes
2025-03-26 17:11:25 -07:00
d4adc9764b
test(test_db_schema_migration.py): ci/cd test to enforce schema migrations are documented in .sql files
2025-03-26 16:59:50 -07:00
37265c8b1c
Add Daily User Spend Aggregate view - allows UI Usage tab to work > 1m rows ( #9538 )
...
* ci: update github action
* build(schema.prisma): enable daily user spend table
allows storing aggregate view of user's daily spend
* build(schema.prisma): add new daily user spend table
* feat: working daily user spend tracking
maintains an aggregate view for easier querying in high traffic
* setup_google_dns
* ci: update ci yaml
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com >
2025-03-26 16:36:36 -07:00
fb9abd40f3
ci(config.yml): add pytest-postgres to ci/cd
2025-03-26 16:25:08 -07:00
132d3f7baa
feat(prisma-migrations): add baseline db migration file ( #9565 )
...
adds initial baseline db migration file
enables future schema changes to be documented via .sql files
2025-03-26 16:22:56 -07:00
b7f4abd13a
Merge pull request #9542 from BerriAI/litellm_fix_vertex_ai_ft_models
...
[Feature]: Support for Fine-Tuned Vertex AI LLMs
2025-03-26 16:19:41 -07:00
23aa7f81b5
fix ProxyException
2025-03-26 15:53:33 -07:00
ff33ed020c
fix auth checks
2025-03-26 15:45:58 -07:00
8bd2081dec
fix get_key_object
2025-03-26 15:41:40 -07:00
f8caebc54b
is_database_connection_error
2025-03-26 14:55:40 -07:00
4948673e35
fix test changes
2025-03-26 14:51:33 -07:00
1812ce4a54
undo config.yml changes
2025-03-26 14:43:03 -07:00
044c56c439
Merge branch 'main' into litellm_stability_fixes
2025-03-26 14:41:43 -07:00
0aae9aa24a
rename _is_model_gemini_spec_model
2025-03-26 14:28:26 -07:00
c38b41f65b
test_get_supports_system_message
2025-03-26 14:26:08 -07:00
72f08bc6ea
unit tests for VertexGeminiConfig
2025-03-26 14:21:35 -07:00
8eaf4c55c0
test_gemini_fine_tuned_model_request_consistency
2025-03-26 14:18:11 -07:00
da9d849348
test_gemini_fine_tuned_model_request_consistency
2025-03-26 14:10:32 -07:00
82faa49668
doc fix Fine-tuned Models
2025-03-26 14:09:27 -07:00
28ab8fdccc
docs vertex ft model
2025-03-26 14:08:19 -07:00
e24a601897
docs verte ft models
2025-03-26 14:03:42 -07:00
82016eba0a
docs vertex ft models
2025-03-26 13:55:38 -07:00
12eb77d02d
docs litellm vertex ai ft models
2025-03-26 12:24:49 -07:00
93daf5cbac
_get_model_name_from_gemini_spec_model
2025-03-26 12:16:18 -07:00
801ecb6517
Nova Canvas complete image generation tasks ( #9177 ) ( #9525 )
...
* Nova Canvas complete image generation tasks (#9177 )
* add initial support for Amazon Nova Canvas model
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* adjust name to AmazonNovaCanvas and map function variables to config
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* tighten model name check
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* fix quality mapping
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add premium quality in config
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* support all Amazon Nova Canvas tasks
* remove unused import
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add tests for image generation tasks and fix payload
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add missing util file
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* update model prices backup file
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* remove image tasks other than text->image
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add color guided generation task for Nova Canvas
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* fix merge
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add nova canvas image generation documentation
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
* add nova canvas unit tests
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
---------
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com >
* ci(config.yml): bump ci config
* test: fix test
---------
Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com >
Co-authored-by: omrishiv <327609+omrishiv@users.noreply.github.com >
2025-03-26 11:28:20 -07:00
793a920caa
rename _is_model_gemini_spec_model
2025-03-26 11:14:51 -07:00
1822c45c0e
test fix test_pick_cheapest_chat_model_from_llm_provider
2025-03-26 11:13:21 -07:00
baa9b34950
Merge branch 'main' into litellm_fix_vertex_ai_ft_models
2025-03-26 11:11:54 -07:00
Gabriel Loiseau