Commit Graph
14698 Commits
Author SHA1 Message Date
Krish DholakiaandGitHub 74e263b8de Merge pull request #4723 from BerriAI/litellm_add_dynamic_api_base
fix(utils.py): allow passing dynamic api base for openai-compatible endpoints (Fireworks AI, etc.)
2024-07-15 21:35:22 -07:00
Krrish Dholakia d136f2b8a7 fix(litellm_logging.py): fix circular reference 2024-07-15 21:28:33 -07:00
Ishaan Jaff eaee90b02e docs - passing extra_headers to anthropic api 2024-07-15 21:15:39 -07:00
Krrish Dholakia 155ee7e99c fix(factory.py): allow converting pdf url to base64 2024-07-15 21:11:53 -07:00
Krish DholakiaandGitHub bbe98151ef Merge pull request #4721 from danielbichuetti/fireworks-model-updates
[Feature]: Add Fireworks AI data to model_prices_and_context_window.json
2024-07-15 21:08:50 -07:00
Ishaan Jaff 0c015003d1 bump: version 1.41.22 → 1.41.23 2024-07-15 21:00:19 -07:00
Ishaan Jaff 4aa98dcbe9 test_amazing_sync_embedding 2024-07-15 20:53:13 -07:00
Ishaan Jaff 4baa48ba4b fix test_sync_embedding 2024-07-15 20:51:29 -07:00
Ishaan JaffandGitHub 254ac37f65 Merge pull request #4724 from BerriAI/litellm_Set_max_file_size_transc
[Feat] - set max file size on /audio/transcriptions
2024-07-15 20:42:24 -07:00
Ishaan Jaff af19a2aff3 ui new build 2024-07-15 20:09:17 -07:00
Ishaan JaffandGitHub 979b5d8eea Merge pull request #4719 from BerriAI/litellm_fix_audio_transcript
[Fix] /audio/transcription - don't write to the local file system
2024-07-15 20:05:42 -07:00
Ishaan JaffandGitHub 4dfc00ae0d Merge pull request #4715 from BerriAI/litellm_stack_cache_ui_analytics
Admin UI - Stack Cache hits vs misses on UI
2024-07-15 20:05:32 -07:00
Ishaan Jaff e1c1149a64 docs set max file size on requests 2024-07-15 20:05:14 -07:00
Ishaan Jaff bac6685bfc fix linting 2024-07-15 20:02:41 -07:00
Krrish Dholakia a15ba2592a fix(utils.py): allow passing dynamic api base for openai-compatible endpoints 2024-07-15 20:00:44 -07:00
Ishaan Jaff 0bd747ef7e max_file_size_mb in float 2024-07-15 19:58:41 -07:00
Ishaan Jaff 38cef1c58d fix error from max file size 2024-07-15 19:57:33 -07:00
Ishaan Jaff 685253568b doc set max file size 2024-07-15 19:57:17 -07:00
Krrish Dholakia 9e07af6c02 docs(vertex.md): Retrieve grounding metadata from call 2024-07-15 19:47:48 -07:00
Krrish Dholakia 023f10cf1c fix(vertex_httpx.py): return grounding metadata 2024-07-15 19:43:37 -07:00
Ishaan Jaff 48d28e37a4 fix set max_file_size 2024-07-15 19:41:38 -07:00
Ishaan Jaff b5a2090720 use helper to check check_file_size_under_limit 2024-07-15 19:40:05 -07:00
Ishaan Jaff 6c060b1fdc check_file_size_under_limit 2024-07-15 19:38:08 -07:00
Ishaan Jaff e65daef572 router return get_deployment_by_model_group_name 2024-07-15 19:27:12 -07:00
Krrish Dholakia 959c627dd3 fix(litellm_logging.py): log response_cost=0 for failed calls
Fixes https://github.com/BerriAI/litellm/issues/4604
2024-07-15 19:25:56 -07:00
Ishaan Jaff 865469e43f allow setting max_file_size_mb 2024-07-15 19:25:24 -07:00
Krrish Dholakia 9cc2daeec9 fix(utils.py): update get_model_info docstring
Fixes https://github.com/BerriAI/litellm/issues/4711
2024-07-15 18:18:50 -07:00
Daniel BichuettiandGitHub cc906319ba Update model_prices_and_context_window.json 2024-07-15 20:44:16 -03:00
Krrish Dholakia ff1bcdd3b5 docs(streaming_logging.md): fix example 2024-07-15 14:58:15 -07:00
Ishaan Jaff a900f352b5 fix - don't write file.filename v1.41.22.dev4 2024-07-15 14:56:01 -07:00
Krrish Dholakia e8e31c4029 docs(enterprise.md): cleanup docs 2024-07-15 14:52:08 -07:00
Krish DholakiaandGitHub 177424c27c Merge pull request #4714 from djliden/main
updates cost tracking example code in docs to resolve errors
2024-07-15 14:50:09 -07:00
Ishaan Jaff 3dc2ec8119 fix show debugging utils on in mem usage 2024-07-15 10:05:57 -07:00
Ishaan Jaff ced35cd841 stack cache hits 2024-07-15 09:10:39 -07:00
Daniel LidenandGitHub b789440854 Update streaming_logging.md
updates cost tracking code

- replace `completion_response` with `response_obj`
- add `import logging`
2024-07-15 10:21:55 -05:00
Krrish Dholakia 2bf1f06a0e bump: version 1.41.21 → 1.41.22 v1.41.22 2024-07-14 08:06:53 -07:00
Krrish Dholakia 82ca7af6df fix(vertex_httpx.py): google search grounding fix 2024-07-14 08:06:17 -07:00
Krrish Dholakia 385da04d72 docs(vertex.md): add reference vertex ai grounding doc 2024-07-13 22:04:38 -07:00
Krrish Dholakia fe6ea9f892 docs(user_keys.md): add openai js example to docs 2024-07-13 22:00:53 -07:00
Krish DholakiaandGitHub 6bf60d773e Merge pull request #4696 from BerriAI/litellm_guardrail_logging_only
Allow setting `logging_only` in guardrails config
2024-07-13 21:50:43 -07:00
Krish DholakiaandGitHub 1e2e67c3fe Merge pull request #4702 from BerriAI/litellm_add_azure_ai_pricing
add azure ai pricing + token info (mistral/jamba instruct/llama3)
2024-07-13 21:50:31 -07:00
Krish DholakiaandGitHub 7bc9a189e7 Merge branch 'main' into litellm_add_azure_ai_pricing 2024-07-13 21:50:26 -07:00
Krrish Dholakia 9cca25f874 test(test_end_users.py): fix test 2024-07-13 21:46:19 -07:00
Krrish Dholakia d475311eb3 test(test_presidio_pii_masking.py): fix presidio test 2024-07-13 21:44:22 -07:00
Krish DholakiaandGitHub d0fb685c56 Merge pull request #4706 from BerriAI/litellm_retry_after
Return `retry-after` header for rate limited requests
2024-07-13 21:37:41 -07:00
Krrish Dholakia de8230ed41 fix(proxy_server.py): fix returning response headers on exception 2024-07-13 19:11:30 -07:00
Ishaan JaffandGitHub 4d7d6504b6 Merge pull request #4704 from BerriAI/litellm_debug_mem
[Debug-Utils] Add some useful memory usage debugging utils
2024-07-13 18:44:40 -07:00
Ishaan JaffandGitHub ed5114c680 Merge pull request #4703 from BerriAI/litellm_only_use_internal_use_cache
[Fix Memory Usage] - only use per request tracking if slack alerting is being used
2024-07-13 18:40:22 -07:00
Ishaan JaffandGitHub 785081422c Merge pull request #4705 from BerriAI/litellm_return_internal_cache_usage
feat mem utils debugging return size of in memory cache
2024-07-13 18:24:53 -07:00
Ishaan Jaff 31783196c0 feat - return size of in memory cache 2024-07-13 18:22:44 -07:00