mirror of
https://github.com/tiennm99/litellm.git
synced 2026-08-21 08:26:34 +00:00
docs(token_usage.md): add response cost to usage docs
This commit is contained in:
@@ -1,7 +1,21 @@
|
||||
# Completion Token Usage & Cost
|
||||
By default LiteLLM returns token usage in all completion requests ([See here](https://litellm.readthedocs.io/en/latest/output/))
|
||||
|
||||
However, we also expose some helper functions + **[NEW]** an API to calculate token usage across providers:
|
||||
LiteLLM returns `response_cost` in all calls.
|
||||
|
||||
```python
|
||||
from litellm import completion
|
||||
|
||||
response = litellm.completion(
|
||||
model="gpt-3.5-turbo",
|
||||
messages=[{"role": "user", "content": "Hey, how's it going?"}],
|
||||
mock_response="Hello world",
|
||||
)
|
||||
|
||||
print(response._hidden_params["response_cost"])
|
||||
```
|
||||
|
||||
LiteLLM also exposes some helper functions:
|
||||
|
||||
- `encode`: This encodes the text passed in, using the model-specific tokenizer. [**Jump to code**](#1-encode)
|
||||
|
||||
@@ -23,7 +37,7 @@ However, we also expose some helper functions + **[NEW]** an API to calculate to
|
||||
|
||||
- `api.litellm.ai`: Live token + price count across [all supported models](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json). [**Jump to code**](#10-apilitellmai)
|
||||
|
||||
📣 This is a community maintained list. Contributions are welcome! ❤️
|
||||
📣 [This is a community maintained list](https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json). Contributions are welcome! ❤️
|
||||
|
||||
## Example Usage
|
||||
|
||||
|
||||
Reference in New Issue
Block a user