diff --git a/docs/my-website/docs/getting_started.md b/docs/my-website/docs/getting_started.md index 00d455e0c6..13118fd461 100644 --- a/docs/my-website/docs/getting_started.md +++ b/docs/my-website/docs/getting_started.md @@ -75,6 +75,24 @@ except OpenAIError as e: print(e) ``` +## Logging Observability - Log LLM Input/Output ([Docs](https://docs.litellm.ai/docs/observability/callbacks)) +LiteLLM exposes pre defined callbacks to send data to LLMonitor, Langfuse, Helicone, Promptlayer, Traceloop, Slack +```python +from litellm import completion + +## set env variables for logging tools +os.environ["PROMPTLAYER_API_KEY"] = "your-promptlayer-key" +os.environ["LLMONITOR_APP_ID"] = "your-llmonitor-app-id" + +os.environ["OPENAI_API_KEY"] + +# set callbacks +litellm.success_callback = ["promptlayer", "llmonitor"] # log input/output to promptlayer, llmonitor, supabase + +#openai call +response = completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hi 👋 - i'm openai"}]) +``` + More details 👉 * [exception mapping](./exception_mapping.md) * [retries + model fallbacks for completion()](./completion/reliable_completions.md) diff --git a/docs/my-website/docs/index.md b/docs/my-website/docs/index.md index 0e979cb830..cd136f8fbf 100644 --- a/docs/my-website/docs/index.md +++ b/docs/my-website/docs/index.md @@ -288,6 +288,24 @@ except OpenAIError as e: print(e) ``` +## Logging Observability - Log LLM Input/Output ([Docs](https://docs.litellm.ai/docs/observability/callbacks)) +LiteLLM exposes pre defined callbacks to send data to LLMonitor, Langfuse, Helicone, Promptlayer, Traceloop, Slack +```python +from litellm import completion + +## set env variables for logging tools +os.environ["PROMPTLAYER_API_KEY"] = "your-promptlayer-key" +os.environ["LLMONITOR_APP_ID"] = "your-llmonitor-app-id" + +os.environ["OPENAI_API_KEY"] + +# set callbacks +litellm.success_callback = ["promptlayer", "llmonitor"] # log input/output to promptlayer, llmonitor, supabase + +#openai call +response = completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hi 👋 - i'm openai"}]) +``` + ## Calculate Costs, Usage, Latency Pass the completion response to `litellm.completion_cost(completion_response=response)` and get the cost diff --git a/docs/my-website/src/pages/index.md b/docs/my-website/src/pages/index.md index f8e4c74a0d..0694818a01 100644 --- a/docs/my-website/src/pages/index.md +++ b/docs/my-website/src/pages/index.md @@ -286,6 +286,24 @@ except OpenAIError as e: print(e) ``` +## Logging Observability - Log LLM Input/Output ([Docs](https://docs.litellm.ai/docs/observability/callbacks)) +LiteLLM exposes pre defined callbacks to send data to LLMonitor, Langfuse, Helicone, Promptlayer, Traceloop, Slack +```python +from litellm import completion + +## set env variables for logging tools +os.environ["PROMPTLAYER_API_KEY"] = "your-promptlayer-key" +os.environ["LLMONITOR_APP_ID"] = "your-llmonitor-app-id" + +os.environ["OPENAI_API_KEY"] + +# set callbacks +litellm.success_callback = ["promptlayer", "llmonitor"] # log input/output to promptlayer, llmonitor, supabase + +#openai call +response = completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hi 👋 - i'm openai"}]) +``` + ## Calculate Costs, Usage, Latency Pass the completion response to `litellm.completion_cost(completion_response=response)` and get the cost