LiteLLM allows tracking 100+ LLMs with AgentOps. Checkout the providers supported by LiteLLM. Visit the LiteLLM docs for more information.

Using AgentOps with LiteLLM

1

Install the AgentOps SDK

pip install agentops
2

Install LiteLLM

AgentOps supports litellm>=1.3.1

pip install litellm
3

Initialize AgentOps and use LiteLLM in your code

AgentOps requires a minor adjustment to how you call LiteLLM. This is because of other existing integrations that use the completion function.

import agentops
import litellm

agentops.init(<INSERT YOUR API KEY HERE>)

# Some code here...

response = litellm.completion(model="gpt-4o", messages=messages)

# Some code here...

agentops.end_session('Success')

Set your API key as an .env variable for easy access.

AGENTOPS_API_KEY=<YOUR API KEY>

Read more about environment variables in Advanced Configuration

4

Run your Agent

Execute your program and visit app.agentops.ai/drilldown to observe your Agent! šŸ•µļø

After your run, AgentOps prints a clickable url to console linking directly to your session in the Dashboard

Clickable link to session

Full Examples

An example notebook is available here.