LiteLLM allows tracking 100+ LLMs with AgentOps. Checkout the providers supported by LiteLLM. Visit the LiteLLM docs for more information.

​
Using AgentOps with LiteLLM

1

Install the AgentOps SDK

2

Install LiteLLM

AgentOps supports litellm>=1.3.1

3

Initialize AgentOps and use LiteLLM in your code

AgentOps requires a minor adjustment to how you call LiteLLM. This is because of other existing integrations that use the completion function.

Set your API key as an .env variable for easy access.

Read more about environment variables in Advanced Configuration

4

Run your Agent

Execute your program and visit app.agentops.ai/drilldown to observe your Agent! 🕵️

After your run, AgentOps prints a clickable url to console linking directly to your session in the Dashboard

Clickable link to session

​
Full Examples

An example notebook is available here.

Llama StackMistral