Installation
Install AgentOps and the LlamaIndex AgentOps instrumentation package:Setting Up API Keys
You’ll need an AgentOps API key from your AgentOps Dashboard:Usage
Simply set the global handler to “agentops” at the beginning of your LlamaIndex application. AgentOps will automatically instrument LlamaIndex to track your LLM interactions and application performance.What Gets Tracked
When you use AgentOps with LlamaIndex, the following operations are automatically tracked:- LLM Calls: All interactions with language models including prompts, completions, and token usage
- Embeddings: Vector embedding generation and retrieval operations
- Query Operations: Search and retrieval operations on your indexes
- Performance Metrics: Response times, token costs, and success/failure rates