Automatic LLM Call Tracking
AgentOps makes tracking LLM calls incredibly simple. Just initialize the SDK with your API key, and AgentOps will automatically track all your LLM calls:How it works
When the AgentOps SDK detects a supported LLM provider module installed, it will automatically start tracking its usage. No further work is required from you! 😊Supported LLM Providers
AgentOps supports automatic tracking for many popular LLM providers, including:- OpenAI
- Anthropic
- Google (Gemini)
- LiteLLM
- And more
Not working?
Try these steps:- Make sure you have the latest version of the AgentOps SDK installed. We are constantly updating it to support new LLM libraries and releases.
- Make sure you are calling
agentops.init()
after importing the LLM module but before you are calling the LLM method. - Make sure the
instrument_llm_calls
parameter ofagentops.init()
is set toTrue
(default).