sentry-setup-ai-monitoring
Instrument OpenAI, Anthropic, Vercel AI, LangChain, Google GenAI, and Pydantic AI
Developer Setup
Setup & Installation
npx skills add https://github.com/getsentry/sentry-for-ai --skill sentry-setup-ai-monitoringnpx skills add https://github.com/getsentry/sentry-for-ai --skill sentry-setup-ai-monitoringOverview
What This Skill Does
Setup Sentry AI Agent Monitoring in any project. Use when asked to monitor LLM calls, track AI agents, or instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI. Detects installed AI SDKs and configures appropriate integrations.
Application
When to use this Skill
- Configuring integration settings for custom agent workflows.
- Optimizing query execution and response latency in production.
- Developing clean, standard-compliant implementations for enterprise services.
- Troubleshooting connection timeouts and authentication handshakes.
- Monitoring API rate limits and execution pipelines programmatically.
Documentation
Show Skills.md file
All Skills > Feature Setup > AI Monitoring
Setup Sentry AI Agent Monitoring
Configure Sentry to track LLM calls, agent executions, tool usage, and token consumption.
Invoke This Skill When
- User asks to "monitor AI/LLM calls" or "track OpenAI/Anthropic usage"
- User wants "AI observability" or "agent monitoring"
- User asks about token usage, model latency, or AI costs
Important: The SDK versions, API names, and code samples below are examples. Always verify against docs.sentry.io before implementing, as APIs and minimum versions may have changed.
Prerequisites
AI monitoring requires tracing enabled (tracesSampleRate > 0).
Data Capture Warning
Prompt and output recording captures user content that is likely PII. Before enabling send-default-PII (sendDefaultPii: true in JavaScript or send_default_pii=True in Python) or per-integration prompt/output capture (recordInputs/recordOutputs in JS, include_prompts in Python), confirm:
- The application's privacy policy permits capturing user prompts and model responses
- Captured data complies with applicable regulations (GDPR, CCPA, etc.)
- Sentry data retention settings are appropriate for the sensitivity of the data
Recommendations
Explore other random skills
voltagent-core-reference
Reference for the VoltAgent class options and lifecycle methods
gemini-live-api-dev
Building real-time bidirectional streaming apps with the Gemini Live API
gemini-api-dev
Best practices for developing Gemini-powered apps using the Gemini API