​

Frequently Asked Questions

​

General Questions

​

What is A24Z?

​

Is A24Z free?

• Free Tier: Up to 100K events/month, perfect for individual developers
• Team Tier: $49/user/month with unlimited events
• Enterprise: Custom pricing for large organizations

​

Which AI tools does A24Z support?

• Claude Code
• Gemini CLI
• Codex

• Cursor
• Continue
• Aider
• And more!

​

How does A24Z differ from other observability tools?

• Specialized Metrics: Tool success rates, prompt effectiveness, AI-specific analytics
• Easy Setup: One command installation
• AI-Native: Understands AI tool semantics
• Cost Tracking: Token usage and cost attribution

​

Privacy & Security

​

Is my code data safe?

• No Code Storage: We only store metadata (tool names, execution times, success/failure)
• Encryption: All data encrypted in transit and at rest
• Organization Isolation: Strict multi-tenant data separation
• SOC 2 Compliant: Audited security practices

​

What data does A24Z collect?

• Tool execution events (name, timestamp, duration)
• Success/failure status
• Token usage and costs
• Session metadata
• Error messages (sanitized)

• Source code content
• File contents
• Passwords or secrets
• Personal user data

​

Can I delete my data?

• Delete individual sessions
• Purge all data
• Close your account (deletes everything)

​

Is A24Z GDPR compliant?

• Right to access your data
• Right to deletion
• Data portability
• Consent management
• Privacy by design

​

Technical Questions

​

Does A24Z slow down my tools?

• Async Hooks: Non-blocking event capture
• Fast API: Sub-millisecond overhead
• Graceful Degradation: Tools work even if A24Z is down
• Local Buffering: No blocking on network

​

Can I self-host A24Z?

• Run on your own infrastructure
• Deploy to your cloud
• Customize for your needs

​

What’s the data retention period?

• Free Tier: 7 days
• Team Tier: 30 days
• Enterprise: Custom (up to 2 years)

​

Can I export my data?

• CSV Export: Via dashboard
• API Access: Programmatic data access
• Database Dump: For self-hosted instances

​

Billing & Plans

​

How does billing work?

• Events: Number of tool executions
• Users: Number of active users
• Storage: Data retention period

​

Can I change plans?

• Upgrade: Immediate access to new features
• Downgrade: Takes effect next billing cycle
• Cancel: Data retained for 30 days

​

Do you offer discounts?

• Annual Plans: 20% discount
• Startups: 50% off for YC companies
• Education: Free for students/educators
• Open Source: Free for OSS projects

​

What payment methods do you accept?

• Credit cards (Visa, Mastercard, Amex)
• ACH/Wire (Enterprise only)
• Purchase orders (Enterprise only)

​

Usage & Features

​

How do I invite team members?

1. Go to Settings → Team
2. Click “Invite Member”
3. Enter email address
4. Select role (Admin, Manager, User)
5. Send invitation

​

Can I integrate A24Z with other tools?

• Slack: Notifications and alerts
• Datadog: Forward metrics
• PagerDuty: Critical alerts
• Webhooks: Custom integrations

​

How do I set up alerts?

1. Go to Settings → Alerts
2. Click “New Alert”
3. Choose metric and threshold
4. Select notification channel
5. Save

​

Can I create custom dashboards?

• Dashboard Builder: Drag-and-drop interface
• Templates: Pre-built dashboards
• API: Build custom UIs

​

Organization & Teams

​

What’s the difference between organizations and teams?

• Organization: Top-level entity (e.g., “Acme Corp”)
• Team: Group within organization (e.g., “Platform Team”)

​

Can I belong to multiple organizations?

• Consultant working with multiple clients
• Employee at company + personal projects
• Contractor for multiple organizations

​

What roles are available?

• Admin: Full access, billing, user management
• Member: Team data access

​

Support

​

How do I get help?

• Documentation: docs.a24z.ai
• Community: Slack
• Email: [email protected]
• GitHub: Issues

​

What’s your support SLA?

• Community support
• Best-effort response

• Email support
• 24-hour response time

• Priority support
• 4-hour response time
• Dedicated Slack channel
• Phone support available

​

Can I request features?

1. Check GitHub Discussions
2. Vote on existing requests
3. Submit new feature requests
4. Describe your use case

​

Is there a roadmap?

• Upcoming features
• In-progress work
• Recently shipped

​

Migration & Compatibility

​

Can I migrate from another observability platform?

• Custom logging solutions
• Generic observability platforms
• Other AI monitoring tools

​

What Node.js versions are supported?

• Minimum: Node.js 18.0.0
• Recommended: Node.js 20 LTS
• Tested: Node.js 18, 20, 21

​

What operating systems are supported?

• macOS: 10.15+
• Linux: Ubuntu 20.04+, Debian 11+, RHEL 8+
• Windows: WSL2 (Windows 10/11)

​

Advanced Usage

​

Can I use A24Z programmatically?

curl -X GET https://api.a24z.ai/metrics \
  -H "x-api-key: sk_live_..."

​

Can I customize what data is collected?

• Filter by tool name
• Sample percentage (e.g., collect 10% of events)
• Custom attributes
• Exclude sensitive operations

​

How do I debug hook issues?

export A24Z_DEBUG=true
a24z status

tail -f ~/.claude/a24z.log

​

What happens if A24Z is down?

• Graceful degradation: Tools work even if A24Z is unavailable
• Local buffering: Events are buffered locally
• Automatic retry: Events are sent when service resumes
• No data loss: Buffered events are preserved

​

Can I use A24Z offline?

• Tools work offline: Your AI tools function normally
• Data buffered: Events are queued locally
• Syncs when online: Data is sent when connection restored

​

How accurate are the metrics?

• Tool executions: 100% accurate (captured at hook level)
• Token counts: Provided by AI provider APIs
• Costs: Based on official provider pricing
• Timestamps: UTC timezone, millisecond precision

​

Can I integrate with CI/CD?

# In your CI pipeline
a24z track --session build-${BUILD_ID} \
  --metric build_time --value $DURATION

• Track AI-generated test coverage
• Measure test generation success rate
• Cost per test file

​

What’s the difference between sessions and executions?

• Session: A conversation or task (e.g., “implement feature X”)
• Execution: Individual tool use within a session (e.g., “view file Y”)

​

Can I share dashboards with my team?

1. Shared dashboard URLs: Copy link and share
2. Embedded dashboards: Embed in internal tools
3. Scheduled reports: Email dashboard snapshots
4. Public dashboards: (Enterprise) Share with external stakeholders

​

How do I track costs by project?

# Configure project tag
a24z config set project "project-alpha"

# Or per session
a24z track --project "project-beta"

​

What metrics should I track?

• Tool success rate (target: >85%)
• Average execution time
• Error rate and types

• Team productivity (executions/day)
• Cost per engineer
• Success rate trends

• Organization-wide costs
• ROI (time saved vs cost)
• Adoption rate

​

How do I improve my success rate?

1. Low success rate (<70%):
   • Review failed executions
   • Check prompt clarity
   • Verify tool selection
   • Train on best practices
2. Inconsistent results:
   • Standardize prompts
   • Use templates
   • Share working patterns
3. High error rate:
   • Check logs for common errors
   • Update tool configurations
   • Verify API keys are valid

​

Can I use multiple API keys?

• Per environment: dev, staging, production
• Per project: separate billing
• Per team: team-specific keys
• Rotation: overlap during key rotation

​

How is success rate calculated?

Success Rate = (Successful Executions / Total Executions) × 100

• Tool completed without errors
• Result was useful (not rejected)
• No timeout or crash

​

What causes tool failures?

1. Permission errors: File system permissions
2. Invalid input: Malformed commands or paths
3. Network issues: API timeouts
4. Resource limits: Memory or CPU constraints
5. Tool bugs: Issues in the tool itself

​

Can I export data for analysis?

# Via CLI
a24z export --format csv --start 2024-01-01 > data.csv

curl -H "x-api-key: $A24Z_API_KEY" \
  https://api.a24z.ai/sessions > sessions.json

• Click “Export” button on any chart
• Choose format (CSV, JSON, Excel)

​

How do I set up SSO?

1. Contact [email protected]
2. We’ll configure SAML integration
3. Supported providers:
   • Okta
   • Azure AD
   • Google Workspace
   • Auth0
   • OneLogin

​

What’s the API rate limit?

• 1,000 requests/hour
• 10,000 requests/day

• 10,000 requests/hour
• 100,000 requests/day

• Custom limits
• Burst capacity available

​

How do I optimize for cost?

1. Use appropriate models:
   • Small tasks → small models
   • Complex tasks → large models
2. Manage context:
   • Remove unused files from context
   • Use file references, not full content
   • Clear history regularly
3. Batch operations:
   • Group related tasks
   • Avoid repeated context loading
4. Monitor and alert:
   • Set budget alerts
   • Review high-cost sessions
   • Train team on efficiency

​

Can I create custom metrics?

curl -X POST https://api.a24z.ai/metrics/custom \
  -H "x-api-key: $A24Z_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "metric": "code_quality_score",
    "value": 8.5,
    "session": "session-123",
    "timestamp": "2024-01-15T10:30:00Z"
  }'

​

What browsers are supported?

• Chrome 90+ (recommended)
• Firefox 88+
• Safari 14+
• Edge 90+

• Internet Explorer
• Opera Mini
• Browsers with JavaScript disabled

​

How do I report a bug?

1. Go to GitHub Issues
2. Click “New Issue”
3. Choose “Bug Report” template
4. Fill in details

• Steps to reproduce
• Expected vs actual behavior
• Screenshots if applicable
• Browser/OS version
• Output of a24z status

​

Is there a mobile app?

• Mobile web: Dashboard works on mobile browsers
• Responsive design: Optimized for tablets
• Native app: On the roadmap for Q3 2024

​

How do I switch between organizations?

# List organizations
a24z org list

# Switch organization
a24z org switch <org-id>

# Current organization
a24z org current

• Click organization dropdown (top right)
• Select organization

​

What happens when I hit my plan limit?

• Events beyond 100K/month are dropped
• Upgrade prompt appears
• No service disruption

• No hard limits
• Overage charges apply
• Billing notification sent

​

Can I get a demo?

• Email: [email protected]
• Schedule: cal.com/a24z/demo
• Duration: 30 minutes
• Includes: Live walkthrough, Q&A, custom setup advice

​

How do I become a reseller/partner?

• Integration Partner: Build integrations
• Reseller: Sell A24Z to clients
• Technology Partner: Joint solutions

​

Still Have Questions?