Screaming Frog

https://screamingfrog.co.uk
33
Fair
Agent Native Score
Free Tier

A desktop web crawler and SEO analysis tool that audits website structure, metadata, and performance issues. Primarily designed as a GUI application for manual SEO analysis rather than programmatic automation.

Categories: Seo · Web Crawling
#14 of 15 in Seo
Checklist Breakdown

11 of 33 checks passed. 14 unscored.

Discovery 50%

Can an agent find and understand this tool without a web search?

✗ Published OpenAPI/Swagger spec
✗ Has llms.txt or llms-full.txt
✗ Has an MCP server (official or well-maintained)
✗ MCP server listed in a public registry
✓ API reference docs are publicly accessible
✓ Docs include runnable code examples
✓ Has a public changelog or release notes
✓ Has a public status page
Auth & Onboarding 33%

Can an agent create an account and get credentials without human intervention?

✗ Signup does not require CAPTCHA
✗ Signup does not require phone verification
✗ Supports API key auth (not only OAuth)
✗ API key obtainable without manual approval
✓ No mandatory billing info to start
✓ Can sign up without creating an organization
Pricing 100%

Can an agent operate autonomously without upfront payment or contracts?

✓ Has a free tier
✓ Usage-based pricing available
✓ No minimum contract or commitment
✓ Pricing page is public (no 'contact sales')
✓ Free tier sufficient for testing (not just a trial)
Agent Tooling Not yet scored

How well does the API work for non-human consumers?

— SDK available in 2+ languages
— Structured error responses (JSON with error codes)
— Idempotency support on write endpoints
— Pagination on list endpoints
— Webhook/event support
— Sandbox or test mode available
— Rate limit headers in responses
— Consistent REST resource naming
Reliability Not yet scored

Does the tool fail gracefully when an agent makes a mistake?

— Meaningful error messages (not just 500)
— 429 responses include Retry-After header
— Documented uptime SLA (99.9%+)
— Graceful degradation under rate limits
— Request IDs in responses for debugging
— API versioning supported
Reviewer Notes

Screaming Frog is fundamentally a desktop GUI tool with minimal API exposure and no MCP server or OpenAPI spec, making it difficult for agents to discover and integrate programmatically. The product lacks agent-friendly authentication (requires license key activation on desktop), has no programmatic account creation pathway, and offers no structured API for automation. While the tool is reliable and has a free tier for limited crawls, its architecture is built for human interactive use rather than agent-driven workflows. An agent would struggle to use this tool without significant workarounds like browser automation.

Let your agents find tools like Screaming Frog

Install the Agent Native Registry MCP server. Your agents can search, compare, and score tools mid-task.

claude mcp add --transport http agent-native-registry https://agentnativeregistry.com/api/mcp