Crawler Setup

Enable/disable crawler and set schedule per project.

If your site uses a firewall/WAF (Cloudflare, Sucuri, server security rules), crawling may be blocked. Whitelist our crawler user-agent:seomktool