TadaSEOBot: our crawler
TadaSEOBot reads the sites tracked by TadaSEO and those that run a free audit. Here is what it does, and how to block it.
How to recognise it?
It identifies itself with this user agent:
TadaSEOBot/1.0 (+https://tadaseo.com/robot)What does it do?
- It reads robots.txt and respects it, both its own rules and the general ones.
- It only reads public HTML pages, with no forms, no login and no actions.
- It sends at most 2 requests at a time, and stops at 30 pages for a free audit, 300 or 500 for a monthly audit.
- It comes back once a month for tracked sites, and occasionally to re-check a fix.
How to block it?
Add these lines to your robots.txt. TadaSEOBot will stop reading your site; TadaSEO’s audit will no longer be able to check it.
User-agent: TadaSEOBot
Disallow: /A problem with our robot?
Write to us from the Contact page with your domain: we fix it quickly.