For site owners
AmbiRank crawler
If you found this page, the AmbiRank audit crawler visited your website. It only visits sites whose owners have registered them in an account and proved ownership (a DNS record, a file or a meta tag), plus single pages checked through our public page-check tool. It exists to produce SEO audit reports for the site owner.
How to recognise it
User agent: Mozilla/5.0 (compatible; AmbiRankBot/1.0; +https://ambirank.com)
robots.txt token: AutomaticSEOBot
How it behaves
- Obeys robots.txt. Rules for
AutomaticSEOBot(or*) are followed, includingCrawl-delay(up to 5 seconds) and wildcards. If robots.txt blocks the whole site, nothing is fetched. - Polite. At most 2 simultaneous requests to one site, with a delay between requests (300 ms by default), a page limit per audit and a time limit.
- Plain HTTP(S) only. Ports 80 and 443. No logins, no forms, no CAPTCHA bypassing, no JavaScript execution.
- Public addresses only. It refuses to connect to private, internal or reserved addresses.
- No data resale. Crawl results are shown only to the account that registered the site.
Control or block it
Add this to your robots.txt to stop it completely:
User-agent: AutomaticSEOBot Disallow: /
To slow it down: Crawl-delay: 5. If you did not expect a visit, or you want a site removed from an account, write to [email protected] and include your domain.