XiaToolsBot

XiaToolsBot is the crawler that keeps XiaTools reports fresh. It identifies itself with this user agent:

Mozilla/5.0 (compatible; XiaToolsBot/1.0; +https://xiatools.com/bot)

What it does

It visits the homepage of a website, reads robots.txt and collects public technical information such as response headers, SSL details, page title, meta tags and the technologies used. It does not log in, submit forms, follow deep links or download files.

How often it visits

Popular websites are checked about once a month, most others less often. Each visit is only a few requests.

How to block it

XiaToolsBot respects robots.txt. To stop it, add this to your robots.txt file:

User-agent: XiaToolsBot
Disallow: /

You can also contact us through the contact page.