Autonomous agents

KunatoCrawler

KunatoCrawler is a bot that browses the web on its own to finish multi-step tasks, and its operator has not been publicly identified. The token has been seen in server logs, but no operator has published documentation for it. No IP range list or reverse-DNS convention is published, so a request carrying this user agent cannot be proven genuine and a robots.txt rule alone will not stop a forgery.

Operator unknownClaim onlyrobots.txt:No policy

Live check

Verify an IP that claimed to be KunatoCrawler

No operator check exists for KunatoCrawler. This still shows what the address really is.

Reference

KunatoCrawler at a glance

Reference data for the KunatoCrawler crawler
User agentKunatoCrawler

Token only: match on the substring.

OperatorNot publicly identified
PurposeAutonomous agents
Respects robots.txtNo policy
Verification methodClaim onlyNone published, user agent only

No IP range file and no reverse-DNS convention have been published for this agent. The user-agent string is the only signal, and any client can send it, so treat a match as a claim rather than proof.

Crawl patternNot published
Robots.txt tokensKunatoCrawler
Operator documentationNone published

No operator documents this token. Everything here comes from the string and the traffic.

robots.txt

Allow or block KunatoCrawler

Paste one at the root of your domain. Rules are per token.

Block KunatoCrawler
User-agent: KunatoCrawler
Disallow: /
Allow KunatoCrawler
User-agent: KunatoCrawler
Allow: /
Allow, except the pages you never want quoted
User-agent: KunatoCrawler
Allow: /
Disallow: /account/
Disallow: /checkout/
Disallow: /search

Edit the Disallow paths to match your own URLs.

What blocking actually costs you

Blocking KunatoCrawler stops automated sessions that fill forms, click through flows and read pages the way a logged-in user would. Rate limits and challenges usually work better here than a robots.txt line.

Build a file for every crawler

FAQ

KunatoCrawler questions

What is KunatoCrawler?

KunatoCrawler is a bot that browses the web on its own to finish multi-step tasks, and its operator has not been publicly identified. The token has been seen in server logs, but no operator has published documentation for it. No IP range list or reverse-DNS convention is published, so a request carrying this user agent cannot be proven genuine and a robots.txt rule alone will not stop a forgery.

Does KunatoCrawler respect robots.txt?

Not documented. No operator statement says whether KunatoCrawler reads robots.txt, so add the rule but verify in your logs that the requests actually stop.

How do I verify a request really came from KunatoCrawler?

You cannot, at least not from the request itself. No IP range file and no reverse-DNS convention have been published for this agent. The user-agent string is the only signal, and any client can send it, so treat a match as a claim rather than proof. Compare the source IP against hosting and datacenter ranges instead, and rate limit anything that behaves like a crawler.

How do I block KunatoCrawler?

Add the KunatoCrawler token to robots.txt with Disallow: /. If the crawler ignores robots.txt, match the user agent at your CDN or reverse proxy and return 403 there instead.

Will blocking KunatoCrawler hurt my search rankings?

Blocking KunatoCrawler stops automated sessions that fill forms, click through flows and read pages the way a logged-in user would. Rate limits and challenges usually work better here than a robots.txt line.

    KunatoCrawler: User Agent, IP Verification & robots.txt | IPScanner