xxxone.cc
robots.txt

Robots Exclusion Standard data for xxxone.cc

Resource Scan

Scan Details

Site Domain xxxone.cc
Base Domain xxxone.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-28T21:29:41+00:00
Next Scan 2025-10-26T21:29:41+00:00

Last Successful Scan

Scanned2025-03-07T23:59:37+00:00
URL https://xxxone.cc/robots.txt
Domain IPs 104.21.46.2, 172.67.221.241, 2606:4700:3032::6815:2e02, 2606:4700:3033::ac43:ddf1
Response IP 104.21.46.2
Found Yes
Hash e30c6b9b689616a4c0c9d99405fddfc6102c2314c8f81b80ef286f7f75b7a39d
SimHash 27d0dc01c7d1

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 40

*

Rule Path
Disallow */2257/
Disallow */dmca/
Disallow */terms/
Disallow */video/*
Disallow */report.php
Disallow */croper