kanojotoys.com
robots.txt
Robots Exclusion Standard data for kanojotoys.com
Resource Scan
Scan Details
Site Domain | kanojotoys.com |
Base Domain | kanojotoys.com |
Scan Status | Ok |
Last Scan | 2024-09-22T00:35:21+00:00 |
Next Scan | 2024-10-22T00:35:21+00:00 |
Last Scan
Scanned | 2024-09-22T00:35:21+00:00 |
URL | https://kanojotoys.com/robots.txt |
Domain IPs | 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59 |
Response IP | 104.27.204.89 |
Found | Yes |
Hash | 1eaa4dfc7e5f94d15d1d224cd5f8251efbe3d2bf1408883a8e7f02a20169aaf2 |
SimHash | 0609d17de388 |
Groups
*
Rule | Path |
---|---|
Disallow | /terms-and-conditions-i-6.html |
Disallow | /contact_us.php |
Disallow | /contact_us |
Disallow | /reviews.php |
Disallow | /xhamster-special-discount-i-12.html |
Disallow | /sankakucomplex-special-discount-i-13.html |
Disallow | /affiliate/scripts |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |