kanojotoys.com
robots.txt

Robots Exclusion Standard data for kanojotoys.com

Resource Scan

Scan Details

Site Domain kanojotoys.com
Base Domain kanojotoys.com
Scan Status Ok
Last Scan2024-09-22T00:35:21+00:00
Next Scan 2024-10-22T00:35:21+00:00

Last Scan

Scanned2024-09-22T00:35:21+00:00
URL https://kanojotoys.com/robots.txt
Domain IPs 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59
Response IP 104.27.204.89
Found Yes
Hash 1eaa4dfc7e5f94d15d1d224cd5f8251efbe3d2bf1408883a8e7f02a20169aaf2
SimHash 0609d17de388

Groups

*

Rule Path
Disallow /terms-and-conditions-i-6.html
Disallow /contact_us.php
Disallow /contact_us
Disallow /reviews.php
Disallow /xhamster-special-discount-i-12.html
Disallow /sankakucomplex-special-discount-i-13.html
Disallow /affiliate/scripts

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbotdisallow: /
lingueedisallow: /
ltx71disallow: /
mj12botdisallow: /
riddlerdisallow: /
zumibotdisallow: /
zumbotdisallow: /

No rules defined. All paths allowed.