kindgirls.cc
robots.txt

Robots Exclusion Standard data for kindgirls.cc

Resource Scan

Scan Details

Site Domain kindgirls.cc
Base Domain kindgirls.cc
Scan Status Ok
Last Scan2024-05-26T17:37:29+00:00
Next Scan 2024-06-25T17:37:29+00:00

Last Scan

Scanned2024-05-26T17:37:29+00:00
URL https://www.kindgirls.cc/robots.txt
Domain IPs 104.21.70.187, 172.67.138.198, 2606:4700:3034::ac43:8ac6, 2606:4700:3036::6815:46bb
Response IP 172.67.138.198
Found Yes
Hash c6177d6738a0d54c6c5d76be190def265d5fbd3eed9f096b295dd4d11736ff77
SimHash 6f01d860c7b0

Groups

yandex

Rule Path
Disallow /get/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /get/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /get/*

Other Records

Field Value
sitemap https://www.kindgirls.cc/sitemap.xml

Warnings

  • `host` is not a known field.