kindgirls.cc
robots.txt

Robots Exclusion Standard data for kindgirls.cc

Resource Scan

Scan Details

Site Domain kindgirls.cc
Base Domain kindgirls.cc
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-16T17:39:55+00:00
Next Scan 2024-11-15T17:39:55+00:00

Last Successful Scan

Scanned2024-06-26T17:38:05+00:00
URL https://kindgirls.cc/robots.txt
Redirect https://www.kindgirls.cc/robots.txt
Redirect Domain www.kindgirls.cc
Redirect Base kindgirls.cc
Domain IPs 104.21.70.187, 172.67.138.198, 2606:4700:3034::ac43:8ac6, 2606:4700:3036::6815:46bb
Redirect IPs 104.21.70.187, 172.67.138.198, 2606:4700:3034::ac43:8ac6, 2606:4700:3036::6815:46bb
Response IP 172.67.138.198
Found Yes
Hash c6177d6738a0d54c6c5d76be190def265d5fbd3eed9f096b295dd4d11736ff77
SimHash 6f01d860c7b0

Groups

yandex

Rule Path
Disallow /get/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /get/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /get/*

Other Records

Field Value
sitemap https://www.kindgirls.cc/sitemap.xml

Warnings

  • `host` is not a known field.