Log In Sign Up

girls.ucrazy.ru
robots.txt

Robots Exclusion Standard data for girls.ucrazy.ru

Resource Scan

Scan Details

Site Domain girls.ucrazy.ru
Base Domain ucrazy.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-06T06:34:29+00:00
Next Scan 2024-07-05T06:34:29+00:00

Last Successful Scan

Scanned2023-11-16T06:30:57+00:00
URL https://girls.ucrazy.ru/robots.txt
Domain IPs 104.21.33.40, 172.67.158.149, 2606:4700:3032::ac43:9e95, 2606:4700:3036::6815:2128
Response IP 172.67.158.149
Found Yes
Hash 2ed2eae1a94a6dde1082e4f2add738d4cbcdb2317b20441956b80622ef95aa0e
SimHash a2099a434ef1

Groups

*

Rule Path
Allow /
Disallow /page/
Back to top

Other Records

Field Value
sitemap https://ucrazy.ru/sitemap.xml
Back to top

Comments

  • uCrazy.ru robots.txt
  • Generated for domain girls.ucrazy.ru
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top