criminalcase.co
robots.txt

Robots Exclusion Standard data for criminalcase.co

Resource Scan

Scan Details

Site Domain criminalcase.co
Base Domain criminalcase.co
Scan Status Ok
Last Scan2024-09-22T13:41:45+00:00
Next Scan 2024-09-29T13:41:45+00:00

Last Scan

Scanned2024-09-22T13:41:45+00:00
URL https://criminalcase.co/robots.txt
Redirect https://www.criminalcase.co/robots.txt
Redirect Domain www.criminalcase.co
Redirect Base criminalcase.co
Domain IPs 108.156.133.15, 108.156.133.16, 108.156.133.34, 108.156.133.64
Redirect IPs 108.156.133.15, 108.156.133.16, 108.156.133.34, 108.156.133.64, 2600:9000:2755:0:3:fc7f:a7c0:93a1, 2600:9000:2755:1600:3:fc7f:a7c0:93a1, 2600:9000:2755:1800:3:fc7f:a7c0:93a1, 2600:9000:2755:3a00:3:fc7f:a7c0:93a1, 2600:9000:2755:6c00:3:fc7f:a7c0:93a1, 2600:9000:2755:d400:3:fc7f:a7c0:93a1, 2600:9000:2755:dc00:3:fc7f:a7c0:93a1, 2600:9000:2755:fc00:3:fc7f:a7c0:93a1
Response IP 108.156.133.16
Found Yes
Hash c3172e0a4e167f9b7293ca6917ed1f52102ccb1c4c921cc0aa8f149f6ce47e6d
SimHash 2850f94acb92

Groups

*

Rule Path
Disallow /direct/
Disallow /fblogin
Disallow /log/fpe

adsbot-google

Rule Path
Disallow /direct/
Disallow /log/fpe
Disallow /fblogin