criminalelement.com
robots.txt

Robots Exclusion Standard data for criminalelement.com

Resource Scan

Scan Details

Site Domain criminalelement.com
Base Domain criminalelement.com
Scan Status Ok
Last Scan2024-05-22T07:16:57+00:00
Next Scan 2024-06-21T07:16:57+00:00

Last Scan

Scanned2024-05-22T07:16:57+00:00
URL https://criminalelement.com/robots.txt
Redirect https://www.criminalelement.com/robots.txt
Redirect Domain www.criminalelement.com
Redirect Base criminalelement.com
Domain IPs 104.20.1.151
Redirect IPs 104.22.24.69, 104.22.25.69, 172.67.13.89, 2606:4700:10::6816:1845, 2606:4700:10::6816:1945, 2606:4700:10::ac43:d59
Response IP 104.22.24.69
Found Yes
Hash 41a51eae025a1002667cd48db3b5f2033be5b4cfd186ae717902482a3afe085e
SimHash a014d820e153

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /