the-pit.com
robots.txt

Robots Exclusion Standard data for the-pit.com

Resource Scan

Scan Details

Site Domain the-pit.com
Base Domain the-pit.com
Scan Status Ok
Last Scan2025-07-04T02:41:43+00:00
Next Scan 2025-07-11T02:41:43+00:00

Last Scan

Scanned2025-07-04T02:41:43+00:00
URL https://the-pit.com/robots.txt
Redirect https://www.the-pit.com/robots.txt
Redirect Domain www.the-pit.com
Redirect Base the-pit.com
Domain IPs 104.21.84.112, 172.67.191.143, 2606:4700:3032::6815:5470, 2606:4700:3037::ac43:bf8f
Redirect IPs 104.21.84.112, 172.67.191.143, 2606:4700:3032::6815:5470, 2606:4700:3037::ac43:bf8f
Response IP 104.21.84.112
Found Yes
Hash cd06c3e7b1f0cafb7286fbfd6d1474bafb9b0a927f41a560dd691757c28658cc
SimHash 4855d820e113

Groups

gptbot
chatgpt-user

Rule Path
Disallow /

*

Rule Path
Disallow