contenterist.com
robots.txt

Robots Exclusion Standard data for contenterist.com

Resource Scan

Scan Details

Site Domain contenterist.com
Base Domain contenterist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-27T06:25:05+00:00
Next Scan 2025-11-26T06:25:05+00:00

Last Successful Scan

Scanned2025-07-30T06:12:02+00:00
URL https://contenterist.com/robots.txt
Domain IPs 104.21.31.64, 172.67.175.58, 2606:4700:3035::6815:1f40, 2606:4700:3035::ac43:af3a
Response IP 104.21.31.64
Found Yes
Hash 48929daf45224bcb1055e995604fca3cc6eede0e596b7abb3804df486737fafd
SimHash 6954cb13f3d3

Groups

googlebot
googlebot-mobile
googlebot-image
*

Rule Path
Disallow /cgi-bin/
Allow /

Other Records

Field Value
sitemap https://contenterist.com/sitemap.xml