steamregister.com
robots.txt

Robots Exclusion Standard data for steamregister.com

Resource Scan

Scan Details

Site Domain steamregister.com
Base Domain steamregister.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-05-11T05:34:49+00:00
Next Scan 2025-06-10T05:34:49+00:00

Last Successful Scan

Scanned2025-03-20T04:17:49+00:00
URL https://steamregister.com/robots.txt
Domain IPs 198.187.31.167
Response IP 198.187.31.167
Found Yes
Hash 2ba159a057950f432ec010c26dc73281a7eefd3685bc30e07d4fd64bd0cd64a5
SimHash 6054dd9566d3

Groups

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://steamregister.com/sitemap.xml