susteps.com
robots.txt

Robots Exclusion Standard data for susteps.com

Resource Scan

Scan Details

Site Domain susteps.com
Base Domain susteps.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-13T16:39:51+00:00
Next Scan 2026-02-14T16:39:51+00:00

Last Successful Scan

Scanned2026-02-06T16:39:46+00:00
URL https://susteps.com/robots.txt
Domain IPs 2a02:4780:84:2737:eaf6:bf6a:3bd4:567c, 2a02:4780:84:fbc7:1113:43e2:d1e2:9ec, 84.32.84.108, 84.32.84.46
Response IP 93.127.187.44
Found Yes
Hash 07ad493687e297e577b82eb5b9f9258b3191857347aeff91d634726885946f54
SimHash 290998d18f13

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://susteps.com/sitemap_index.xml