theshaun.com
robots.txt

Robots Exclusion Standard data for theshaun.com

Resource Scan

Scan Details

Site Domain theshaun.com
Base Domain theshaun.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-01-18T10:29:49+00:00
Next Scan 2026-03-19T10:29:49+00:00

Last Successful Scan

Scanned2025-10-25T15:45:09+00:00
URL https://theshaun.com/robots.txt
Domain IPs 43.229.62.100
Response IP 43.229.62.100
Found Yes
Hash f143754b4d10da89c98ea843635224fdc863697acb97b2e6f98f5c5f7823daa5
SimHash 4101d8404bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://theshaun.com/wp-sitemap.xml