baycrawlspace.com
robots.txt

Robots Exclusion Standard data for baycrawlspace.com

Resource Scan

Scan Details

Site Domain baycrawlspace.com
Base Domain baycrawlspace.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-06T03:50:45+00:00
Next Scan 2025-07-05T03:50:45+00:00

Last Successful Scan

Scanned2024-02-02T14:39:55+00:00
URL https://baycrawlspace.com/robots.txt
Redirect https://www.baycrawlspace.com/robots.txt
Redirect Domain www.baycrawlspace.com
Redirect Base baycrawlspace.com
Domain IPs 192.124.249.67
Redirect IPs 192.124.249.67
Response IP 192.124.249.67
Found Yes
Hash 51617c60af313f72a3e2c585c6bdfe365e60fe24a0f6139f37df1cd38127c413
SimHash 490008004d93

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.baycrawlspace.com/sitemap.xml