brownstoner.com
robots.txt

Robots Exclusion Standard data for brownstoner.com

Resource Scan

Scan Details

Site Domain brownstoner.com
Base Domain brownstoner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T17:05:55+00:00
Next Scan 2024-12-16T17:05:55+00:00

Last Successful Scan

Scanned2023-02-26T01:34:59+00:00
URL https://brownstoner.com/robots.txt
Redirect https://www.brownstoner.com/robots.txt
Redirect Domain www.brownstoner.com
Redirect Base brownstoner.com
Domain IPs 141.193.213.20, 141.193.213.21
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash d331b2e9bee04c631a0f2280fb1e1a4320ee055009f570e7d43a192db8bf3c3f
SimHash 41000c400f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.brownstoner.com/sitemap_index.xml