crewetown.blogspot.com
robots.txt

Robots Exclusion Standard data for crewetown.blogspot.com

Resource Scan

Scan Details

Site Domain crewetown.blogspot.com
Base Domain crewetown.blogspot.com
Scan Status Ok
Last Scan6/29/2025, 9:46:53 PM
Next Scan 7/6/2025, 9:46:53 PM

Last Scan

Scanned6/29/2025, 9:46:53 PM
URL https://crewetown.blogspot.com/robots.txt
Redirect https://www.crewenews.net/robots.txt
Redirect Domain www.crewenews.net
Redirect Base crewenews.net
Domain IPs 172.253.118.132, 2404:6800:4003:c05::84
Redirect IPs 2404:6800:4003:c1a::79, 74.125.24.121
Response IP 142.251.12.121
Found Yes
Hash 27265847fd2ce2cdc80c936a840be1a1da5dcef8c4549e9e0bfe271558c360a3
SimHash 0d44d2504713

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /share-widget
Allow /

Other Records

Field Value
sitemap https://www.crewenews.net/sitemap.xml