eriereader.com
robots.txt
Robots Exclusion Standard data for eriereader.com
Resource Scan
Scan Details
Site Domain | eriereader.com |
Base Domain | eriereader.com |
Scan Status | Ok |
Last Scan | 2024-10-28T14:39:27+00:00 |
Next Scan | 2024-11-04T14:39:27+00:00 |
Last Scan
Scanned | 2024-10-28T14:39:27+00:00 |
URL | https://eriereader.com/robots.txt |
Redirect | https://www.eriereader.com/robots.txt |
Redirect Domain | www.eriereader.com |
Redirect Base | eriereader.com |
Domain IPs | 66.147.235.167 |
Redirect IPs | 66.147.235.167 |
Response IP | 66.147.235.167 |
Found | Yes |
Hash | ea87aa7cb349cf0ee5cd588ace5fd665e9313154c52433ec91142b7d7a2a87d7 |
SimHash | 6165cc0503d5 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /error |
Disallow | /contests/thank-you |
Disallow | /calendar/submit/thank-you |
Disallow | /40-under-40-nomination/thank-you |
Disallow | /Giveaway |
Disallow | /advertising/thank-you |
Disallow | /great-lakes-online-media/thanks |
Disallow | /2020-best-of-erie-nominations |
Disallow | /adsorder/thanks |
Disallow | /adsorder |
Disallow | /newsletter/thank-you |
Disallow | /erie-regional-takeout-delivery |
Disallow | /supportlocal |
Disallow | /bestoferie2021 |
Disallow | /2021-best-of-erie-nominations |
Other Records
Field | Value |
---|---|
sitemap | https://www.eriereader.com/sitemap.xml |
sitemap | https://www.eriereader.com/news-sitemap.xml |