westmilfordmessenger.com
robots.txt
Robots Exclusion Standard data for westmilfordmessenger.com
Resource Scan
Scan Details
Site Domain | westmilfordmessenger.com |
Base Domain | westmilfordmessenger.com |
Scan Status | Ok |
Last Scan | 2024-11-16T18:43:10+00:00 |
Next Scan | 2024-11-23T18:43:10+00:00 |
Last Scan
Scanned | 2024-11-16T18:43:10+00:00 |
URL | https://westmilfordmessenger.com/robots.txt |
Redirect | https://www.westmilfordmessenger.com/robots.txt |
Redirect Domain | www.westmilfordmessenger.com |
Redirect Base | westmilfordmessenger.com |
Domain IPs | 129.213.199.43, 129.213.77.43 |
Redirect IPs | 129.213.199.43, 129.213.77.43 |
Response IP | 129.213.77.43 |
Found | Yes |
Hash | bce65a14b2d7fa18de09b713bac19549a701137245b7c989ac0d2d079633d402 |
SimHash | b8597ad287bb |
Groups
*
Rule | Path |
---|---|
Disallow | /news-portlet/metalocator/ |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_page.jsp |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_filter.jsp |
Disallow | /news-portlet/filterteaser/ |
Disallow | /news-portlet/getfilteropts/ |
Disallow | /tracking-portlet/html/ranking-viewer/ranking_details.jsp |
Disallow | /user-portlet/login-with/ |
Disallow | /user-portlet/edit-user-profile/ |
Disallow | /user-portlet/reset-credentials/ |
Disallow | /user-portlet/confirm-email/ |
Disallow | /user-portlet/refreshuserentitlements/ |
Disallow | /user-portlet/getEntitlements/ |
Disallow | /group/ |
Disallow | /user/ |
Disallow | /web/ |
Disallow | /image/ |
*
Rule | Path |
---|---|
Disallow | /news/police-fire |
Other Records
Field | Value |
---|---|
sitemap | https://www.westmilfordmessenger.com/sitemap.xml |
sitemap | https://www.westmilfordmessenger.com/sitemapforgoogle.xml |
sitemap | https://www.westmilfordmessenger.com/megasitemap.xml |
Comments