ourtownny.com
robots.txt
Robots Exclusion Standard data for ourtownny.com
Resource Scan
Scan Details
Site Domain | ourtownny.com |
Base Domain | ourtownny.com |
Scan Status | Ok |
Last Scan | 2024-10-30T17:10:08+00:00 |
Next Scan | 2024-11-06T17:10:08+00:00 |
Last Scan
Scanned | 2024-10-30T17:10:08+00:00 |
URL | https://ourtownny.com/robots.txt |
Redirect | https://www.ourtownny.com/robots.txt |
Redirect Domain | www.ourtownny.com |
Redirect Base | ourtownny.com |
Domain IPs | 129.213.199.43 |
Redirect IPs | 129.213.199.43, 129.213.77.43 |
Response IP | 129.213.77.43 |
Found | Yes |
Hash | 8fa5a27d70bbe7bb44949a516531d1dd0d2c0d33a11c36cd7b33c3d96a82e092 |
SimHash | 9c5b59da85b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /news-portlet/metalocator/ |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_page.jsp |
Disallow | /news-portlet/html/teaser-viewer-portlet/teaser_filter.jsp |
Disallow | /news-portlet/filterteaser/ |
Disallow | /news-portlet/getfilteropts/ |
Disallow | /tracking-portlet/html/ranking-viewer/ranking_details.jsp |
Disallow | /user-portlet/login-with/ |
Disallow | /user-portlet/edit-user-profile/ |
Disallow | /user-portlet/reset-credentials/ |
Disallow | /user-portlet/confirm-email/ |
Disallow | /user-portlet/refreshuserentitlements/ |
Disallow | /user-portlet/getEntitlements/ |
Disallow | /group/ |
Disallow | /user/ |
Disallow | /web/ |
Disallow | /image/ |
*
Rule | Path |
---|---|
Disallow | /news/crime-watch |
Disallow | /news/woman-killed-in-subway-shove-at-times-square-JG1932496 |
Other Records
Field | Value |
---|---|
sitemap | https://www.ourtownny.com/sitemap.xml |
sitemap | https://www.ourtownny.com/sitemapforgoogle.xml |
sitemap | https://www.ourtownny.com/megasitemap.xml |
Comments