boston25news.com
robots.txt

Robots Exclusion Standard data for boston25news.com

Resource Scan

Scan Details

Site Domain boston25news.com
Base Domain boston25news.com
Scan Status Ok
Last Scan2024-06-26T23:16:59+00:00
Next Scan 2024-07-03T23:16:59+00:00

Last Scan

Scanned2024-06-26T23:16:59+00:00
URL https://www.boston25news.com/robots.txt
Domain IPs 2600:1413:b000:14::b857:c152, 2600:1413:b000:14::b857:c161, 96.17.72.10, 96.17.72.9
Response IP 42.99.140.187
Found Yes
Hash bb9c9c5abe9d8f9fa96fa3bfb406bcfbc9f56f80729f33858fd6285811397338
SimHash 290dd806a9d2

Groups

*

Rule Path
Disallow /unavailable-location/

Other Records

Field Value
sitemap https://www.boston25news.com/arc/outboundfeeds/sitemap-index?outputType=xml
sitemap https://www.boston25news.com/arc/outboundfeeds/news-sitemap-index?outputType=xml