thefirsthundredmiles.com
robots.txt
Robots Exclusion Standard data for thefirsthundredmiles.com
Resource Scan
Scan Details
| Site Domain | thefirsthundredmiles.com |
| Base Domain | thefirsthundredmiles.com |
| Scan Status | Ok |
| Last Scan | 2024-05-27T09:47:26+00:00 |
| Next Scan | 2024-06-03T09:47:26+00:00 |
Last Scan
| Scanned | 2024-05-27T09:47:26+00:00 |
| URL | https://thefirsthundredmiles.com/robots.txt |
| Redirect | https://www.thefirsthundredmiles.com:443/robots.txt |
| Redirect Domain | www.thefirsthundredmiles.com |
| Redirect Base | thefirsthundredmiles.com |
| Domain IPs | 75.2.105.204, 99.83.253.50 |
| Redirect IPs | 23.52.171.146, 23.52.171.161, 2600:1413:b000:13::b857:c18c, 2600:1413:b000:13::b857:c19e |
| Response IP | 42.99.140.137 |
| Found | Yes |
| Hash | 813c3f333adb2fd6e43a573af4ee78086b9922ba30957bbf99840483cdaabe76 |
| SimHash | d93d9c880d93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /examples/ |
| Disallow | /search/ |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thefirsthundredmiles.com/arc/outboundfeeds/sitemap-index?outputType=xml |
| sitemap | https://www.thefirsthundredmiles.com/arc/outboundfeeds/news-sitemap-index?outputType=xml |
| sitemap | https://www.thefirsthundredmiles.com/arc/outboundfeeds/news-sitemap?outputType=xml |