on-this-day.com
robots.txt
Robots Exclusion Standard data for on-this-day.com
Resource Scan
Scan Details
| Site Domain | on-this-day.com |
| Base Domain | on-this-day.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T05:48:43+00:00 |
| Next Scan | 2024-10-03T05:48:43+00:00 |
Last Scan
| Scanned | 2024-09-26T05:48:43+00:00 |
| URL | https://on-this-day.com/robots.txt |
| Domain IPs | 107.180.113.223 |
| Response IP | 107.180.113.223 |
| Found | Yes |
| Hash | 4bd8c8168024f8f60331d45ad402d001a81d7bdc122fcaf041c92e760f31d486 |
| SimHash | 3144b4847f90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pho |
| Disallow | /cgi-bin/mcc/ |
| Disallow | /cgi-bin/mmf/ |
| Disallow | /cgi-bin/mms/ |
| Disallow | /saturdaytrivia/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.on-this-day.com/sitemap.xml |
Comments