whathappenedtodayinhistory.com
robots.txt
Robots Exclusion Standard data for whathappenedtodayinhistory.com
Resource Scan
Scan Details
| Site Domain | whathappenedtodayinhistory.com |
| Base Domain | whathappenedtodayinhistory.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T02:46:03+00:00 |
| Next Scan | 2024-09-28T02:46:03+00:00 |
Last Scan
| Scanned | 2024-09-21T02:46:03+00:00 |
| URL | https://whathappenedtodayinhistory.com/robots.txt |
| Redirect | https://www.whathappenedtodayinhistory.com/robots.txt |
| Redirect Domain | www.whathappenedtodayinhistory.com |
| Redirect Base | whathappenedtodayinhistory.com |
| Domain IPs | 66.165.238.98 |
| Redirect IPs | 66.165.238.98 |
| Response IP | 66.165.238.98 |
| Found | Yes |
| Hash | 5f7a5a1aba5655de2f950ef1a803b25907d43b383d2f1d5e2780e20e4097b9af |
| SimHash | a82c8c13c5f3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.png |
| Disallow | /*.gif |
| Disallow | /*.jpg |
| Disallow | /*.txt |
| Disallow | /*.zip |
| Disallow | /*.doc |
| Disallow | /*.exe |
| Disallow | |
| Disallow | /rad-* |
| Allow | /robots.txt |
| Allow | /ads.txt |
| Allow | / |
Comments