datei.info
robots.txt
Robots Exclusion Standard data for datei.info
Resource Scan
Scan Details
| Site Domain | datei.info |
| Base Domain | datei.info |
| Scan Status | Ok |
| Last Scan | 2024-09-28T10:54:06+00:00 |
| Next Scan | 2024-10-05T10:54:06+00:00 |
Last Scan
| Scanned | 2024-09-28T10:54:06+00:00 |
| URL | https://datei.info/robots.txt |
| Domain IPs | 104.21.23.242, 172.67.214.90, 2606:4700:3030::ac43:d65a, 2606:4700:3033::6815:17f2 |
| Response IP | 104.21.23.242 |
| Found | Yes |
| Hash | 927b220358b4023ba2b830bd8f7aac52fe34c6829ad122f7b9a8256fff0e3129 |
| SimHash | 532cc860ee30 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /cgi-sys |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.datei.info/google_sitemap.gz |
Comments