dmitrov.su
robots.txt
Robots Exclusion Standard data for dmitrov.su
Resource Scan
Scan Details
| Site Domain | dmitrov.su |
| Base Domain | dmitrov.su |
| Scan Status | Ok |
| Last Scan | 2025-06-18T06:51:57+00:00 |
| Next Scan | 2025-06-25T06:51:57+00:00 |
Last Scan
| Scanned | 2025-06-18T06:51:57+00:00 |
| URL | https://dmitrov.su/robots.txt |
| Redirect | http://www.dmitrov.su/robots.txt |
| Redirect Domain | www.dmitrov.su |
| Redirect Base | dmitrov.su |
| Domain IPs | 104.21.17.40, 172.67.220.204, 2606:4700:3033::6815:1128, 2606:4700:3036::ac43:dccc |
| Redirect IPs | 104.21.17.40, 172.67.220.204, 2606:4700:3033::6815:1128, 2606:4700:3036::ac43:dccc |
| Response IP | 104.21.17.40 |
| Found | Yes |
| Hash | 4ad29b0241383aab8f17ea6eb9329b281481e9187e5de6a3d10b10bd97159c2e |
| SimHash | 4b4c9c60ce93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /*/print.html$ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.dmitrov.su/sitemap.xml |
Warnings
- `host` is not a known field.