domdivanov.com
robots.txt
Robots Exclusion Standard data for domdivanov.com
Resource Scan
Scan Details
| Site Domain | domdivanov.com |
| Base Domain | domdivanov.com |
| Scan Status | Ok |
| Last Scan | 2024-10-18T11:04:35+00:00 |
| Next Scan | 2024-11-17T11:04:35+00:00 |
Last Scan
| Scanned | 2024-10-18T11:04:35+00:00 |
| URL | https://domdivanov.com/robots.txt |
| Domain IPs | 212.158.168.178 |
| Response IP | 212.158.168.178 |
| Found | Yes |
| Hash | 3e8deb2266463acc93bb22b0a3589ea735365ff5657bad62715b5345d2554252 |
| SimHash | 494d9c426711 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /user* |
| Disallow | *?* |
| Allow | *?page=* |
| Allow | /scripts* |
| Allow | /style* |
| Allow | /img* |
| Disallow | *.doc |
| Disallow | *.xls |
| Disallow | |
| Disallow | *.xlsx |
| Disallow | */m/* |
| Disallow | /poisk* |
| Disallow | /privacy |
| Disallow | *.docx |
| Disallow |
yandex
| Rule | Path |
|---|---|
| Disallow | /user* |
| Disallow | */m/* |
| Disallow | *.doc |
| Disallow | *.xls |
| Disallow | /poisk* |
| Disallow | *.xlsx |
| Disallow | |
| Disallow | *.docx |
| Disallow | /privacy |
| Disallow | |
| Disallow | *?* |
| Allow | *?page=* |
| Allow | /scripts* |
| Allow | /style* |
| Allow | /img* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://domdivanov.com/sitemap.xml |
Warnings
- `host` is not a known field.