мастергаз.рф
robots.txt
Robots Exclusion Standard data for мастергаз.рф
Resource Scan
Scan Details
| Site Domain | мастергаз.рф |
| Base Domain | мастергаз.рф |
| Scan Status | Ok |
| Last Scan | 2025-11-08T08:55:51+00:00 |
| Next Scan | 2025-12-08T08:55:51+00:00 |
Last Scan
| Scanned | 2025-11-08T08:55:51+00:00 |
| URL | http://мастергаз.рф/robots.txt |
| Redirect | http://xn--80aaihmz4agj.xn--p1ai/robots.txt |
| Domain IPs | 91.201.52.199 |
| Response IP | 91.201.52.199 |
| Found | Yes |
| Hash | 48a9ab5da4eeaf5e41f54802ec7b739aa61244a3ceb7856662909f32d746ff65 |
| SimHash | 49410b510532 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /rss.xml |
| Disallow | /admin$ |
| Disallow | /admin/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://xn--80aaihmz4agj.xn--p1ai/sitemap.xml |
| sitemap | http://xn--80aaihmz4agj.xn--p1ai/sitemap.xml |
| sitemap | http://xn--80aaihmz4agj.xn--p1ai/sitemap.xml |
Warnings
- `host` is not a known field.