иванов-ам.рф
robots.txt
Robots Exclusion Standard data for иванов-ам.рф
Resource Scan
Scan Details
Site Domain | иванов-ам.рф |
Base Domain | иванов-ам.рф |
Scan Status | Ok |
Last Scan | 2024-11-11T12:31:49+00:00 |
Next Scan | 2024-11-18T12:31:49+00:00 |
Last Scan
Scanned | 2024-11-11T12:31:49+00:00 |
URL | https://иванов-ам.рф/robots.txt |
Redirect | https://xn----7sbbfb7a7aej.xn--p1ai/robots.txt |
Domain IPs | 217.107.219.198 |
Response IP | 217.107.219.198 |
Found | Yes |
Hash | 0bfae87db9135394a0118c9567e3a6d52ffd69860333b27cc58c820b20e9e472 |
SimHash | 2d17ab4852b3 |
Groups
*
Rule | Path |
---|---|
Allow | /favicon.ico |
Allow | /favicon.svg |
Allow | /ads.txt |
Allow | /app-ads.txt |
Allow | /robots.txt |
Allow | /sitemap.xml |
Disallow | *?* |
Disallow | /page? |
Disallow | /*.html? |
Disallow | /img/ |
Disallow | /iframes/ |
Disallow | /lib/ |
Disallow | /doc/ |
Disallow | /xls/ |
Disallow | /pdf/ |
Disallow | /txt/ |
Disallow | /swf/ |
Disallow | /content/ |
Disallow | /zip/ |
Disallow | /test/ |
Disallow | /ur_*/ |
Disallow | /mp*/ |
Disallow | /*.mp*$ |
Disallow | /*.pdf$ |
Disallow | /*.pp*$ |
Disallow | /*.swf$ |
Disallow | /*.mdb$ |
Disallow | /*.do*$ |
Disallow | /*.xl*$ |
Disallow | /*.od*$ |
Disallow | /*.txt$ |
Disallow | /*.oms$ |
Disallow | /*.js$ |
Disallow | /yad_*.html$ |
Disallow | /sm_*.html$ |
Other Records
Field | Value |
---|---|
sitemap | https://xn----7sbbfb7a7aej.xn--p1ai/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments