iz.ru
robots.txt
Robots Exclusion Standard data for iz.ru
Resource Scan
Scan Details
Site Domain | iz.ru |
Base Domain | iz.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-24T02:38:16+00:00 |
Next Scan | 2024-06-23T02:38:16+00:00 |
Last Successful Scan
Scanned | 2024-02-23T19:02:19+00:00 |
URL | https://iz.ru/robots.txt |
Domain IPs | 185.178.208.4 |
Response IP | 185.178.208.4 |
Found | Yes |
Hash | ef5c6f1dc5bc132d2315f797032e67e76f4490c2af197cd7b8bada4fc5b1623e |
SimHash | b812994b0714 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /admin*$ |
Disallow | /filter*$ |
Disallow | /user*$ |
Disallow | /login*$ |
Disallow | /register*$ |
Disallow | /reset-password*$ |
Disallow | /taxonomy*$ |
Disallow | /comment*$ |
Disallow | /node*$ |
Disallow | /core*$ |
Disallow | /libraries*$ |
Disallow | /modules*$ |
Disallow | /themes*$ |
Disallow | /*node_modules*$ |
Disallow | /profiles*$ |
Allow | /profiles/*.jpg |
Allow | /profiles/*.svg |
Allow | /profiles/*.png |
Disallow | /README.txt |
Disallow | /INSTALL.txt |
Disallow | */undefined* |
googlebot
Rule | Path |
---|---|
Disallow | /admin*$ |
Disallow | /filter*$ |
Disallow | /user*$ |
Disallow | /login*$ |
Disallow | /register*$ |
Disallow | /reset-password*$ |
Disallow | /taxonomy*$ |
Disallow | /comment*$ |
Disallow | /node*$ |
Disallow | /core*$ |
Disallow | /libraries*$ |
Disallow | /modules*$ |
Disallow | /themes*$ |
Disallow | /*node_modules*$ |
Disallow | /profiles*$ |
Allow | /profiles/*.jpg |
Allow | /profiles/*.svg |
Allow | /profiles/*.png |
Disallow | /README.txt |
Disallow | /INSTALL.txt |
Disallow | */undefined* |
*
Rule | Path |
---|---|
Disallow | /admin*$ |
Disallow | /filter*$ |
Disallow | /user*$ |
Disallow | /login*$ |
Disallow | /register*$ |
Disallow | /reset-password*$ |
Disallow | /taxonomy*$ |
Disallow | /comment*$ |
Disallow | /node*$ |
Disallow | /core*$ |
Disallow | /libraries*$ |
Disallow | /modules*$ |
Disallow | /themes*$ |
Disallow | /*node_modules*$ |
Disallow | /profiles*$ |
Allow | /profiles/*.jpg |
Allow | /profiles/*.svg |
Allow | /profiles/*.png |
Disallow | /README.txt |
Disallow | /INSTALL.txt |
Disallow | */undefined* |
Other Records
Field | Value |
---|---|
sitemap | https://iz.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments