информа.рус
robots.txt
Robots Exclusion Standard data for информа.рус
Resource Scan
Scan Details
Site Domain | информа.рус |
Base Domain | информа.рус |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-22T15:19:42+00:00 |
Next Scan | 2024-12-21T15:19:42+00:00 |
Last Successful Scan
Scanned | 2023-05-29T21:33:32+00:00 |
URL | https://информа.рус/robots.txt |
Redirect | https://xn--80apmdfm0a.xn--p1acf/robots.txt |
Domain IPs | 104.21.94.87, 172.67.221.147, 2606:4700:3034::ac43:dd93, 2606:4700:3035::6815:5e57 |
Response IP | 104.21.94.87 |
Found | Yes |
Hash | a86561cf644054b9e01317f44e3cc1449e38dac0da0a878a33f049109dc2a766 |
SimHash | 65048a724ebc |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /? |
Disallow | /wp-* |
Disallow | /*?s= |
Disallow | /*%26s%3D |
Disallow | /search |
Disallow | /author/ |
Disallow | /*?attachment_id= |
Disallow | /*/trackback |
Disallow | /*/feed |
Disallow | /*/embed |
Disallow | /*/page/ |
Disallow | /*?page_id=* |
Disallow | /category/* |
Disallow | /attachment_category/* |
Disallow | /tag/* |
Allow | /*/uploads |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /wp-*.png |
Allow | /wp-*.jpg |
Allow | /wp-*.jpeg |
Allow | /wp-*.gif |
Other Records
Field | Value |
---|---|
sitemap | https://xn--80apmdfm0a.xn--p1acf/page-sitemap.xml |
Warnings
- `host` is not a known field.