aer-rea.ru
robots.txt
Robots Exclusion Standard data for aer-rea.ru
Resource Scan
Scan Details
| Site Domain | aer-rea.ru |
| Base Domain | aer-rea.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-27T17:47:50+00:00 |
| Next Scan | 2024-07-27T17:47:50+00:00 |
Last Scan
| Scanned | 2024-06-27T17:47:50+00:00 |
| URL | http://aer-rea.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:ca21, 2a00:15f8:a000:5:1:12:0:ca21, 2a00:15f8:a000:5:1:13:0:ca21, 2a00:15f8:a000:5:1:14:0:ca21, 90.156.201.112, 90.156.201.26, 90.156.201.34, 90.156.201.76 |
| Response IP | 90.156.201.26 |
| Found | Yes |
| Hash | 9a5b0251b073081f6d982aa119af36357cefd89d810cec08fa7add8e18a891c2 |
| SimHash | 48851841e745 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2.0 |
yandexbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.pptx |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2.0 |
yandexmetrika
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.pptx |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2.0 |
yandeximages
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.pptx |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2.0 |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.pptx |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2.0 |
*
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /aup/ |
| Disallow | /admin/ |
| Disallow | /account/ |
| Disallow | |
| Disallow | *.doc |
| Disallow | *.docx |
| Disallow | *.xls |
| Disallow | *.xlsx |
| Disallow | *.ppt |
| Disallow | *.pptx |
| Disallow | *.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.aer-rea.ru/seo/sitemap/ |
Warnings
- `host` is not a known field.