silavtravah.ru
robots.txt
Robots Exclusion Standard data for silavtravah.ru
Resource Scan
Scan Details
| Site Domain | silavtravah.ru |
| Base Domain | silavtravah.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-14T09:44:35+00:00 |
| Next Scan | 2024-10-14T09:44:35+00:00 |
Last Scan
| Scanned | 2024-09-14T09:44:35+00:00 |
| URL | http://silavtravah.ru/robots.txt |
| Redirect | http://www.silavtravah.ru/robots.txt |
| Redirect Domain | www.silavtravah.ru |
| Redirect Base | silavtravah.ru |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:8f1b, 2a00:15f8:a000:5:1:12:0:8f1b, 2a00:15f8:a000:5:1:13:0:8f1b, 2a00:15f8:a000:5:1:14:0:8f1b, 90.156.201.103, 90.156.201.38, 90.156.201.56, 90.156.201.83 |
| Redirect IPs | 2a00:15f8:a000:5:1:11:0:8f1b, 2a00:15f8:a000:5:1:12:0:8f1b, 2a00:15f8:a000:5:1:13:0:8f1b, 2a00:15f8:a000:5:1:14:0:8f1b, 90.156.201.103, 90.156.201.38, 90.156.201.56, 90.156.201.83 |
| Response IP | 90.156.201.38 |
| Found | Yes |
| Hash | 863b802eccdab410ca520de03500c07100864248a399203ae1a9af9a2d245dd7 |
| SimHash | 6ded8e50a770 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /get_captcha |
| Disallow | /ajax_page |
| Disallow | /404 |
| Disallow | /search |
| Disallow | /admin |
| Disallow | /user |
| Disallow | /include |
| Disallow | /Smarty |
| Disallow | /tmp |
| Disallow | */mailto/ |
| Disallow | /*?num=0 |
| Disallow | /*bracket |
googlebot
| Rule | Path |
|---|---|
| Disallow | /get_captcha |
| Disallow | /ajax_page |
| Disallow | /404 |
| Disallow | /search |
| Disallow | /admin |
| Disallow | /user |
| Disallow | /include |
| Disallow | /Smarty |
| Disallow | /tmp |
| Disallow | /FCKeditor |
| Disallow | */mailto/ |
| Disallow | /*?num=0 |
| Disallow | /*bracket |
bingbot
| Rule | Path |
|---|---|
| Disallow | /get_captcha |
| Disallow | /ajax_page |
| Disallow | /404 |
| Disallow | /search |
| Disallow | /admin |
| Disallow | /user |
| Disallow | /include |
| Disallow | /Smarty |
| Disallow | /tmp |
| Disallow | /FCKeditor |
| Disallow | */mailto/ |
| Disallow | /*?num=0 |
| Disallow | /*bracket |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /get_captcha |
| Disallow | /ajax_page |
| Disallow | /404 |
| Disallow | /search |
| Disallow | /admin |
| Disallow | /user |
| Disallow | /include |
| Disallow | /Smarty |
| Disallow | /tmp |
| Disallow | /FCKeditor |
| Disallow | */mailto/ |
| Disallow | /*?num=0 |
| Disallow | /*bracket |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.silavtravah.ru/sitemap.php |
Warnings
- `host` is not a known field.