поварёнок.рф
robots.txt
Robots Exclusion Standard data for поварёнок.рф
Resource Scan
Scan Details
| Site Domain | поварёнок.рф |
| Base Domain | поварёнок.рф |
| Scan Status | Ok |
| Last Scan | 2024-09-20T18:35:55+00:00 |
| Next Scan | 2024-09-27T18:35:55+00:00 |
Last Scan
| Scanned | 2024-09-20T18:35:55+00:00 |
| URL | https://поварёнок.рф/robots.txt |
| Redirect | https://xn--80adzlcdcl7m.xn--p1ai/robots.txt |
| Domain IPs | 87.236.16.26 |
| Response IP | 87.236.16.26 |
| Found | Yes |
| Hash | 05b68dd0dcaa0fcf167882bbfda9329bbc94363ab389ee42ae2f94c19a803e11 |
| SimHash | 0457d950a753 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /js/ |
| Disallow | /blok/ |
| Disallow | /css/ |
| Disallow | /foto2/ |
| Disallow | /connections/ |
| Disallow | /fotogal/ |
| Disallow | /images/ |
| Disallow | /img/ |
| Disallow | /kcaptcha/ |
| Disallow | /obr/ |
| Disallow | /avatars/ |
| Disallow | /foto/ |
| Disallow | /foto2/ |
| Disallow | /frm/ |
| Disallow | /supr/ |
| Disallow | /404.php |
| Disallow | /footer.php |
| Disallow | /header.php |
| Disallow | /povknigamenu.php |
| Disallow | /activation_user.php |
| Disallow | /avatar.php |
| Disallow | /enter_user.php |
| Disallow | /errorent.php |
| Disallow | /lenta_soob_user.php |
| Disallow | /mysql_connect_or_die.php |
| Disallow | /rezpoisk.php |
| Disallow | /soob.php |
| Disallow | /sooball.php |
| Disallow | /zapis_kniga_user.php |
| Disallow | /zapis_kniga_user_add.php |
| Disallow | /zapis_kniga_user_add_razdel.php |
| Disallow | /zapis_kniga_user_edit.php |
| Disallow | /zapis_kniga_user_edit_razdel.php |
| Disallow | /zapis-kniga-spisok-retseptov.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://XN--80ADZLCDCL7M.XN--P1AI/sitemap.xml |
Warnings
- `host` is not a known field.