поварёнок.рф
robots.txt
Robots Exclusion Standard data for поварёнок.рф
Resource Scan
Scan Details
Site Domain | поварёнок.рф |
Base Domain | поварёнок.рф |
Scan Status | Ok |
Last Scan | 2024-09-20T18:35:55+00:00 |
Next Scan | 2024-09-27T18:35:55+00:00 |
Last Scan
Scanned | 2024-09-20T18:35:55+00:00 |
URL | https://поварёнок.рф/robots.txt |
Redirect | https://xn--80adzlcdcl7m.xn--p1ai/robots.txt |
Domain IPs | 87.236.16.26 |
Response IP | 87.236.16.26 |
Found | Yes |
Hash | 05b68dd0dcaa0fcf167882bbfda9329bbc94363ab389ee42ae2f94c19a803e11 |
SimHash | 0457d950a753 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /js/ |
Disallow | /blok/ |
Disallow | /css/ |
Disallow | /foto2/ |
Disallow | /connections/ |
Disallow | /fotogal/ |
Disallow | /images/ |
Disallow | /img/ |
Disallow | /kcaptcha/ |
Disallow | /obr/ |
Disallow | /avatars/ |
Disallow | /foto/ |
Disallow | /foto2/ |
Disallow | /frm/ |
Disallow | /supr/ |
Disallow | /404.php |
Disallow | /footer.php |
Disallow | /header.php |
Disallow | /povknigamenu.php |
Disallow | /activation_user.php |
Disallow | /avatar.php |
Disallow | /enter_user.php |
Disallow | /errorent.php |
Disallow | /lenta_soob_user.php |
Disallow | /mysql_connect_or_die.php |
Disallow | /rezpoisk.php |
Disallow | /soob.php |
Disallow | /sooball.php |
Disallow | /zapis_kniga_user.php |
Disallow | /zapis_kniga_user_add.php |
Disallow | /zapis_kniga_user_add_razdel.php |
Disallow | /zapis_kniga_user_edit.php |
Disallow | /zapis_kniga_user_edit_razdel.php |
Disallow | /zapis-kniga-spisok-retseptov.php |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
Other Records
Field | Value |
---|---|
sitemap | http://XN--80ADZLCDCL7M.XN--P1AI/sitemap.xml |
Warnings
- `host` is not a known field.