bukvaved.faith
robots.txt
Robots Exclusion Standard data for bukvaved.faith
Resource Scan
Scan Details
Site Domain | bukvaved.faith |
Base Domain | bukvaved.faith |
Scan Status | Ok |
Last Scan | 2024-10-15T00:14:56+00:00 |
Next Scan | 2024-11-14T00:14:56+00:00 |
Last Scan
Scanned | 2024-10-15T00:14:56+00:00 |
URL | https://bukvaved.faith/robots.txt |
Domain IPs | 104.21.75.143, 172.67.177.124, 2606:4700:3030::6815:4b8f, 2606:4700:3031::ac43:b17c |
Response IP | 104.21.75.143 |
Found | Yes |
Hash | 6ed318205824aa691f964ff963a5f1a89dfe8fc6819ed2269fb7d609a3cc1abd |
SimHash | 4c39c3e26a92 |
Groups
*
Rule | Path |
---|---|
Disallow | /biz/authorization.html |
Disallow | /biz/reg.html |
Disallow | /biz/auth.html |
Disallow | /cgi-bin/ |
Disallow | /images/ |
Disallow | /index.php?cstart=*&do=lastcomments |
Disallow | /engine/modules/error_info.php? |
Disallow | /engine/modules/bonus_form.php? |
Disallow | /engine/modules/error_form.php? |
Disallow | /umor/rss.xml |
Disallow | /audioknigi/rss.xml |
Disallow | /biographi/rss.xml |
Disallow | /bukvasklad/rss.xml |
Disallow | /classic/rss.xml |
Disallow | /detektiv/rss.xml |
Disallow | /detskaia_literatura/rss.xml |
Disallow | /engine/rss.php |
Disallow | /fantastika/rss.xml |
Disallow | /fantasy/rss.xml |
Disallow | /filosofiia/rss.xml |
Disallow | /main/rss.xml |
Disallow | /naychnaia_literatura/rss.xml |
Disallow | /proza-stihi/rss.xml |
Disallow | /roman/rss.xml |
Disallow | /sovremennaia_literatura/rss.xml |
Disallow | /templates/biblio/bbcodes/color.html |
Disallow | /500.php |
Disallow | /400.php |
Disallow | /404.php |
Disallow | /504.php |
Disallow | /addnews.html |
Disallow | /donate.html |
Disallow | /index.php?do=search |
Disallow | /index.php?do=stats |
Disallow | /index.php?do=feedback |
Disallow | /index.php?do=balance |
Disallow | /balance.html |
Disallow | /*/page/ |
Disallow | /engine/modules/subscribe_form.php |
Disallow | /advert_no.html |
Disallow | /join.html |
Disallow | /index.php?do=lostpassword |
Disallow | /allreg.html |
Disallow | /index.php?do=statistics |
Disallow | /pravoobladateli.html |
Disallow | /otvetstvennost.html |
Disallow | /index.php?do=pm |
Disallow | /admin.php |
Disallow | /index.php?subaction=userinfo |
Disallow | /podskazki.html |
Other Records
Field | Value |
---|---|
crawl-delay | 3 |
Warnings
- `host` is not a known field.