baza-knig.ru
robots.txt

Robots Exclusion Standard data for baza-knig.ru

Resource Scan

Scan Details

Site Domain baza-knig.ru
Base Domain baza-knig.ru
Scan Status Ok
Last Scan2024-09-20T03:30:39+00:00
Next Scan 2024-09-27T03:30:39+00:00

Last Scan

Scanned2024-09-20T03:30:39+00:00
URL https://baza-knig.ru/robots.txt
Redirect https://baza-knig.ink/robots.txt
Redirect Domain baza-knig.ink
Redirect Base baza-knig.ink
Domain IPs 104.21.43.31, 172.67.217.250, 2606:4700:3031::ac43:d9fa, 2606:4700:3033::6815:2b1f
Redirect IPs 104.21.52.228, 172.67.205.56, 2606:4700:3030::ac43:cd38, 2606:4700:3033::6815:34e4
Response IP 172.67.205.56
Found Yes
Hash deee05d8911dcdbe0ad4b0fe024f71a2638348885d04e1a3a499b7478da2c499
SimHash 7d0db47ac031

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow */page/*
Disallow /cdn-cgi/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo

Comments

  • Crawl-delay: 3