tver.ru
robots.txt

Robots Exclusion Standard data for tver.ru

Resource Scan

Scan Details

Site Domain tver.ru
Base Domain tver.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-15T15:06:02+00:00
Next Scan 2024-07-14T15:06:02+00:00

Last Successful Scan

Scanned2024-02-23T15:04:43+00:00
URL https://tver.ru/robots.txt
Redirect https://www.tver.ru/robots.txt
Redirect Domain www.tver.ru
Redirect Base tver.ru
Domain IPs 185.106.107.10
Redirect IPs 185.106.107.10
Response IP 185.106.107.10
Found Yes
Hash 47fc35db41f538fa4dd8a18d97fecaa032c1322fce7460db92798e7576c5a980
SimHash 0118d5404673

Groups

*

Rule Path
Allow /
Disallow /kniga-pamyati

Other Records

Field Value
sitemap https://www.tver.ru:443/sitemap.xml
sitemap https://www.tver.ru:443/sitemap0.xml
sitemap https://www.tver.ru:443/sitemap1.xml
sitemap https://www.tver.ru:443/sitemap2.xml
sitemap https://www.tver.ru:443/sitemap3.xml
sitemap https://www.tver.ru:443/sitemap4.xml
sitemap https://www.tver.ru:443/sitemap5.xml
sitemap https://www.tver.ru:443/sitemap6.xml
sitemap https://www.tver.ru:443/sitemap7.xml