vahte.ru
robots.txt

Robots Exclusion Standard data for vahte.ru

Resource Scan

Scan Details

Site Domain vahte.ru
Base Domain vahte.ru
Scan Status Ok
Last Scan2024-11-18T05:32:19+00:00
Next Scan 2024-11-25T05:32:19+00:00

Last Scan

Scanned2024-11-18T05:32:19+00:00
URL https://vahte.ru/robots.txt
Domain IPs 2a0a:8d80:0:9123::135, 91.236.136.105
Response IP 91.236.136.105
Found Yes
Hash 017faa4723abae273393e13110fac506f3e3f8caee2e5bd226af5eeddbc47a6e
SimHash 4d24fc4543b0

Groups

*

Rule Path
Disallow */*/feed/*/
Disallow */feed
Disallow /?feed=
Disallow /wp-admin/
Disallow /author/
Disallow /author*
Disallow */author/*
Disallow */page/*
Disallow */trackback/
Disallow /search
Disallow */tag/*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://vahte.ru/sitemap_index.xml

Warnings

  • `host` is not a known field.