vahte.ru
robots.txt
Robots Exclusion Standard data for vahte.ru
Resource Scan
Scan Details
Site Domain | vahte.ru |
Base Domain | vahte.ru |
Scan Status | Ok |
Last Scan | 2024-11-18T05:32:19+00:00 |
Next Scan | 2024-11-25T05:32:19+00:00 |
Last Scan
Scanned | 2024-11-18T05:32:19+00:00 |
URL | https://vahte.ru/robots.txt |
Domain IPs | 2a0a:8d80:0:9123::135, 91.236.136.105 |
Response IP | 91.236.136.105 |
Found | Yes |
Hash | 017faa4723abae273393e13110fac506f3e3f8caee2e5bd226af5eeddbc47a6e |
SimHash | 4d24fc4543b0 |
Groups
*
Rule | Path |
---|---|
Disallow | */*/feed/*/ |
Disallow | */feed |
Disallow | /?feed= |
Disallow | /wp-admin/ |
Disallow | /author/ |
Disallow | /author* |
Disallow | */author/* |
Disallow | */page/* |
Disallow | */trackback/ |
Disallow | /search |
Disallow | */tag/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://vahte.ru/sitemap_index.xml |
Warnings
- `host` is not a known field.