xvedios.me
robots.txt

Robots Exclusion Standard data for xvedios.me

Resource Scan

Scan Details

Site Domain xvedios.me
Base Domain xvedios.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-01-23T01:29:51+00:00
Next Scan 2025-03-24T01:29:51+00:00

Last Successful Scan

Scanned2024-11-02T01:27:51+00:00
URL https://xvedios.me/robots.txt
Domain IPs 104.21.79.169, 172.67.146.157, 2606:4700:3034::6815:4fa9, 2606:4700:3035::ac43:929d
Response IP 172.67.146.157
Found Yes
Hash e8ef5d29e02748aa9f14a65d4a19a4fbdf6d2eba3920cfa7e64044aa0dc9a77c
SimHash 6d08d454c3b3

Groups

yandex

Rule Path
Disallow /content/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /content/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /content/*

Other Records

Field Value
sitemap https://xvedios.me/sitemap.xml

Warnings

  • `host` is not a known field.