dxlive.one
robots.txt

Robots Exclusion Standard data for dxlive.one

Resource Scan

Scan Details

Site Domain dxlive.one
Base Domain dxlive.one
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-06-14T02:07:23+00:00
Next Scan 2024-07-14T02:07:23+00:00

Last Successful Scan

Scanned2024-04-23T01:57:43+00:00
URL https://dxlive.one/robots.txt
Domain IPs 104.21.66.251, 172.67.210.169, 2606:4700:3033::ac43:d2a9, 2606:4700:3036::6815:42fb
Response IP 172.67.210.169
Found Yes
Hash 509341fc5a7e3be974d9c2e395ec35e66036b8c30bc55a91b6631d2da6d632c5
SimHash 4f095e40e3f0

Groups

yandex

Rule Path
Disallow /downloads/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /downloads/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /downloads/*

Other Records

Field Value
sitemap https://dxlive.one/sitemap.xml

Warnings

  • `host` is not a known field.