setdartauction.com
robots.txt

Robots Exclusion Standard data for setdartauction.com

Resource Scan

Scan Details

Site Domain setdartauction.com
Base Domain setdartauction.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-12T14:21:39+00:00
Next Scan 2025-12-11T14:21:39+00:00

Last Successful Scan

Scanned2022-09-11T01:35:03+00:00
URL https://setdartauction.com/robots.txt
Response IP 104.21.51.116
Found Yes
Hash 466df842e8bed44124874b103dfceba5caf290b5c839fcc3da783fc13d1c65a9
SimHash 22488e41c792

Groups

*

Rule Path
Disallow /bjbw/
Disallow /LP_TA/
Disallow

Other Records

Field Value
sitemap http://setdartauction.com/sitemap_index.xml

Warnings

  • `host` is not a known field.