btdig.com
robots.txt

Robots Exclusion Standard data for btdig.com

Resource Scan

Scan Details

Site Domain btdig.com
Base Domain btdig.com
Scan Status Ok
Last Scan2024-11-11T07:36:00+00:00
Next Scan 2024-11-18T07:36:00+00:00

Last Scan

Scanned2024-11-11T07:36:00+00:00
URL https://btdig.com/robots.txt
Domain IPs 2001:470:6192:65b2:f126:925c:6e46:d434, 80.78.27.14
Response IP 80.78.28.198
Found Yes
Hash e3b8cedb41cb1e094e6669d32cbb4447ae96b1611180b98bde9339d5c194daf2
SimHash 4a48ca720733

Groups

yandex

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /search?

Other Records

Field Value
sitemap https://btdig.com/sitemap.xml

Warnings

  • `host` is not a known field.