dan.info
robots.txt

Robots Exclusion Standard data for dan.info

Resource Scan

Scan Details

Site Domain dan.info
Base Domain dan.info
Scan Status Ok
Last Scan2025-11-17T06:30:38+00:00
Next Scan 2025-11-24T06:30:38+00:00

Last Scan

Scanned2025-11-17T06:30:38+00:00
URL https://dan.info/robots.txt
Redirect https://www.dan.info/robots.txt
Redirect Domain www.dan.info
Redirect Base dan.info
Domain IPs 173.236.254.4, 2607:f298:5:117b::f5b:54e8
Redirect IPs 173.236.254.4, 2607:f298:5:117b::f5b:54e8
Response IP 173.236.254.4
Found Yes
Hash 78326f4d13243bf77b74cc8b5696630730f3dbc945f15482f022622ff2cb7059
SimHash 3938274ad7c0

Groups

*

Rule Path
Disallow /cgi-bin/

Comments

  • This file tells robots what not to index in the site