dnews.com
robots.txt

Robots Exclusion Standard data for dnews.com

Resource Scan

Scan Details

Site Domain dnews.com
Base Domain dnews.com
Scan Status Ok
Last Scan2024-11-13T03:58:21+00:00
Next Scan 2024-11-20T03:58:21+00:00

Last Scan

Scanned2024-11-13T03:58:21+00:00
URL https://dnews.com/robots.txt
Redirect https://www.dnews.com/robots.txt
Redirect Domain www.dnews.com
Redirect Base dnews.com
Domain IPs 76.76.21.21
Redirect IPs 3.165.82.108, 3.165.82.26, 3.165.82.70, 3.165.82.73
Response IP 3.165.82.70
Found Yes
Hash 211fc0b4da2be2189f5a311e6a6120637bf1f842c3628c829b260a41cecedc87
SimHash 69408142a633

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dnews.com/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.