dlnews.com
robots.txt

Robots Exclusion Standard data for dlnews.com

Resource Scan

Scan Details

Site Domain dlnews.com
Base Domain dlnews.com
Scan Status Ok
Last Scan2024-05-25T02:17:23+00:00
Next Scan 2024-06-24T02:17:23+00:00

Last Scan

Scanned2024-05-25T02:17:23+00:00
URL https://dlnews.com/robots.txt
Redirect https://www.dlnews.com:443/robots.txt
Redirect Domain www.dlnews.com
Redirect Base dlnews.com
Domain IPs 15.197.224.250, 3.33.240.22
Redirect IPs 2600:1413:b000:14::b857:c14b, 2600:1413:b000:14::b857:c154, 72.247.127.192, 72.247.127.224
Response IP 23.52.171.123
Found Yes
Hash 066575c77bd732e2e981be475a67bb597f2743bdd4352ff7413e495b7daf58f7
SimHash 69548c50d533

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dlnews.com/arc/outboundfeeds/sitemap-index/
sitemap https://www.dlnews.com/arc/outboundfeeds/sitemap-news-index/
sitemap https://www.dlnews.com/arc/outboundfeeds/sitemap-section-index/