dlnewsoft.com
robots.txt

Robots Exclusion Standard data for dlnewsoft.com

Resource Scan

Scan Details

Site Domain dlnewsoft.com
Base Domain dlnewsoft.com
Scan Status Ok
Last Scan2024-10-09T22:52:12+00:00
Next Scan 2024-10-16T22:52:12+00:00

Last Scan

Scanned2024-10-09T22:52:12+00:00
URL https://dlnewsoft.com/robots.txt
Redirect https://www.dlnewsoft.com/robots.txt
Redirect Domain www.dlnewsoft.com
Redirect Base dlnewsoft.com
Domain IPs 104.21.46.105, 172.67.137.197, 2606:4700:3031::ac43:89c5, 2606:4700:3037::6815:2e69
Redirect IPs 104.21.46.105, 172.67.137.197, 2606:4700:3031::ac43:89c5, 2606:4700:3037::6815:2e69
Response IP 172.67.137.197
Found Yes
Hash c4228e5acc330a4dd961e5f49558a9542c97b2dd51b3294e0a6d757f0594fee0
SimHash 512488701e22

Groups

*

Rule Path
Disallow /wp-admin/
Disallow */trackback/
Disallow *?wptheme=
Disallow *?comments=
Disallow *?replytocom
Disallow *?attachment_id=
Disallow */trackback*
Allow /wp-admin/admin-ajax.php

sogou web spider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

addthis.com (http://support.addthis.com/)

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dlnewsoft.com/sitemap_index.xml