divenewsletter.com
robots.txt

Robots Exclusion Standard data for divenewsletter.com

Resource Scan

Scan Details

Site Domain divenewsletter.com
Base Domain divenewsletter.com
Scan Status Ok
Last Scan2024-11-06T05:03:29+00:00
Next Scan 2024-12-06T05:03:29+00:00

Last Scan

Scanned2024-11-06T05:03:29+00:00
URL https://www.divenewsletter.com/robots.txt
Redirect https://www.industrydive.com/robots.txt
Redirect Domain www.industrydive.com
Redirect Base industrydive.com
Domain IPs 104.18.43.191, 172.64.144.65, 2606:4700:4400::6812:2bbf, 2606:4700:4400::ac40:9041
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 54.178.223.218
Found Yes
Hash 72628c6583752b4f849b99cb5f59806c2d93f966392629aba5ef9f0ccad7f793
SimHash a1055045af13

Groups

*

Rule Path
Disallow /dw-all-path-1

Other Records

Field Value
sitemap https://www.industrydive.com/sitemap.xml