dawsonnews.com
robots.txt

Robots Exclusion Standard data for dawsonnews.com

Resource Scan

Scan Details

Site Domain dawsonnews.com
Base Domain dawsonnews.com
Scan Status Ok
Last Scan2024-11-10T05:46:49+00:00
Next Scan 2024-11-17T05:46:49+00:00

Last Scan

Scanned2024-11-10T05:46:49+00:00
URL https://dawsonnews.com/robots.txt
Redirect https://www.dawsonnews.com:443/robots.txt
Redirect Domain www.dawsonnews.com
Redirect Base dawsonnews.com
Domain IPs 54.230.112.128, 54.230.112.24, 54.230.112.3, 54.230.112.67
Redirect IPs 54.230.112.128, 54.230.112.24, 54.230.112.3, 54.230.112.67
Response IP 108.156.22.30
Found Yes
Hash 337ef0ff38f7b1c658400bcc9a8279f2152fa08827537d27f7ebae0fc4fa24d2
SimHash 28090a458bf2

Groups

*

Rule Path
Disallow /auth/

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.dawsonnews.com/sitemap.xml