aldiadallas.com
robots.txt

Robots Exclusion Standard data for aldiadallas.com

Resource Scan

Scan Details

Site Domain aldiadallas.com
Base Domain aldiadallas.com
Scan Status Ok
Last Scan2024-09-22T09:30:44+00:00
Next Scan 2024-09-29T09:30:44+00:00

Last Scan

Scanned2024-09-22T09:30:44+00:00
URL https://aldiadallas.com/robots.txt
Redirect https://www.dallasnews.com/robots.txt
Redirect Domain www.dallasnews.com
Redirect Base dallasnews.com
Domain IPs 15.197.248.213, 3.33.236.11
Redirect IPs 23.52.171.153, 23.52.171.154, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c19d
Response IP 23.52.171.153
Found Yes
Hash 1055b7d4e12496d93613a48da14dd2a4eebec9d8990f7a6a55db268c3c382f34
SimHash 290cd840e393

Groups

*

Rule Path
Allow /

magnetbot

Rule Path
Allow /

*

Rule Path
Disallow /help/thank*
Disallow /checkout/*
Disallow /offers*
Allow /subscribe/join/
Disallow /subscribe*

magnetbot

Rule Path
Disallow /checkout/*
Disallow /offers*
Disallow /subscribe*

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.dallasnews.com/arc/outboundfeeds/sitemap-index/?outputType=xml