aldifoods.com
robots.txt

Robots Exclusion Standard data for aldifoods.com

Resource Scan

Scan Details

Site Domain aldifoods.com
Base Domain aldifoods.com
Scan Status Ok
Last Scan2024-09-15T23:45:41+00:00
Next Scan 2024-10-15T23:45:41+00:00

Last Scan

Scanned2024-09-15T23:45:41+00:00
URL http://www.aldifoods.com/robots.txt
Redirect https://www.aldi.us/robots.txt
Redirect Domain www.aldi.us
Redirect Base aldi.us
Domain IPs 109.235.139.138
Redirect IPs 216.137.52.28, 216.137.52.41, 216.137.52.61, 216.137.52.9
Response IP 13.226.2.126
Found Yes
Hash 9c5c0b2b9a20a238d7d726b87075370baab4e335efde02c2cf4e650ceeb02cbf
SimHash 695dca15eb51

Groups

mj12bot

Rule Path
Disallow /

googlebot
searchmetricsbot
slurp
bingbot
teoma

Rule Path
Disallow /*/template.html$
Disallow /*/contenttemplate.html$

*

Rule Path
Disallow /stores/

Other Records

Field Value
sitemap https://www.aldi.us/en/sitemap.xml
sitemap https://www.aldi.us/en/sitemap-index.xml
sitemap https://corporate.aldi.us/en/sitemap.xml
sitemap https://corporate.aldi.us/en/sitemap-index.xml