investor.walgreensbootsalliance.com
robots.txt

Robots Exclusion Standard data for investor.walgreensbootsalliance.com

Resource Scan

Scan Details

Site Domain investor.walgreensbootsalliance.com
Base Domain walgreensbootsalliance.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-08T01:38:45+00:00
Next Scan 2025-01-06T01:38:45+00:00

Last Successful Scan

Scanned2024-02-19T01:36:40+00:00
URL https://investor.walgreensbootsalliance.com/robots.txt
Domain IPs 162.159.130.11
Response IP 162.159.130.11
Found Yes
Hash de73d32142f114b8d18bbfd7fa5779ccee5f7a1753873402cfdab59444834ccd
SimHash 691cde52c053

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

eluta.ca

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

ms search 6.0 robot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

gsa-crawler

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60