alzheimers.gov
robots.txt
Robots Exclusion Standard data for alzheimers.gov
Resource Scan
Scan Details
Site Domain | alzheimers.gov |
Base Domain | alzheimers.gov |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-04T13:52:37+00:00 |
Next Scan | 2024-06-03T13:52:37+00:00 |
Last Successful Scan
Scanned | 2024-03-13T12:31:54+00:00 |
URL | https://alzheimers.gov/robots.txt |
Redirect | https://www.alzheimers.gov/robots.txt |
Redirect Domain | www.alzheimers.gov |
Redirect Base | alzheimers.gov |
Domain IPs | 76.223.47.21 |
Redirect IPs | 108.156.133.45, 108.156.133.55, 108.156.133.83, 108.156.133.93, 2600:9000:2755:200:0:470e:9c0:93a1, 2600:9000:2755:3400:0:470e:9c0:93a1, 2600:9000:2755:7e00:0:470e:9c0:93a1, 2600:9000:2755:c400:0:470e:9c0:93a1, 2600:9000:2755:c600:0:470e:9c0:93a1, 2600:9000:2755:cc00:0:470e:9c0:93a1, 2600:9000:2755:d400:0:470e:9c0:93a1, 2600:9000:2755:f600:0:470e:9c0:93a1 |
Response IP | 108.156.133.83 |
Found | Yes |
Hash | 97eaa91d8c11828b478454cf95ce9eee710d9d59b2750c410fc3c78a4d1e0668 |
SimHash | 3c169f09c764 |
Groups
*
Rule | Path |
---|---|
Allow | /_next/static/chunks/*.css$ |
Allow | /_next/static/chunks/*.css? |
Allow | /_next/static/chunks/*.js$ |
Allow | /_next/static/chunks/*.js? |
Allow | /_next/static/chunks/*.gif |
Allow | /_next/static/chunks/*.jpg |
Allow | /_next/static/chunks/*.jpeg |
Allow | /_next/static/chunks/*.png |
Allow | /_next/static/chunks/*.svg |
Allow | /images/*.png |
Disallow | /api/ |
Disallow | /node/ |
Disallow | /node/* |
Disallow | /node |
Comments