medlineplus.awsprod.nlm.nih.gov
robots.txt
Robots Exclusion Standard data for medlineplus.awsprod.nlm.nih.gov
Resource Scan
Scan Details
| Site Domain | medlineplus.awsprod.nlm.nih.gov |
| Base Domain | nih.gov |
| Scan Status | Ok |
| Last Scan | 2024-04-22T12:18:07+00:00 |
| Next Scan | 2024-05-22T12:18:07+00:00 |
Last Scan
| Scanned | 2024-04-22T12:18:07+00:00 |
| URL | https://medlineplus.awsprod.nlm.nih.gov/robots.txt |
| Domain IPs | 18.155.192.110, 18.155.192.41, 18.155.192.44, 18.155.192.62, 2600:9000:2475:5e00:1:6b7c:7400:93a1, 2600:9000:2475:6a00:1:6b7c:7400:93a1, 2600:9000:2475:a00:1:6b7c:7400:93a1, 2600:9000:2475:a600:1:6b7c:7400:93a1, 2600:9000:2475:c200:1:6b7c:7400:93a1, 2600:9000:2475:da00:1:6b7c:7400:93a1, 2600:9000:2475:f400:1:6b7c:7400:93a1, 2600:9000:2475:f600:1:6b7c:7400:93a1 |
| Response IP | 18.165.171.8 |
| Found | Yes |
| Hash | 56de24df38fc4cc898993964f130fd1186357853864217b66cb8b68913d2100f |
| SimHash | c8558140cf00 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /URLchecker/ |
| Disallow | /usp/ |
| Disallow | /cgi/ |
| Disallow | /logs/ |
| Disallow | /glftp/ |
| Disallow | /feeds/topics/ |
| Disallow | /groupfeeds/ |
| Disallow | /spanish/feeds/topics/ |
| Disallow | /spanish/groupfeeds/ |
| Disallow | /xml/ |
| Disallow | /xml/vocabulary/ |
| Disallow | /scwidget/topsearch.html |
| Disallow | /spanish/scwidget/topsearch.html |
| Disallow | /tutorials/*.swf$ |
| Disallow | /spanish/tutorials/*.swf$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://medlineplus.gov/sitemap.xml |