drugs.com
robots.txt
Robots Exclusion Standard data for drugs.com
Resource Scan
Scan Details
| Site Domain | drugs.com |
| Base Domain | drugs.com |
| Scan Status | Ok |
| Last Scan | 2024-11-02T16:12:44+00:00 |
| Next Scan | 2024-11-09T16:12:44+00:00 |
Last Scan
| Scanned | 2024-11-02T16:12:44+00:00 |
| URL | https://drugs.com/robots.txt |
| Redirect | https://www.drugs.com/robots.txt |
| Redirect Domain | www.drugs.com |
| Redirect Base | drugs.com |
| Domain IPs | 23.210.106.59, 2600:1413:b000:38a::19b8, 2600:1413:b000:39a::19b8 |
| Redirect IPs | 23.210.106.59, 2600:1413:1:98e::19b8 |
| Response IP | 23.210.106.59 |
| Found | Yes |
| Hash | 15c75782702a094a32abd02932673f7383a17c76e875cad118f5784295ad1dd4 |
| SimHash | 8948f842c710 |
Groups
mediapartners-google
twitterbot
mozilla/5.0 (windows nt 6.1; wow64) applewebkit/535.1 (khtml, like gecko) chrome/13.0.782.112 safari/535.1
| Rule | Path |
|---|---|
| Disallow |
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /drug-interactions-all/ |
| Disallow | /interactions-list-drugs.php |
| Disallow | /members_comments_add/ |
| Disallow | /search.php |
| Disallow | /search-wildcard-phonetic.php |
| Disallow | /survey/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.drugs.com/sitemap_index.xml.gz |