family-drugs.net
robots.txt
Robots Exclusion Standard data for family-drugs.net
Resource Scan
Scan Details
Site Domain | family-drugs.net |
Base Domain | family-drugs.net |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-06-04T20:01:02+00:00 |
Next Scan | 2025-06-05T20:01:02+00:00 |
Last Successful Scan
Scanned | 2025-05-05T19:56:56+00:00 |
URL | https://family-drugs.net/robots.txt |
Domain IPs | 104.21.17.209, 172.67.178.79, 2606:4700:3034::6815:11d1, 2606:4700:3035::ac43:b24f |
Response IP | 104.21.17.209 |
Found | Yes |
Hash | 152b4336536d0650a416b32356aa04f2c622e55638e85646a79efee043b3c8e1 |
SimHash | 2d095c77e595 |
Groups
*
Rule | Path |
---|---|
Disallow | /imgs/ |
Disallow | /images/ |
Disallow | /click.* |
Disallow | /checkout.* |
Other Records
Field | Value |
---|---|
crawl-delay | 600 |
Other Records
Field | Value |
---|---|
sitemap | sitemap.xml |