datasheetwiki.com
robots.txt
Robots Exclusion Standard data for datasheetwiki.com
Resource Scan
Scan Details
Site Domain | datasheetwiki.com |
Base Domain | datasheetwiki.com |
Scan Status | Ok |
Last Scan | 2024-10-01T14:41:45+00:00 |
Next Scan | 2024-10-08T14:41:45+00:00 |
Last Scan
Scanned | 2024-10-01T14:41:45+00:00 |
URL | https://datasheetwiki.com/robots.txt |
Domain IPs | 104.21.70.117, 172.67.223.97, 2606:4700:3031::ac43:df61, 2606:4700:3037::6815:4675 |
Response IP | 104.21.70.117 |
Found | Yes |
Hash | 53efcc3c216fc4f33def1408d313af4a6d8798e08f7da694c01f7ad31361abdc |
SimHash | 495ddd736e31 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*.pdf$ |
Disallow | /download.php |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |