idworks.com
robots.txt
Robots Exclusion Standard data for idworks.com
Resource Scan
Scan Details
Site Domain | idworks.com |
Base Domain | idworks.com |
Scan Status | Ok |
Last Scan | 2025-08-17T21:59:36+00:00 |
Next Scan | 2025-09-16T21:59:36+00:00 |
Last Scan
Scanned | 2025-08-17T21:59:36+00:00 |
URL | https://idworks.com/robots.txt |
Redirect | https://www.idworks.com/robots.txt |
Redirect Domain | www.idworks.com |
Redirect Base | idworks.com |
Domain IPs | 199.16.172.237, 199.16.173.73 |
Redirect IPs | 199.16.172.237, 199.16.173.73 |
Response IP | 199.16.172.237 |
Found | Yes |
Hash | 80ee0124093baa572e87c8ae36515d64c9c8cfc43696ee4f8d11ff1538ac9c51 |
SimHash | e511e972c343 |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /*%26 |
Disallow | /cgi-bin/ |
Disallow | /*add_to_wishlist%3D* |
Disallow | /*add_to_cart%3D* |
Disallow | /cart/ |
Disallow | /checkout/ |
Disallow | /my-account/ |
Disallow | /custom-quote/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |