ariens.com
robots.txt
Robots Exclusion Standard data for ariens.com
Resource Scan
Scan Details
Site Domain | ariens.com |
Base Domain | ariens.com |
Scan Status | Ok |
Last Scan | 2024-10-22T13:50:22+00:00 |
Next Scan | 2024-11-21T13:50:22+00:00 |
Last Scan
Scanned | 2024-10-22T13:50:22+00:00 |
URL | https://www.ariens.com/robots.txt |
Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.57 |
Found | Yes |
Hash | 82983d3d13fa348eecf2be4cbe272fdf442b7df0752d44c3228bf688b3329d1f |
SimHash | 6c75d870a349 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /checkout/ |
Disallow | /support/signin |
Disallow | /support/create-account |
Disallow | /support |
Disallow | /support/case-insert |
Disallow | /support/profile |
Disallow | /parts/list |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |