gravely.com
robots.txt
Robots Exclusion Standard data for gravely.com
Resource Scan
Scan Details
Site Domain | gravely.com |
Base Domain | gravely.com |
Scan Status | Ok |
Last Scan | 2024-10-07T02:14:35+00:00 |
Next Scan | 2024-11-06T02:14:35+00:00 |
Last Scan
Scanned | 2024-10-07T02:14:35+00:00 |
URL | https://www.gravely.com/robots.txt |
Domain IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | 82983d3d13fa348eecf2be4cbe272fdf442b7df0752d44c3228bf688b3329d1f |
SimHash | 6c75d870a349 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /checkout/ |
Disallow | /support/signin |
Disallow | /support/create-account |
Disallow | /support |
Disallow | /support/case-insert |
Disallow | /support/profile |
Disallow | /parts/list |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |