ocedar.com
robots.txt
Robots Exclusion Standard data for ocedar.com
Resource Scan
Scan Details
Site Domain | ocedar.com |
Base Domain | ocedar.com |
Scan Status | Ok |
Last Scan | 2024-05-22T16:50:02+00:00 |
Next Scan | 2024-06-21T16:50:02+00:00 |
Last Scan
Scanned | 2024-05-22T16:50:02+00:00 |
URL | https://ocedar.com/robots.txt |
Redirect | https://www.ocedar.com/robots.txt |
Redirect Domain | www.ocedar.com |
Redirect Base | ocedar.com |
Domain IPs | 137.116.205.193 |
Redirect IPs | 23.44.4.242, 23.44.5.219, 2600:1413:1::48f7:7fc9, 2600:1413:1::7d38:db40 |
Response IP | 42.99.140.186 |
Found | Yes |
Hash | 734119b439a82353fa5e716c9000032657d895b44bb8a0dd60ec1e03b67dc77e |
SimHash | ec605f1eedea |
Groups
*
Rule | Path |
---|---|
Disallow | /cart |
Disallow | /checkout |
Disallow | /my-account |
Disallow | /*?text= |
Other Records
Field | Value | Comment |
---|---|---|
crawl-delay | 10 | 10 seconds between page requests |
Other Records
Field | Value |
---|---|
sitemap | https://www.ocedar.com/sitemap.xml |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.
Comments