caeonline.com
robots.txt
Robots Exclusion Standard data for caeonline.com
Resource Scan
Scan Details
| Site Domain | caeonline.com |
| Base Domain | caeonline.com |
| Scan Status | Ok |
| Last Scan | 2024-10-26T00:35:03+00:00 |
| Next Scan | 2024-11-25T00:35:03+00:00 |
Last Scan
| Scanned | 2024-10-26T00:35:03+00:00 |
| URL | https://caeonline.com/robots.txt |
| Domain IPs | 13.107.246.59 |
| Response IP | 13.107.246.59 |
| Found | Yes |
| Hash | 70ab1c8dcfd298425320b60a1eba228428812ab7d87e157b245afe7b8763356e |
| SimHash | 990d7854bb02 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*search?* |
| Disallow | /*sort%3D* |
| Disallow | /*onlyPhotos%3D* |
| Disallow | /*categories%3D* |
| Disallow | /*Category?=* |
| Disallow | /*manufacturers%3D* |
| Disallow | /*status%3D* |
| Disallow | /*mfrModel%3D* |
| Disallow | /*equipId%3D* |
| Disallow | /*filter%3D* |
| Disallow | /*type%3D* |
| Disallow | /*skip%3D* |
| Disallow | /*recs%3D* |
| Disallow | /*top%3D* |
| Disallow | /*keywords%3D* |
| Disallow | /*q%3D* |
| Disallow | /*model%3D* |
| Disallow | /*mfr%3D* |
| Disallow | /*waferSizes%3D* |
| Disallow | /*vintages%3D* |
| Disallow | /*hasPhotos%3D* |
| Disallow | /buy/cart |
| Disallow | /errors/* |
| Disallow | /listing/product/* |
| Disallow | /gis$ |
| Disallow | /asia$ |
| Disallow | /why-cae$ |
| Disallow | /europe$ |
| Disallow | /leadership$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://caeonline.com/sitemap.xml |