crailar.com
robots.txt
Robots Exclusion Standard data for crailar.com
Resource Scan
Scan Details
| Site Domain | crailar.com |
| Base Domain | crailar.com |
| Scan Status | Ok |
| Last Scan | 2024-10-25T15:44:40+00:00 |
| Next Scan | 2024-11-24T15:44:40+00:00 |
Last Scan
| Scanned | 2024-10-25T15:44:40+00:00 |
| URL | http://crailar.com/robots.txt |
| Redirect | https://www.bastfibretech.com/robots.txt |
| Redirect Domain | www.bastfibretech.com |
| Redirect Base | bastfibretech.com |
| Domain IPs | 67.223.102.78 |
| Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
| Response IP | 54.178.223.218 |
| Found | Yes |
| Hash | 5eff4f6b5ced90c0f7149ff3bd077f848d207d06f83947a2cb2890090b328099 |
| SimHash | 3d151c8d6c12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /page-template |
| Disallow | /library |
| Disallow | /library-2-base |
| Disallow | /typography-base |
| Disallow | /testing |
| Disallow | /testing-cookie |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bastfibretech.com/sitemap.xml |