thaiunion.com
robots.txt
Robots Exclusion Standard data for thaiunion.com
Resource Scan
Scan Details
| Site Domain | thaiunion.com |
| Base Domain | thaiunion.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-06T08:41:50+00:00 |
| Next Scan | 2024-12-05T08:41:50+00:00 |
Last Successful Scan
| Scanned | 2024-01-18T08:39:56+00:00 |
| URL | https://thaiunion.com/robots.txt |
| Redirect | https://www.thaiunion.com/robots.txt |
| Redirect Domain | www.thaiunion.com |
| Redirect Base | thaiunion.com |
| Domain IPs | 13.35.169.28, 204.246.164.46 |
| Redirect IPs | 18.155.68.107, 18.155.68.129, 18.155.68.6, 18.155.68.88, 2600:9000:23d2:1400:6:d6f6:ec80:93a1, 2600:9000:23d2:3000:6:d6f6:ec80:93a1, 2600:9000:23d2:4400:6:d6f6:ec80:93a1, 2600:9000:23d2:4a00:6:d6f6:ec80:93a1, 2600:9000:23d2:b000:6:d6f6:ec80:93a1, 2600:9000:23d2:b200:6:d6f6:ec80:93a1, 2600:9000:23d2:d600:6:d6f6:ec80:93a1, 2600:9000:23d2:ea00:6:d6f6:ec80:93a1 |
| Response IP | 3.160.196.119 |
| Found | Yes |
| Hash | bc27325ac30a015f5adf8d16db89b0ede69f91511367f539c34a3266a277deb9 |
| SimHash | 491c4048ef80 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /en/about/company/csr-activities |
| Disallow | /th/about/company/csr-activities |
| Disallow | /en/about/company/csr-activities/333/csr-1 |
| Disallow | /en/about/company/csr-activities/334/csr-2 |
| Disallow | /en/about/company/csr-activities/335/csr-3 |
| Disallow | /th/about/company/csr-activities/333/csr-1 |
| Disallow | /th/about/company/csr-activities/334/csr-2 |
| Disallow | /th/about/company/csr-activities/335/csr-3 |
| Disallow | /en/about/environment-health-and-safety-v1 |
| Disallow | /en/about/environment-health-and-safety-backup |
| Disallow | /*-preview |