thailandweb.nl
robots.txt
Robots Exclusion Standard data for thailandweb.nl
Resource Scan
Scan Details
| Site Domain | thailandweb.nl |
| Base Domain | thailandweb.nl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-02-14T03:59:37+00:00 |
| Next Scan | 2026-03-16T03:59:37+00:00 |
Last Successful Scan
| Scanned | 2026-01-16T03:57:57+00:00 |
| URL | https://thailandweb.nl/robots.txt |
| Domain IPs | 2a00:d640:d640:9999::2eeb:2851, 46.235.40.81 |
| Response IP | 46.235.40.81 |
| Found | Yes |
| Hash | effa42042344c018fdfebc8fb6118c63d93b3c5c5f00c8e69031f14bddb000b4 |
| SimHash | 980c5d14af92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css/ |
| Disallow | /images/ |
| Disallow | /kolom/ |
| Disallow | /vakantie.php |
| Disallow | /reizen.php |
| Disallow | /reizen/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://thailandweb.nl/sitemap.xml |