test-aankoop-verzekeringen.be
robots.txt
Robots Exclusion Standard data for test-aankoop-verzekeringen.be
Resource Scan
Scan Details
| Site Domain | test-aankoop-verzekeringen.be |
| Base Domain | test-aankoop-verzekeringen.be |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-24T14:11:49+00:00 |
| Next Scan | 2024-12-23T14:11:49+00:00 |
Last Successful Scan
| Scanned | 2023-05-30T09:13:19+00:00 |
| URL | https://www.test-aankoop-verzekeringen.be/robots.txt |
| Domain IPs | 104.18.2.36, 104.18.3.36, 2606:4700::6812:224, 2606:4700::6812:324 |
| Response IP | 104.18.2.36 |
| Found | Yes |
| Hash | e5ce9a0bf4b64798c37e548e38e8b846b8eed81e03a1b29eb1614e5f2a6c735c |
| SimHash | 590ccc0ac9d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rss/* |
| Disallow | /embed/* |
| Disallow | /errors/* |
| Disallow | /sitecore/* |
| Disallow | /layouts/* |
| Disallow | /sitemap/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.test-aankoop-verzekeringen.be/sitemap.xml |
Comments