automation24.nl
robots.txt
Robots Exclusion Standard data for automation24.nl
Resource Scan
Scan Details
| Site Domain | automation24.nl |
| Base Domain | automation24.nl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-17T22:54:51+00:00 |
| Next Scan | 2024-11-15T22:54:51+00:00 |
Last Successful Scan
| Scanned | 2023-12-29T19:59:37+00:00 |
| URL | https://automation24.nl/robots.txt |
| Redirect | https://www.automation24.nl/robots.txt |
| Redirect Domain | www.automation24.nl |
| Redirect Base | automation24.nl |
| Domain IPs | 104.21.94.198, 172.67.168.165, 2606:4700:3030::ac43:a8a5, 2606:4700:3034::6815:5ec6 |
| Redirect IPs | 104.21.94.198, 172.67.168.165, 2606:4700:3030::ac43:a8a5, 2606:4700:3034::6815:5ec6 |
| Response IP | 172.67.168.165 |
| Found | Yes |
| Hash | f2ea6a105d4c9f3ac37f52e8f4e7ebe968f47b4e681e9ece24931b12970d43b0 |
| SimHash | 5ba0dc64fb52 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?Filter=* |
| Disallow | /*?filter=* |
| Disallow | /*?Items=* |
| Disallow | /*?items=* |
| Disallow | /*?Page=* |
| Disallow | /*?page=* |
| Disallow | /*?Sort=* |
| Disallow | /*?sort=* |
| Disallow | /amountvoucher |
| Disallow | /amountvoucher/* |
| Disallow | /article* |
| Disallow | /Article* |
| Disallow | /artikel/* |
| Disallow | /Artikel/* |
| Disallow | /Checkout |
| Disallow | /checkout |
| Disallow | /Checkout/* |
| Disallow | /checkout/* |
| Disallow | /corporationmanagement |
| Disallow | /corporationmanagement/* |
| Disallow | /Customer |
| Disallow | /customer |
| Disallow | /Customer/* |
| Disallow | /customer/* |
| Disallow | /invoicedelivery |
| Disallow | /invoicedelivery/* |
| Disallow | /kategorie/* |
| Disallow | /Landingpage |
| Disallow | /landingpage |
| Disallow | /merkzettel |
| Disallow | /merkzettel/* |
| Disallow | /mijn-notitieblok |
| Disallow | /mijn-notitieblok/* |
| Disallow | /multiuseraccountmanagement |
| Disallow | /multiuseraccountmanagement/* |
| Disallow | /page/* |
| Disallow | /Payment/* |
| Disallow | /projectlist |
| Disallow | /projectlist/* |
| Disallow | /quotation |
| Disallow | /Quotation |
| Disallow | /quotation/* |
| Disallow | /Quotation/* |
| Disallow | /quotationrequest |
| Disallow | /quotationrequest/* |
| Disallow | /ShipmentTracking* |
| Disallow | /sicher_einkaufen |
| Disallow | /sicher_einkaufen/* |
| Disallow | /winkelwagen |
| Disallow | /winkelwagen/* |
| Disallow | /basket |
| Disallow | /basket/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.automation24.nl/sitemap.xml |