automation24.de
robots.txt
Robots Exclusion Standard data for automation24.de
Resource Scan
Scan Details
| Site Domain | automation24.de |
| Base Domain | automation24.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-08T03:25:38+00:00 |
| Next Scan | 2024-12-07T03:25:38+00:00 |
Last Successful Scan
| Scanned | 2024-01-19T22:38:02+00:00 |
| URL | https://automation24.de/robots.txt |
| Redirect | https://www.automation24.de/robots.txt |
| Redirect Domain | www.automation24.de |
| Redirect Base | automation24.de |
| Domain IPs | 104.26.14.69, 104.26.15.69, 172.67.72.191, 2606:4700:20::681a:e45, 2606:4700:20::681a:f45, 2606:4700:20::ac43:48bf |
| Redirect IPs | 104.26.14.69, 104.26.15.69, 172.67.72.191, 2606:4700:20::681a:e45, 2606:4700:20::681a:f45, 2606:4700:20::ac43:48bf |
| Response IP | 104.26.14.69 |
| Found | Yes |
| Hash | 595d4b6ab85e25a0f7249b3241a667181dadecf6f6e04c531dc34e672792ebac |
| SimHash | 5b80d620f9d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?Filter=* |
| Disallow | /*?filter=* |
| Disallow | /*?Items=* |
| Disallow | /*?items=* |
| Disallow | /*?Page=* |
| Disallow | /*?page=* |
| Disallow | /*?Sort=* |
| Disallow | /*?sort=* |
| Disallow | /amountvoucher |
| Disallow | /amountvoucher/* |
| Disallow | /artikel/* |
| Disallow | /Artikel/* |
| Disallow | /Checkout |
| Disallow | /checkout |
| Disallow | /Checkout/* |
| Disallow | /checkout/* |
| Disallow | /corporationmanagement |
| Disallow | /corporationmanagement/* |
| Disallow | /Customer |
| Disallow | /customer |
| Disallow | /Customer/* |
| Disallow | /customer/* |
| Disallow | /invoicedelivery |
| Disallow | /invoicedelivery/* |
| Disallow | /kategorie/* |
| Disallow | /Landingpage |
| Disallow | /landingpage |
| Disallow | /merkzettel |
| Disallow | /merkzettel/* |
| Disallow | /multiuseraccountmanagement |
| Disallow | /multiuseraccountmanagement/* |
| Disallow | /page/* |
| Disallow | /Payment/* |
| Disallow | /projectlist |
| Disallow | /project-list |
| Disallow | /projectlist/* |
| Disallow | /project-list/* |
| Disallow | /quotation |
| Disallow | /Quotation |
| Disallow | /quotation/* |
| Disallow | /Quotation/* |
| Disallow | /quotationrequest |
| Disallow | /quotationrequest/* |
| Disallow | /ShipmentTracking* |
| Disallow | /sicher_einkaufen |
| Disallow | /sicher_einkaufen/* |
| Disallow | /warenkorb |
| Disallow | /warenkorb/* |
| Disallow | /basket |
| Disallow | /basket/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.automation24.de/sitemap.xml |