cylex.nl
robots.txt
Robots Exclusion Standard data for cylex.nl
Resource Scan
Scan Details
| Site Domain | cylex.nl |
| Base Domain | cylex.nl |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-02T04:50:45+00:00 |
| Next Scan | 2026-04-02T04:50:45+00:00 |
Last Successful Scan
| Scanned | 2025-08-12T00:49:52+00:00 |
| URL | https://cylex.nl/robots.txt |
| Redirect | https://www.cylex.nl/robots.txt |
| Redirect Domain | www.cylex.nl |
| Redirect Base | cylex.nl |
| Domain IPs | 104.18.4.185, 104.18.5.185, 2606:4700::6812:4b9, 2606:4700::6812:5b9 |
| Redirect IPs | 104.18.4.185, 104.18.5.185, 2606:4700::6812:4b9, 2606:4700::6812:5b9 |
| Response IP | 104.18.5.185 |
| Found | Yes |
| Hash | 548fc72ed61a364b42877e128534d42dca873b6dcb203b783f1f0e1233bf182d |
| SimHash | 2875c546d441 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /google/ |
| Disallow | /reviews/ |
| Disallow | /webmastertools/ |
| Disallow | /fir_news/ |
| Disallow | /webservices/ |
| Disallow | /Homepage/internet-shops.asp |
| Disallow | /webshop/ |
| Disallow | /correct/ |
| Disallow | /webservices/ |
| Disallow | /ContactForm.aspx |
| Disallow | /ContactForm2.aspx |
| Disallow | /ContactForm.ashx |
| Disallow | /uploadHandler.ashx |
| Disallow | /userContent.ashx |
| Disallow | /korrektur_firmendaten.asp |
| Disallow | /s? |
| Disallow | /ScriptResource.axd |
| Disallow | /combinescriptshandler.axd |
| Disallow | /WebResource.axd |
| Disallow | /info/cookies_policy.html |
| Disallow | /info/terms-and-conditions-customer-reviews.html |
| Disallow | /info/terms-and-conditions-quote-requests.html |
| Disallow | /api/ |
| Disallow | /map/*-route.html |
| Disallow | /showCompanyMap |
| Disallow | /cdn-cgi/ |