courir.nl
robots.txt
Robots Exclusion Standard data for courir.nl
Resource Scan
Scan Details
Site Domain | courir.nl |
Base Domain | courir.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-18T17:48:44+00:00 |
Next Scan | 2024-12-17T17:48:44+00:00 |
Last Successful Scan
Scanned | 2024-04-29T15:34:56+00:00 |
URL | https://www.courir.nl/robots.txt |
Domain IPs | 18.155.68.106, 18.155.68.41, 18.155.68.7, 18.155.68.92, 2600:9000:23d2:1800:1f:5876:db40:93a1, 2600:9000:23d2:3c00:1f:5876:db40:93a1, 2600:9000:23d2:6400:1f:5876:db40:93a1, 2600:9000:23d2:9a00:1f:5876:db40:93a1, 2600:9000:23d2:ae00:1f:5876:db40:93a1, 2600:9000:23d2:dc00:1f:5876:db40:93a1, 2600:9000:23d2:e800:1f:5876:db40:93a1, 2600:9000:23d2:fa00:1f:5876:db40:93a1 |
Response IP | 18.155.68.7 |
Found | Yes |
Hash | 497bb2d93a610c9aaffc96b66342007cff6bb92db2dc54c8237e23559c922897 |
SimHash | e00d11500da7 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?prefn |
Disallow | /*?prefv |
Disallow | /*?pmin |
Disallow | /*?pmax |
Disallow | /*?srule |
Disallow | /*%26prefn |
Disallow | /*%26prefv |
Disallow | /*%26pmin |
Disallow | /*%26pmax |
Disallow | /*%26srule |
Disallow | /*dwvar |
Disallow | /*cgid |
Disallow | /*%2B |
Disallow | /*marques/marque/ |
Disallow | /c/ |
Disallow | /cdn-cgi/ |
Disallow | /*/CQRecomm-Start |
Disallow | /*/SeoRedirect-RedirectLang |
Disallow | /*__Analytics-Start |
Disallow | /*/Product-Variation?* |
Disallow | /nl_*-PP_* |
Disallow | /*?start=* |
Allow | /*?start=24&sz=24 |
Allow | /*?start=48&sz=24 |
Allow | /*?start=72&sz=24 |
Allow | /*?start=96&sz=24 |
Disallow | /*/cart |
Disallow | /*account |
Disallow | /*register |
Disallow | /*/giftcertpurchase |
Disallow | /*/compare |
Disallow | /*/billing |
Disallow | /*/orders |
Disallow | /*Login-AuthenticateWithFacebook |
Disallow | /on/demandware.store/Sites-Courir-*/Login-Show |
Disallow | /on/demandware.store/Sites-Courir-*/COPayment-Start |
Disallow | /*search? |
Disallow | /*search* |
Disallow | /*?zone=bandeau* |
Comments