nl.boats.com
robots.txt
Robots Exclusion Standard data for nl.boats.com
Resource Scan
Scan Details
Site Domain | nl.boats.com |
Base Domain | boats.com |
Scan Status | Ok |
Last Scan | 2024-09-25T19:24:54+00:00 |
Next Scan | 2024-10-09T19:24:54+00:00 |
Last Scan
Scanned | 2024-09-25T19:24:54+00:00 |
URL | https://nl.boats.com/robots.txt |
Domain IPs | 54.230.112.104, 54.230.112.30, 54.230.112.72, 54.230.112.80 |
Response IP | 108.156.22.50 |
Found | Yes |
Hash | 87272219f581661822d044047c879d1d4ba80d6eab5c1cfc3fc11d67c4ee838d |
SimHash | 3d13ddda4fe7 |
Groups
*
Rule | Path |
---|---|
Disallow | /my-boats/ |
Disallow | /sites/ |
Disallow | /listing/ |
Allow | /boottransport/ |
Disallow | /boottransport/?b=* |
Allow | /boat-transport/index.jsp |
Disallow | /boat-transport/index.jsp?yw_country=* |
Disallow | /boten-te-koop/*sort%3D |
Disallow | /boten-te-koop/*currency%3D |
Disallow | /boten-te-koop/*length%3D |
Disallow | /boten-te-koop/*price%3D |
Disallow | /boten-te-koop/*year%3D |
Disallow | /boten-te-koop/*condition%3Dall-in-stock |
Disallow | /boten-te-koop/*condition%3Dnew-in-stock |
Disallow | /boten-te-koop/*condition%3Dnew-models |
Disallow | /boten-te-koop/*hull-material%3D |
Disallow | /boten-te-koop/*fuel-type%3D |
Disallow | /boten-te-koop/*created%3D |
Disallow | /boten-te-koop/*media-type%3D |
Disallow | /boten-te-koop/*activity%3D |
Disallow | *keyword%3D |
Disallow | *type-class%3D |
Disallow | *typeClass%3D |
Disallow | *?p= |
Disallow | *?locale= |
Disallow | *?redirect= |
Disallow | /boats.serv* |
Disallow | /engines/engine_details_frame.jsp* |
Disallow | /dealer/ |
Disallow | /boats/contact/email_seller.html |
Disallow | /252108799/Boats* |
Other Records
Field | Value |
---|---|
sitemap | https://nl.boats.com/sitemap.xml |
Comments