lastdodo.nl
robots.txt
Robots Exclusion Standard data for lastdodo.nl
Resource Scan
Scan Details
Site Domain | lastdodo.nl |
Base Domain | lastdodo.nl |
Scan Status | Ok |
Last Scan | 2025-03-20T04:28:44+00:00 |
Next Scan | 2025-04-19T04:28:44+00:00 |
Last Scan
Scanned | 2025-03-20T04:28:44+00:00 |
URL | https://lastdodo.nl/robots.txt |
Redirect | https://www.lastdodo.nl/robots.txt |
Redirect Domain | www.lastdodo.nl |
Redirect Base | lastdodo.nl |
Domain IPs | 34.107.215.221 |
Redirect IPs | 34.107.215.221 |
Response IP | 34.107.215.221 |
Found | Yes |
Hash | eb6fa18b158f1e8d30f556cae51428cfd7970e27b901a29125bea957ea26abee |
SimHash | 78b0c9d06958 |
Groups
*
Rule | Path |
---|---|
Disallow | /collection |
Disallow | /marche |
Disallow | /marketplace |
Disallow | /marktplaats |
Disallow | /marktplatz |
Disallow | /verzameling |
Disallow | /catalog/area_history |
Disallow | /catalog/view_shops |
Disallow | /catalog/bulk_add |
Disallow | /lots/ |
Disallow | /search |
Disallow | /shop/order |
Disallow | /invoices |
Disallow | /user* |
Disallow | /history?area=*$ |
Disallow | /currencies |
Disallow | /register_user |
Disallow | /auth* |
Disallow | /user/feedbacks |
Disallow | /user/view |
Disallow | /buyer/categories |
Disallow | /catalog/user/view |
Disallow | /nl/community/forum_users |
Disallow | /en/community/forum_users |
Disallow | /fr/community/forum_users |
Disallow | /de/community/forum_users |
Disallow | /nl/users |
Disallow | /en/users |
Disallow | /fr/users |
Disallow | /de/users |
Disallow | */edit$ |
Disallow | *?*cf*=* |
Disallow | *?*interest=* |
Disallow | *?*own_images=* |
Disallow | *?*own_images=* |
Disallow | *?*price_from=* |
Disallow | *?*price_to=* |
Disallow | *?*q=* |
Disallow | *?*sale=* |
Disallow | *?*shop_pro=* |
Disallow | *?*show=* |
Disallow | *?*sort_by=* |
Disallow | *?*type_id=* |
Disallow | *?*view=* |
Disallow | *?filters* |
Disallow | /*/community/*/new$ |
Disallow | /*/marketplace/search |
Disallow | /*/shops/*/* |
Disallow | /catalog/*/history$ |
Disallow | /catalog/add_image |
Disallow | /catalog/area_history |
Disallow | /catalog/area_link |
Disallow | /catalog/edit_item |
Disallow | /catalog/moderators |
Disallow | /catalog/new_item |
Disallow | /catalog/price_suggestion |
Disallow | /catalog/user/feedbacks |
Disallow | /catalog/user/login |
Disallow | /catalog/user/register |
Disallow | /catalog/user/opt_out_info |
Disallow | /shop/*/questions/new |
Disallow | /shop/feedback |
Disallow | /shop/order_step_1 |
Disallow | /shop/shopping_cart |
Disallow | /shop/shopping_cart_login |
Disallow | /user/my_shopping_carts |
Disallow | /user/view/*/area_backgrounds_written |
Disallow | /wish_list |
Disallow | /shop/*/i/*/v |
Disallow | /catalog/view_collectors |
Disallow | /catalog/most_recent_items |
Disallow | /catalog/view_shops |
Disallow | /*/users/*/collections |
Disallow | /*/users/*/collection |
Disallow | /*/marketplace/* |
Disallow | /explore |
Disallow | *?*related_items=* |
Disallow | *?*only_aggregate=* |
Disallow | *?*include_all=* |
Disallow | *?*hoofdreeks=* |
Disallow | *?*in_shop=* |
Disallow | *?*stamps_filter=* |
Disallow | */more?* |
Disallow | *?*q2=* |
Disallow | *?*from=* |
Disallow | *?*to=* |
Disallow | *?*sort_by_id=* |
Disallow | *?*replace_link=* |
Disallow | *?*prefix=* |
Disallow | *?*area_id=* |
Disallow | /catalog/grade_info/ |
Disallow | /shop/temporary_closed/ |
Disallow | /catalog/selected_items |
Disallow | *?*scope=* |
Disallow | *?*vg=* |
Disallow | *?*external=* |
Disallow | *?*id=* |
Disallow | *?*order=* |
Disallow | *?*hide_language_switch=* |
Disallow | *?*image=* |
Disallow | *?*filter=* |
Disallow | *?*slug=* |
Disallow | *?*token=* |
Disallow | *?*id_product=* |
Disallow | *?*search_cat_id=* |
Disallow | *?*qty=* |
Disallow | /*/my/ |
Disallow | */item_feed |
Disallow | *?*session_id=* |
Disallow | *?*referer=* |
Disallow | /csrf_token |
Disallow | /*/items/*/tabs/* |
Disallow | /*/items/*/tabs |
Disallow | /*/items/*/sub_items |
Disallow | /*/feedback |
Other Records
Field | Value |
---|---|
crawl-delay | 0.3 |
Other Records
Field | Value |
---|---|
sitemap | https://www.lastdodo.nl/nl/sitemap.xml.gz |
Comments