Log In Sign Up

2dehands.be
robots.txt

Robots Exclusion Standard data for 2dehands.be

Resource Scan

Scan Details

Site Domain 2dehands.be
Base Domain 2dehands.be
Scan Status Ok
Last Scan2024-10-25T01:53:36+00:00
Next Scan 2024-11-01T01:53:36+00:00

Last Scan

Scanned2024-10-25T01:53:36+00:00
URL https://2dehands.be/robots.txt
Redirect https://www.2dehands.be/robots.txt
Redirect Domain www.2dehands.be
Redirect Base 2dehands.be
Domain IPs 13.226.2.117, 13.226.2.25, 13.226.2.34, 13.226.2.55
Redirect IPs 13.226.2.117, 13.226.2.25, 13.226.2.34, 13.226.2.55
Response IP 3.164.206.41
Found Yes
Hash 7fe2e71cb8501d1db1ca40cde852f0930846762fb83c0facf07551d737d2de4e
SimHash e895133a0776

Groups

*

Rule Path
Disallow /experiences/*
Disallow /*/asq/
Disallow /4282/mpnl.*
Disallow /LR/*
Disallow /4282/web/mpnl.*
Disallow /messages*
Disallow /notifications*
Disallow /plaats/*
Disallow /i/adinfo/*
Disallow /admanager/*
Disallow /u/*/*/q/*
Disallow /u/*/*/l/*
Disallow /u/*/*/f/*
Disallow /account/wachtwoordvergeten.html
Disallow /account/wachtwoordinstellen.html
Disallow /account/password-reset/initiate.html
Disallow /account/password-reset/confirm.html
Disallow /account/confirm.html
Disallow /account/login.html?target=*
Disallow /account/createAccount.html
Disallow /account/loginSuccess.html
Disallow /account/login.html
Disallow /account/password-reset/secure-redirect-new-password.html
Disallow /accounts/authentication/logout
Disallow /account/oauth/login.html
Disallow /identity/v2/reset-password
Disallow /identity/v2/new-password
Disallow /identity/v2/confirm
Disallow /identity/v2/login
Disallow /identity/v2/create-account
Disallow /identity/v2/logout
Disallow /identity/v2/two-factor-auth-setup
Disallow /identity/v2/delete-account
Disallow /identity/v2/delete-account/confirm
Disallow /identity/v2/change-email/initiate
Disallow /identity/v2/mid.js
Disallow /identity/mid.js
Disallow /mymp/
Disallow /asq.html
Disallow /asq
Disallow /syi/
Disallow /flag/
Disallow /bid/
Disallow /externalUrl/
Disallow /EVIP/*
Disallow /VIP/*
Disallow /L1PAGE/*
Disallow /L1.5PAGE/*
Disallow /*ebayimg.com/*/s/*
Disallow /metrics/
Disallow /wijzigAdvertentie/
Disallow /search?q=*
Disallow /callback/
Disallow /beheer/
Disallow /page_personnelle/
Disallow /evaluation_profil.html
Disallow /rating.html
Disallow /login.html
Disallow /session_ouvrir.html
Disallow /loguit.html
Disallow /session_fermer.html
Disallow /registreer/
Disallow /sinscrire/
Disallow /bevestig/
Disallow /confirmez/
Disallow /transactie/
Disallow /transaction/
Disallow /bestelling/
Disallow /commande/
Disallow /afrekenen/
Disallow /payer/
Disallow /1006750/
Disallow /7195/
Disallow /219305991/
Disallow /advertentie/*/stuur_door/
Disallow /annonce/*/transferer_annonce/
Disallow /advertentie/*/reactie/
Disallow /annonce/*/reaction/
Disallow /beheer/chat/
Disallow /page_personnelle/messagerie_instantanee/
Disallow /lrp/api/audience-targeting
Disallow /px/fb*
Disallow /a/*/*/m*.html?c=*
Disallow /a/*/*/a*.html?c=*
Disallow /v/*/*/m*?c=*
Disallow /v/*/*/a*?c=*
Disallow /a/*/*/m*.html*correlationId%3D*
Disallow /a/*/*/a*.html*correlationId%3D*
Disallow /v/*/*/m*correlationId%3D*
Disallow /v/*/*/a*correlationId%3D*
Disallow /?type=*
Disallow /kijkinuwwijk.html?m_i=*
Disallow */undefined*
Back to top

Other Records

Field Value
sitemap https://www.2dehands.be/sitemap/sitemap.xml
Back to top

Comments

  • Here is our sitemap (this line is independent of UA blocks, per the spec)
  • Please keep blocking of all URLs in place for at least 2 years after removing a specific module
  • SOI subpage
  • login, confirm and forgot password pages
  • mymp pages
  • ASQ pages
  • SYI Pages
  • Flagging/tipping ads
  • bidding on ads
  • external url redirects
  • google analytics
  • korean spam
  • legacy
  • prevent unnecessary crawling
  • Block VIPs with parameters
  • block homepage feeds
  • block kijkinuwwijk parameters
  • block undefined URLs
Back to top