Log In Sign Up

2ememain.be
robots.txt

Robots Exclusion Standard data for 2ememain.be

Resource Scan

Scan Details

Site Domain 2ememain.be
Base Domain 2ememain.be
Scan Status Ok
Last Scan2024-05-27T07:06:25+00:00
Next Scan 2024-06-03T07:06:25+00:00

Last Scan

Scanned2024-05-27T07:06:25+00:00
URL https://2ememain.be/robots.txt
Redirect https://www.2ememain.be/robots.txt
Redirect Domain www.2ememain.be
Redirect Base 2ememain.be
Domain IPs 34.120.83.206
Redirect IPs 18.161.6.101, 18.161.6.123, 18.161.6.13, 18.161.6.52
Response IP 108.157.60.125
Found Yes
Hash d31579f5838094a8ab285b05301f883022382cddf35ddf7df3a69e0974aa773d
SimHash e8d513ba0776

Groups

*

Rule Path
Disallow /experiences/*
Disallow /*/asq/
Disallow /4282/mpnl.*
Disallow /LR/*
Disallow /4282/web/mpnl.*
Disallow /messages*
Disallow /notifications*
Disallow /plaats/*
Disallow /i/adinfo/*
Disallow /admanager/*
Disallow /u/*/*/q/*
Disallow /u/*/*/l/*
Disallow /u/*/*/f/*
Disallow /account/wachtwoordvergeten.html
Disallow /account/wachtwoordinstellen.html
Disallow /account/password-reset/initiate.html
Disallow /account/password-reset/confirm.html
Disallow /account/confirm.html
Disallow /account/login.html?target=*
Disallow /account/createAccount.html
Disallow /account/loginSuccess.html
Disallow /mymp/
Disallow /asq.html
Disallow /asq
Disallow /syi/
Disallow /flag/
Disallow /bid/
Disallow /externalUrl/
Disallow /EVIP/*
Disallow /VIP/*
Disallow /L1PAGE/*
Disallow /L1.5PAGE/*
Disallow /*ebayimg.com/*/s/*
Disallow /metrics/
Disallow /wijzigAdvertentie/
Disallow /search?q=*
Disallow /callback/
Disallow /beheer/
Disallow /page_personnelle/
Disallow /evaluation_profil.html
Disallow /rating.html
Disallow /login.html
Disallow /session_ouvrir.html
Disallow /loguit.html
Disallow /session_fermer.html
Disallow /registreer/
Disallow /sinscrire/
Disallow /bevestig/
Disallow /confirmez/
Disallow /transactie/
Disallow /transaction/
Disallow /bestelling/
Disallow /commande/
Disallow /afrekenen/
Disallow /payer/
Disallow /1006750/
Disallow /7195/
Disallow /219305991/
Disallow /advertentie/*/stuur_door/
Disallow /annonce/*/transferer_annonce/
Disallow /advertentie/*/reactie/
Disallow /annonce/*/reaction/
Disallow /beheer/chat/
Disallow /page_personnelle/messagerie_instantanee/
Disallow /beheer/chat/
Disallow /page_personnelle/messagerie_instantanee/
Disallow /lrp/api/audience-targeting
Disallow /px/fb*
Disallow /a/*/*/m*.html?c=*
Disallow /a/*/*/a*.html?c=*
Disallow /v/*/*/m*?c=*
Disallow /v/*/*/a*?c=*
Disallow /a/*/*/m*.html*correlationId%3D*
Disallow /a/*/*/a*.html*correlationId%3D*
Disallow /v/*/*/m*correlationId%3D*
Disallow /v/*/*/a*correlationId%3D*
Disallow /?type=*
Disallow /kijkinuwwijk.html?m_i=*
Disallow */undefined*
Back to top

Other Records

Field Value
sitemap https://www.2ememain.be/sitemap/sitemap.xml
Back to top

Comments

  • Here is our sitemap (this line is independent of UA blocks, per the spec)
  • Please keep blocking of all URLs in place for at least 2 years after removing a specific module
  • SOI subpage
  • login, confirm and forgot password pages
  • mymp pages
  • ASQ pages
  • SYI Pages
  • Flagging/tipping ads
  • bidding on ads
  • external url redirects
  • google analytics
  • korean spam
  • legacy
  • prevent unnecessary crawling
  • Block VIPs with parameters
  • block homepage feeds
  • block kijkinuwwijk parameters
  • block undefined URLs
Back to top