Log In Sign Up

ec.europa.eu
robots.txt

Robots Exclusion Standard data for ec.europa.eu

Resource Scan

Scan Details

Site Domain ec.europa.eu
Base Domain europa.eu
Scan Status Ok
Last Scan2024-05-27T11:04:59+00:00
Next Scan 2024-06-26T11:04:59+00:00

Last Scan

Scanned2024-05-27T11:04:59+00:00
URL https://ec.europa.eu/robots.txt
Domain IPs 147.67.210.30, 147.67.34.30, 2a01:7080:14:100::666:30, 2a01:7080:24:100::666:30
Response IP 147.67.34.30
Found Yes
Hash 4c143f8fcd70c3923a8e79df3369879c64dd7da60b15d8e3c64ab52568b36f67
SimHash 4e2222609d58

Groups

baiduspider

Rule Path
Disallow /eurostat/tgm/
Disallow /europeaid/prag/

twitterbot

Rule Path
Allow /digital-single-market/en/files
Allow /digital-single-market/files
Allow /digital-single-market/sites/
Allow /digital-single-market/en/sites/

*

Rule Path
Disallow /archives/
Disallow /cgi-bin/
Disallow /clima/ets/
Disallow /clima/sites/registry/
Disallow /commission_2010-2014/katainen/
Disallow /creative-europe/404_en.htm
Disallow /culture/404_en.htm
Disallow /dgs/education_culture/404_en.htm
Disallow /eclas/
Disallow /education/404_en.htm
Disallow /employment_social/anticipedia/xwiki/bin/attach/
Disallow /employment_social/anticipedia/xwiki/bin/cancel/
Disallow /employment_social/anticipedia/xwiki/bin/commentadd/
Disallow /employment_social/anticipedia/xwiki/bin/delattachment/
Disallow /employment_social/anticipedia/xwiki/bin/delete/
Disallow /employment_social/anticipedia/xwiki/bin/dot/
Disallow /employment_social/anticipedia/xwiki/bin/download/
Disallow /employment_social/anticipedia/xwiki/bin/downloadrev/
Disallow /employment_social/anticipedia/xwiki/bin/edit/
Disallow /employment_social/anticipedia/xwiki/bin/export/
Disallow /employment_social/anticipedia/xwiki/bin/inline/
Disallow /employment_social/anticipedia/xwiki/bin/lifeblog/
Disallow /employment_social/anticipedia/xwiki/bin/login/
Disallow /employment_social/anticipedia/xwiki/bin/loginerror/
Disallow /employment_social/anticipedia/xwiki/bin/logout/
Disallow /employment_social/anticipedia/xwiki/bin/objectremove/
Disallow /employment_social/anticipedia/xwiki/bin/pdf/
Disallow /employment_social/anticipedia/xwiki/bin/preview/
Disallow /employment_social/anticipedia/xwiki/bin/propadd/
Disallow /employment_social/anticipedia/xwiki/bin/propdelete/
Disallow /employment_social/anticipedia/xwiki/bin/propupdate/
Disallow /employment_social/anticipedia/xwiki/bin/register/
Disallow /employment_social/anticipedia/xwiki/bin/save/
Disallow /employment_social/anticipedia/xwiki/bin/skin/
Disallow /employment_social/anticipedia/xwiki/bin/status/
Disallow /employment_social/anticipedia/xwiki/bin/upload/
Disallow /employment_social/anticipedia/xwiki/bin/viewattachrev/
Disallow /employment_social/anticipedia/xwiki/bin/viewrev/
Disallow /employment_social/anticipedia/xwiki/bin/xmlrpc/
Disallow /environment/ets/
Disallow /erasmus-plus/404_en.htm
Disallow /eurostat/SDMX/diss-web/rest/
Disallow /fisheries/fleet/
Disallow /languages/404_en.htm
Disallow /research/participants/cofund/
Disallow /sport/404_en.htm
Disallow /taxation_customs/dds2/col/
Disallow /taxation_customs/dds2/ebti/
Disallow /taxation_customs/dds2/ecics/
Disallow /taxation_customs/dds2/taric/
Disallow /youth/404_en.htm
Disallow /food/archive/
Disallow /consumers/archive/
Disallow /transparencyregister/public/staticPage/displayStaticPage.do
Disallow /transparencyregister/public/consultation/search.do
Disallow /transparencyregister/public/consultation/reportControllerPager.do
Disallow /europeaid/companion/
Disallow /transparencyregister/
Disallow /transparencyinitiative/
Disallow /eurostat/tgm/
Disallow /clima/ets/
Disallow /clima/sites/registry/
Disallow /commission_2010-2014/katainen/
Disallow /creative-europe/404_en.htm
Disallow /culture/404_en.htm
Disallow /dgs/education_culture/404_en.htm
Disallow /eclas/
Disallow /education/404_en.htm
Disallow /youth/404_en.htm
Disallow /environment/ets/
Disallow /erasmus-plus/404_en.htm
Disallow /eurostat/SDMX/diss-web/rest/
Disallow /fisheries/fleet/
Disallow /languages/404_en.htm
Disallow /research/participants/cofund/
Disallow /sport/404_en.htm
Disallow /employment_social/anticipedia/xwiki/bin/attach/
Disallow /employment_social/anticipedia/xwiki/bin/cancel/
Disallow /employment_social/anticipedia/xwiki/bin/commentadd/
Disallow /employment_social/anticipedia/xwiki/bin/delattachment/
Disallow /employment_social/anticipedia/xwiki/bin/delete/
Disallow /employment_social/anticipedia/xwiki/bin/dot/
Disallow /employment_social/anticipedia/xwiki/bin/download/
Disallow /employment_social/anticipedia/xwiki/bin/downloadrev/
Disallow /employment_social/anticipedia/xwiki/bin/edit/
Disallow /employment_social/anticipedia/xwiki/bin/export/
Disallow /employment_social/anticipedia/xwiki/bin/inline/
Disallow /employment_social/anticipedia/xwiki/bin/lifeblog/
Disallow /employment_social/anticipedia/xwiki/bin/login/
Disallow /employment_social/anticipedia/xwiki/bin/loginerror/
Disallow /employment_social/anticipedia/xwiki/bin/logout/
Disallow /employment_social/anticipedia/xwiki/bin/objectremove/
Disallow /employment_social/anticipedia/xwiki/bin/pdf/
Disallow /employment_social/anticipedia/xwiki/bin/preview/
Disallow /employment_social/anticipedia/xwiki/bin/propadd/
Disallow /employment_social/anticipedia/xwiki/bin/propdelete/
Disallow /employment_social/anticipedia/xwiki/bin/propupdate/
Disallow /employment_social/anticipedia/xwiki/bin/register/
Disallow /employment_social/anticipedia/xwiki/bin/save/
Disallow /employment_social/anticipedia/xwiki/bin/skin/
Disallow /employment_social/anticipedia/xwiki/bin/status/
Disallow /employment_social/anticipedia/xwiki/bin/upload/
Disallow /employment_social/anticipedia/xwiki/bin/viewattachrev/
Disallow /employment_social/anticipedia/xwiki/bin/viewrev/
Disallow /employment_social/anticipedia/xwiki/bin/xmlrpc/
Disallow /taxation_customs/dds2/col/
Disallow /taxation_customs/dds2/ebti/
Disallow /taxation_customs/dds2/ecics/
Disallow /taxation_customs/dds2/taric/
Disallow /food/archive/
Disallow /consumers/archive/
Disallow /transparencyregister/public/staticPage/displayStaticPage.do
Disallow /transparencyregister/public/consultation/search.do
Disallow /transparencyregister/public/consultation/reportControllerPager.do
Disallow /transparencyregister/
Disallow /transparencyinitiative/
Disallow /europeaid/companion/
Disallow /europeaid/prag/
Allow /digital-single-market/
Disallow /digital-single-market/sites/
Disallow /digital-single-market/users/
Disallow /digital-single-market/events/cf/
Disallow /digital-single-market/contact*
Disallow /digital-single-market/tags/
Disallow /digital-single-market/news-redirect/
Disallow /digital-single-market/newsroom/
Disallow /digital-single-market/country/
Disallow /digital-single-market/taxonomy/
Disallow /digital-single-market/search/
Disallow /digital-single-market/group-libraries
Disallow /digital-single-market/files
Disallow /digital-single-market/en/sites/
Disallow /digital-single-market/en/users/
Disallow /digital-single-market/en/events/cf/
Disallow /digital-single-market/en/contact*
Disallow /digital-single-market/en/news-redirect/
Disallow /digital-single-market/en/newsroom/
Disallow /digital-single-market/en/country/
Disallow /digital-single-market/en/taxonomy/
Disallow /digital-single-market/en/search/
Disallow /digital-single-market/en/group-libraries
Disallow /digital-single-market/en/files
Disallow /newsroom/dae/
Allow /digital-agenda/
Disallow /digital-agenda/sites/
Disallow /digital-agenda/users/
Disallow /digital-agenda/events/cf/
Disallow /digital-agenda/contact*
Disallow /digital-agenda/tags/
Disallow /digital-agenda/news-redirect/
Disallow /digital-agenda/newsroom/
Disallow /digital-agenda/country/
Disallow /digital-agenda/taxonomy/
Disallow /digital-agenda/search/
Disallow /digital-agenda/group-libraries/
Disallow /newsroom/dae/
Disallow /eurostat/*?*p_p_id=estatsearchportlet_WAR_estatsearchportlet
Disallow /eurostat/*?*p_p_id=esssearchportlet_WAR_esssearchportlet
Disallow /eurostat/home/-/search/data-browser
Disallow /eurostat/group/*control_panel
Disallow /eurostat/*com_liferay_login_web_portlet_LoginPortlet
Disallow /eurostat/*doAsUserId
Disallow /eusurvey/publication
Disallow /eusurvey/files
Disallow /eusurvey/webservice
Disallow /eusurvey/resources
Disallow /health/sites/health/files/tobacco/docs/doi/
Disallow /pmo/contact/fr/staff/
Disallow /pmo/contact/en/staff/
Disallow /taxation_customs/tax-cfw-interactive-brochure
Disallow /taxation_customs/tax-cfw-interactive-brochure_en
Disallow /taxation_customs/tax-cfw-interactive-brochure-news
Disallow /taxation_customs/tax-cfw-interactive-brochure-news_en
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14885
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=7856
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14885*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=7856*
Disallow /cai/*
Disallow /eurostat/search
Disallow /eurostat/*/search/-/
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14964*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14944*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14907*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14896*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=14895*
Disallow /transparency/regexpert/index.cfm?do=groupDetail.groupDetailDoc&id=15010*
Disallow /eusurvey/printcontribution
Disallow /eusurvey/printcontribution/?*
Disallow /eusurvey/printcontribution/?code=*
Disallow /social/social-security-directory/cai/
Disallow /taxation_customs/business/vat/vat-e-commerce/modernising-vat-cross-border-e-commerce_en
Disallow /taxation_customs/dds2/arc/
Disallow /taxation_customs/dds2/ecics/
Disallow /taxation_customs/dds2/ebti/
Disallow /taxation_customs/dds2/eos/
Disallow /taxation_customs/dds2/rd/
Disallow /taxation_customs/dds2/seed/
Disallow /taxation_customs/dds2/surv/
Disallow /taxation_customs/dds2/susp/
Disallow /taxation_customs/dds2/taric/
Disallow /taxation_customs/dds2/tra/
Disallow /taxation_customs/dds2/ecs/
Disallow /taxation_customs/dds2/transit/
Disallow /taxation_customs/dds2/export/
Disallow /eures/main.jsp
Back to top

Comments

  • EC.EUROPA.EU ROBOTS.TXT
  • BAIDUSPIDER
  • Connect 22/02/2016 [IM0014473437]
  • TWITTERBOT
  • Connect
  • ALL AGENTS
  • Clima, education, eurostat and others
  • Employment
  • Taxud
  • Connect
  • former digital agenda
  • estat [IM0014642760 - IM0014779417]
  • estat 22/06/2020 [IM0019106804]
  • estat 25/01/2024 [INC00817544]
  • eusurvey IM0015280464
  • health 18/05/2017 [IM0015562498]
  • DIGIT 06/09/2018 [IM0016965874]
  • requested by Edson Ramos (TAXUD) on 03/12/2018 [IM0017249768]
  • requested by Edson Ramos (TAXUD) on 06/03/2019 [IM0017321783]
  • cai IM0017839861
  • requested by FRIPPIAT Jean-Michel (ESTAT-EXT) on 18/07/2019 IM0017839861
  • requested by Edson Ramos (TAXUD) on 12/08/2019 [IM0017861661]
  • requested by DIGIT on 05/08/2019 [IM0019249777]
  • requested by EMPL on 13/05/2022 [IM0021694682]
  • requested by EMPL on 13/05/2022 [IM0021869713]
  • SMT Ticket IM0022076229 [IM0021567470]
  • requested by EMPL on 11/01/2023 [IM0022626137]
Back to top