Log In Sign Up

digital-strategy.ec.europa.eu
robots.txt

Robots Exclusion Standard data for digital-strategy.ec.europa.eu

Resource Scan

Scan Details

Site Domain digital-strategy.ec.europa.eu
Base Domain europa.eu
Scan Status Ok
Last Scan2024-04-21T06:20:00+00:00
Next Scan 2024-05-21T06:20:00+00:00

Last Scan

Scanned2024-04-21T06:20:00+00:00
URL https://digital-strategy.ec.europa.eu/robots.txt
Domain IPs 2600:9000:25f0:7200:c:ecf4:4a00:93a1, 2600:9000:25f0:7c00:c:ecf4:4a00:93a1, 2600:9000:25f0:ac00:c:ecf4:4a00:93a1, 2600:9000:25f0:b800:c:ecf4:4a00:93a1, 2600:9000:25f0:c400:c:ecf4:4a00:93a1, 2600:9000:25f0:ce00:c:ecf4:4a00:93a1, 2600:9000:25f0:e200:c:ecf4:4a00:93a1, 2600:9000:25f0:f800:c:ecf4:4a00:93a1, 3.163.24.106, 3.163.24.129, 3.163.24.2, 3.163.24.85
Response IP 18.165.171.74
Found Yes
Hash 0d0cb8fb93ddc21fceaa21b1d844328eab87c74014ba6350cf8d4ab57925d784
SimHash 5dc7f95f4550

Groups

*

Rule Path
Disallow /newsletters/*
Disallow /themes/*
Disallow /news-redirect/*
Disallow /profiles/*
Disallow /sites/*
Disallow /core/*
Disallow /admin/*
Disallow /events?
Disallow /related-content?
Disallow /news?
Disallow /consultations?
Disallow /funding?
Disallow /library?
Disallow /search?s=*
Disallow /taxonomy/*
Disallow /en/newsletters/*
Disallow /en/themes/*
Disallow /en/news-redirect/*
Disallow /en/profiles/*
Disallow /en/sites/*
Disallow /en/core/*
Disallow /en/admin/*
Disallow /en/events?
Disallow /en/related-content?
Disallow /en/news?
Disallow /en/consultations?
Disallow /en/funding?
Disallow /en/library?
Disallow /en/search?s=*
Disallow /en/taxonomy/*
Disallow /printable/pdf
Disallow /node/*

*

Rule Path
Disallow /core/*.css$
Disallow /core/*.css?
Disallow /core/*.js$
Disallow /core/*.js?
Disallow /core/*.gif
Disallow /core/*.jpg
Disallow /core/*.jpeg
Disallow /core/*.png
Disallow /core/*.svg
Disallow /profiles/*.css$
Disallow /profiles/*.css?
Disallow /profiles/*.js$
Disallow /profiles/*.js?
Disallow /profiles/*.gif
Disallow /profiles/*.jpg
Disallow /profiles/*.jpeg
Disallow /profiles/*.png
Disallow /profiles/*.svg
Disallow /*pdf$
Disallow /*.pdf$
Disallow /*?

*

Rule Path
Disallow /README.txt
Disallow /web.config

*

Rule Path
Disallow /comment/*
Disallow /comment/reply/
Disallow /filter/
Disallow /filter/tips
Disallow /node/add/
Disallow /user/*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/logout/
Disallow en/comment/*
Disallow en/comment/reply/
Disallow en/filter/
Disallow en/filter/tips
Disallow en/user/
Disallow en/user/register/
Disallow en/user/password/
Disallow en/user/login/
Disallow en/user/logout/

*

Rule Path
Disallow /index.php/
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password/
Disallow /index.php/user/register/
Disallow /index.php/user/login/
Disallow /index.php/user/logout/
Back to top

Comments

  • This is version 3 from 25 May 2021, uploaded in production for testing on 19 July 2021
  • test comment by Alexis this 6 August at 10:04
  • test Irina 6 August at 11:57
  • update 10 September 08:48 Irina
  • update 13 April Irina
  • update 28 July Irina
  • update august 2022Irina
  • update March 2023 (multilingualism)
  • update February 2024 (Irina)
  • CSS, JS, Images, Pdf
  • General
  • Files
  • Paths (no clean URLs)
Back to top