euronav.eu
robots.txt

Robots Exclusion Standard data for euronav.eu

Resource Scan

Scan Details

Site Domain euronav.eu
Base Domain euronav.eu
Scan Status Ok
Last Scan2024-04-25T07:51:21+00:00
Next Scan 2024-05-25T07:51:21+00:00

Last Scan

Scanned2024-04-25T07:51:21+00:00
URL http://euronav.eu/robots.txt
Redirect https://www.euronav.com/robots.txt
Redirect Domain www.euronav.com
Redirect Base euronav.com
Domain IPs 212.123.6.254
Redirect IPs 185.162.29.186
Response IP 185.162.29.186
Found Yes
Hash e8334243d38aa0438d89a84bfd83544fa5cad7bdb458cc413e935ceaee31d8d0
SimHash 1b0e9967cff0

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /bin/
Disallow /config/
Disallow /css/
Disallow /data/
Disallow /install/
Disallow /masterpages/
Disallow /python/
Disallow /scripts/
Disallow /umbraco/
Disallow /umbraco_client/
Disallow /usercontrols/
Disallow /xslt/
Disallow /crisis/
Disallow /statement/
Disallow /statement/
Disallow /press-information/
Disallow /coverage/
Disallow /crisis/
Disallow /statement/
Disallow /press-information/
Disallow /coverage/
Disallow /crisis-contact-information/
Disallow /investis-testing/
Disallow /crisis-center/
Disallow /en/crisis-center/
Disallow /nl/crisis-center/
Disallow /crisis/
Disallow /crisis/current-information
Disallow /crisis/crisis-contact
Disallow /Media/
Disallow /Files/
Disallow /eea/

Other Records

Field Value
sitemap http://www.euronav.com/en/sitemap-xml

Comments

  • robots.txt for Umbraco
  • Add paths to this txt file to exclude indexing from search engines and other robots
  • No guarantee that they will not index but it is a start
  • INDEX WHAT IS ALLOWED