ferrovial.com
robots.txt

Robots Exclusion Standard data for ferrovial.com

Resource Scan

Scan Details

Site Domain ferrovial.com
Base Domain ferrovial.com
Scan Status Ok
Last Scan2024-04-30T05:54:31+00:00
Next Scan 2024-05-30T05:54:31+00:00

Last Scan

Scanned2024-04-30T05:54:31+00:00
URL https://ferrovial.com/robots.txt
Redirect https://www.ferrovial.com//robots.txt
Redirect Domain www.ferrovial.com
Redirect Base ferrovial.com
Domain IPs 204.246.191.110, 204.246.191.121, 204.246.191.28, 204.246.191.92
Redirect IPs 18.155.202.30, 18.155.202.33, 18.155.202.71, 18.155.202.88
Response IP 18.165.171.90
Found Yes
Hash f5968df0d7b143b5671cc9dc6eaa3269e9d35a68cac07584a9dd855989dd42ae
SimHash 2815cc41c510

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*/ical/*
Disallow /*/*/*/*/*/*/?action*
Disallow /*/*/*/*/*/?action*
Disallow /*/*/*/*/?action*
Disallow /*/*/*/?action*
Disallow /*/*/?action*
Disallow /*/?action*
Disallow /n1/*
Disallow /*/awards/*
Disallow /*/premios/*

elastic-crawler (8.11.1) elastic cloud (https://www.elastic.co/guide/en/cloud/current/ec-get-help.html; 3c7856d2d6d4436db7c9bda423267108)

Rule Path
Allow /*/awards/*
Allow /*/premios/*

Other Records

Field Value
sitemap https://www.ferrovial.com/sitemap_index.xml