corre40minutos.com
robots.txt

Robots Exclusion Standard data for corre40minutos.com

Resource Scan

Scan Details

Site Domain corre40minutos.com
Base Domain corre40minutos.com
Scan Status Ok
Last Scan2025-03-30T17:27:31+00:00
Next Scan 2025-04-06T17:27:31+00:00

Last Scan

Scanned2025-03-30T17:27:31+00:00
URL https://corre40minutos.com/robots.txt
Redirect https://www.corre40minutos.com/robots.txt
Redirect Domain www.corre40minutos.com
Redirect Base corre40minutos.com
Domain IPs 104.21.57.225, 172.67.193.21, 2606:4700:3033::6815:39e1, 2606:4700:3033::ac43:c115
Redirect IPs 104.21.57.225, 172.67.193.21, 2606:4700:3033::6815:39e1, 2606:4700:3033::ac43:c115
Response IP 172.67.193.21
Found Yes
Hash adbb575b5646d909bfb5f8690c7c100524940f8baa0051f3ca06e29740c8c006
SimHash e229d945e9b3

Groups

*

Rule Path
Disallow /app/
Disallow /bin/
Disallow /config/
Disallow /src/
Disallow /vendor/
Disallow /var/
Disallow /public/bundles/
Disallow /_profiler/
Disallow /_wdt/

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Disallow access to Symfony development and profiler routes
  • Sitemap