covestro.com
robots.txt

Robots Exclusion Standard data for covestro.com

Resource Scan

Scan Details

Site Domain covestro.com
Base Domain covestro.com
Scan Status Ok
Last Scan2024-11-07T04:22:59+00:00
Next Scan 2024-11-21T04:22:59+00:00

Last Scan

Scanned2024-11-07T04:22:59+00:00
URL https://covestro.com/robots.txt
Redirect https://www.covestro.com/robots.txt
Redirect Domain www.covestro.com
Redirect Base covestro.com
Domain IPs 20.50.2.72
Redirect IPs 13.107.246.59, 2620:1ec:bdf::59
Response IP 13.107.246.59
Found Yes
Hash f7a856274d98b44492b16b8490d024bb890410940abda7860f86d0cc3ed93cc0
SimHash aac20ac1d042

Groups

sentibot

Rule Path
Disallow /

*

Rule Path
Disallow /tagfeed/*
Disallow /?q=*
Disallow /?h=*
Disallow /press/*
Disallow /blogs/*
Disallow /investors/*
Disallow /search?query=*
Disallow /~/link.aspx?_id=*
Disallow /*.css$
Disallow /*.js$

Other Records

Field Value
sitemap https://www.covestro.com/sitemapindex.xml

Comments

  • robots.txt for Sitemap: https://www.covestro.com/sitemapindex.xml
  • Sitemap

Warnings

  • 2 invalid lines.