dow.com
robots.txt
Robots Exclusion Standard data for dow.com
Resource Scan
Scan Details
Site Domain | dow.com |
Base Domain | dow.com |
Scan Status | Ok |
Last Scan | 2024-11-03T23:31:08+00:00 |
Next Scan | 2024-11-17T23:31:08+00:00 |
Last Scan
Scanned | 2024-11-03T23:31:08+00:00 |
URL | https://dow.com/robots.txt |
Redirect | https://www.dow.com/robots.txt |
Redirect Domain | www.dow.com |
Redirect Base | dow.com |
Domain IPs | 23.51.132.36, 2600:1401:4000:282::2417, 2600:1401:4000:291::2417 |
Redirect IPs | 125.252.231.238, 2600:1413:b000:38d::2417, 2600:1413:b000:39b::2417 |
Response IP | 125.252.231.238 |
Found | Yes |
Hash | 68a908e6402234c911c5c3299a49777c26cfa9d0672a3aeccb6a29093a8b5b15 |
SimHash | aa154165b691 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/document-viewer.html?*contentType=salesSpec* |
Disallow | /*/.search.servlet.json |
Disallow | /en-us/search |
Disallow | /content/dc/en-us/search |
Disallow | /ja-jp/search |
Disallow | /content/dc/ja-jp/search |
Disallow | /zh-cn/search |
Disallow | /content/dc/zh-cn/search |
Disallow | /pt-br/search |
Disallow | /content/dc/pt-br/search |
Disallow | /es-es/search |
Disallow | /content/dc/es-es/search |
Disallow | /ko-kr/search |
Disallow | /content/dc/ko-kr/search |
Other Records
Field | Value |
---|---|
sitemap | https://www.dow.com/en-us/sitemap.xml |
sitemap | https://www.dow.com/zh-cn/sitemap.xml |
sitemap | https://www.dow.com/ja-jp/sitemap.xml |
sitemap | https://www.dow.com/pt-br/sitemap.xml |
sitemap | https://www.dow.com/es-es/sitemap.xml |
sitemap | https://www.dow.com/ko-kr/sitemap.xml |