Log In Sign Up

mining.komatsu
robots.txt

Robots Exclusion Standard data for mining.komatsu

Resource Scan

Scan Details

Site Domain mining.komatsu
Base Domain mining.komatsu
Scan Status Ok
Last Scan2025-10-21T07:01:31+00:00
Next Scan 2025-11-20T07:01:31+00:00

Last Scan

Scanned2025-10-21T07:01:31+00:00
URL https://mining.komatsu/robots.txt
Redirect https://www.komatsu.com/robots.txt
Redirect Domain www.komatsu.com
Redirect Base komatsu.com
Domain IPs 13.107.246.40
Redirect IPs 13.107.226.59, 13.107.253.59, 2620:1ec:29:1::59, 2620:1ec:48:1::59
Response IP 13.107.213.59
Found Yes
Hash 9c900abad9b851055137c288cf05518145ff84eac92af8162ef98a95f232cb1e
SimHash 8110db738300

Groups

elastic-crawler (8.17.2)

Rule Path
Allow /

*

Rule Path
Disallow /search/
Disallow /errors/
Back to top

Other Records

Field Value
sitemap https://www.komatsu.com/na.sitemap.fr-ca-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.en-in-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.zh-cn-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.en-au-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.en-gb-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.pl-pl-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.en-za-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.ru-ru-sitemap.xml
sitemap https://www.komatsu.com/latam.sitemap.pt-br-sitemap.xml
sitemap https://www.komatsu.com/latam.sitemap.es-mx-sitemap.xml
sitemap https://www.komatsu.com/content/dam/komatsu/seo/elasticsearch/assets-index.xml
sitemap https://www.komatsu.com/na.sitemap.fr-ca-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.fr-ca-products-parts-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-engine-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-fluids-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-work-equipment-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-chemicals-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-chassis-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-attachments-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-hose-fittings-adapters-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-power-module-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-power-train-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-hydraulics-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-cab-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-filters-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-electrical-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-undercarriage-sitemap.xml
sitemap https://www.komatsu.com/na.sitemap.en-us-products-parts-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.en-in-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.zh-cn-sitemap.xml
sitemap https://www.komatsu.com/apac.sitemap.en-au-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.en-gb-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.pl-pl-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.en-za-sitemap.xml
sitemap https://www.komatsu.com/emea.sitemap.ru-ru-sitemap.xml
sitemap https://www.komatsu.com/latam.sitemap.pt-br-sitemap.xml
sitemap https://www.komatsu.com/latam.sitemap.es-mx-sitemap.xml
Back to top