adani.com
robots.txt

Robots Exclusion Standard data for adani.com

Resource Scan

Scan Details

Site Domain adani.com
Base Domain adani.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-09T07:43:29+00:00
Next Scan 2025-12-08T07:43:29+00:00

Last Successful Scan

Scanned2025-04-20T06:51:32+00:00
URL https://adani.com/robots.txt
Redirect https://www.adani.com/robots.txt
Redirect Domain www.adani.com
Redirect Base adani.com
Domain IPs 23.58.144.136, 23.58.144.142, 2600:1413:3800:56::172d:cf47, 2600:1413:3800:56::172d:cf5b
Redirect IPs 23.58.144.136, 23.58.144.142, 2600:1413:5000:34::173d:ca69, 2600:1413:5000:34::173d:ca6c
Response IP 23.215.7.26
Found Yes
Hash 62d217f168c599048d4f87073014b5d96aba6e628117c846ebe37e4bda20352d
SimHash 38451a314636

Groups

*
google

Rule Path
Allow /

bing

Rule Path
Allow /

yahoo

Rule Path
Allow /

googlebot

Rule Path
Allow *.js
Allow *.css
Allow *.png
Allow *.jpg
Disallow /%21ut/
Disallow /iehs/
Disallow /home/
Disallow /wps/

Other Records

Field Value
sitemap https://www.adani.com/sitemap.xml

Comments

  • Do not crawl