Log In Sign Up

indracompany.com
robots.txt

Robots Exclusion Standard data for indracompany.com

Resource Scan

Scan Details

Site Domain indracompany.com
Base Domain indracompany.com
Scan Status Ok
Last Scan2026-01-25T05:05:14+00:00
Next Scan 2026-02-24T05:05:14+00:00

Last Scan

Scanned2026-01-25T05:05:14+00:00
URL https://indracompany.com/robots.txt
Redirect https://www.indragroup.com/robots.txt
Redirect Domain www.indragroup.com
Redirect Base indragroup.com
Domain IPs 94.126.240.49
Redirect IPs 2600:9000:2153:1a00:11:f21a:7700:93a1, 2600:9000:2153:200:11:f21a:7700:93a1, 2600:9000:2153:6800:11:f21a:7700:93a1, 2600:9000:2153:6c00:11:f21a:7700:93a1, 2600:9000:2153:9600:11:f21a:7700:93a1, 2600:9000:2153:aa00:11:f21a:7700:93a1, 2600:9000:2153:d000:11:f21a:7700:93a1, 2600:9000:2153:f000:11:f21a:7700:93a1, 65.8.76.11, 65.8.76.128, 65.8.76.17, 65.8.76.34
Response IP 65.8.76.11
Found Yes
Hash 34982ce551ea8ecd72ad9a03d22c283e191914ea3a64d68ba47538d2dac38f6e
SimHash 60048c8a97d9

Groups

*

Rule Path
Disallow /download/
Disallow /node/
Disallow /autodiscover.xml
Disallow /mail/
Disallow /errorpage404
Disallow /*/accionistas/accionistas/
Disallow /*/revista-accionista/accionistas/accionistas/
Disallow /pt-br/
Disallow /api/
Disallow /preview/

bytespider

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot
bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.indragroup.com/sitemap/general.xml
sitemap https://www.indragroup.com/sitemap/noticias.xml
sitemap https://defence.indragroup.com/sitemap/general.xml
sitemap https://defence.indragroup.com/sitemap/noticias.xml
sitemap https://airtraffic.indragroup.com/sitemap/general.xml
sitemap https://airtraffic.indragroup.com/sitemap/noticias.xml
sitemap https://mobility.indragroup.com/sitemap/general.xml
sitemap https://mobility.indragroup.com/sitemap/noticias.xml
sitemap https://www.minsait.com/sitemap/general.xml
sitemap https://www.minsait.com/sitemap/noticias.xml
sitemap https://www.indragroup-usa.com/sitemap/general.xml
sitemap https://www.indragroup-usa.com/sitemap/noticias.xml
sitemap https://www.indramind.com/sitemap/general.xml
sitemap https://www.indramind.com/sitemap/noticias.xml
Back to top

Comments

  • Block malformed URL patterns causing 404 floods
  • Protect API and preview endpoints
  • Block aggressive/problematic bots
  • Allow legitimate crawlers
Back to top