Log In Sign Up

indragroup.com
robots.txt

Robots Exclusion Standard data for indragroup.com

Resource Scan

Scan Details

Site Domain indragroup.com
Base Domain indragroup.com
Scan Status Ok
Last Scan2026-02-03T22:56:43+00:00
Next Scan 2026-03-05T22:56:43+00:00

Last Scan

Scanned2026-02-03T22:56:43+00:00
URL https://indragroup.com/robots.txt
Redirect https://www.indragroup.com/robots.txt
Redirect Domain www.indragroup.com
Redirect Base indragroup.com
Domain IPs 167.86.50.54
Redirect IPs 2600:9000:2153:3800:11:f21a:7700:93a1, 2600:9000:2153:400:11:f21a:7700:93a1, 2600:9000:2153:4800:11:f21a:7700:93a1, 2600:9000:2153:5c00:11:f21a:7700:93a1, 2600:9000:2153:600:11:f21a:7700:93a1, 2600:9000:2153:7e00:11:f21a:7700:93a1, 2600:9000:2153:9800:11:f21a:7700:93a1, 2600:9000:2153:e200:11:f21a:7700:93a1, 65.8.76.11, 65.8.76.128, 65.8.76.17, 65.8.76.34
Response IP 65.8.76.34
Found Yes
Hash 34982ce551ea8ecd72ad9a03d22c283e191914ea3a64d68ba47538d2dac38f6e
SimHash 60048c8a97d9

Groups

*

Rule Path
Disallow /download/
Disallow /node/
Disallow /autodiscover.xml
Disallow /mail/
Disallow /errorpage404
Disallow /*/accionistas/accionistas/
Disallow /*/revista-accionista/accionistas/accionistas/
Disallow /pt-br/
Disallow /api/
Disallow /preview/

bytespider

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot
bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.indragroup.com/sitemap/general.xml
sitemap https://www.indragroup.com/sitemap/noticias.xml
sitemap https://defence.indragroup.com/sitemap/general.xml
sitemap https://defence.indragroup.com/sitemap/noticias.xml
sitemap https://airtraffic.indragroup.com/sitemap/general.xml
sitemap https://airtraffic.indragroup.com/sitemap/noticias.xml
sitemap https://mobility.indragroup.com/sitemap/general.xml
sitemap https://mobility.indragroup.com/sitemap/noticias.xml
sitemap https://www.minsait.com/sitemap/general.xml
sitemap https://www.minsait.com/sitemap/noticias.xml
sitemap https://www.indragroup-usa.com/sitemap/general.xml
sitemap https://www.indragroup-usa.com/sitemap/noticias.xml
sitemap https://www.indramind.com/sitemap/general.xml
sitemap https://www.indramind.com/sitemap/noticias.xml
Back to top

Comments

  • Block malformed URL patterns causing 404 floods
  • Protect API and preview endpoints
  • Block aggressive/problematic bots
  • Allow legitimate crawlers
Back to top