Log In Sign Up

minsait.com
robots.txt

Robots Exclusion Standard data for minsait.com

Resource Scan

Scan Details

Site Domain minsait.com
Base Domain minsait.com
Scan Status Ok
Last Scan2026-01-26T21:52:12+00:00
Next Scan 2026-02-25T21:52:12+00:00

Last Scan

Scanned2026-01-26T21:52:12+00:00
URL https://minsait.com/robots.txt
Redirect https://www.minsait.com/robots.txt
Redirect Domain www.minsait.com
Redirect Base minsait.com
Domain IPs 66.22.36.146
Redirect IPs 13.35.202.115, 13.35.202.125, 13.35.202.40, 13.35.202.42, 2600:9000:2078:1800:3:2d58:5e40:93a1, 2600:9000:2078:2200:3:2d58:5e40:93a1, 2600:9000:2078:2400:3:2d58:5e40:93a1, 2600:9000:2078:4000:3:2d58:5e40:93a1, 2600:9000:2078:6600:3:2d58:5e40:93a1, 2600:9000:2078:ee00:3:2d58:5e40:93a1, 2600:9000:2078:f400:3:2d58:5e40:93a1, 2600:9000:2078:fa00:3:2d58:5e40:93a1
Response IP 13.35.202.40
Found Yes
Hash 34982ce551ea8ecd72ad9a03d22c283e191914ea3a64d68ba47538d2dac38f6e
SimHash 60048c8a97d9

Groups

*

Rule Path
Disallow /download/
Disallow /node/
Disallow /autodiscover.xml
Disallow /mail/
Disallow /errorpage404
Disallow /*/accionistas/accionistas/
Disallow /*/revista-accionista/accionistas/accionistas/
Disallow /pt-br/
Disallow /api/
Disallow /preview/

bytespider

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

chatgpt-user

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

googlebot
bingbot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.indragroup.com/sitemap/general.xml
sitemap https://www.indragroup.com/sitemap/noticias.xml
sitemap https://defence.indragroup.com/sitemap/general.xml
sitemap https://defence.indragroup.com/sitemap/noticias.xml
sitemap https://airtraffic.indragroup.com/sitemap/general.xml
sitemap https://airtraffic.indragroup.com/sitemap/noticias.xml
sitemap https://mobility.indragroup.com/sitemap/general.xml
sitemap https://mobility.indragroup.com/sitemap/noticias.xml
sitemap https://www.minsait.com/sitemap/general.xml
sitemap https://www.minsait.com/sitemap/noticias.xml
sitemap https://www.indragroup-usa.com/sitemap/general.xml
sitemap https://www.indragroup-usa.com/sitemap/noticias.xml
sitemap https://www.indramind.com/sitemap/general.xml
sitemap https://www.indramind.com/sitemap/noticias.xml
Back to top

Comments

  • Block malformed URL patterns causing 404 floods
  • Protect API and preview endpoints
  • Block aggressive/problematic bots
  • Allow legitimate crawlers
Back to top