indegene.com
robots.txt

Robots Exclusion Standard data for indegene.com

Resource Scan

Scan Details

Site Domain indegene.com
Base Domain indegene.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-13T17:38:29+00:00
Next Scan 2024-11-12T17:38:29+00:00

Last Successful Scan

Scanned2024-08-22T13:35:02+00:00
URL https://indegene.com/robots.txt
Redirect https://www.indegene.com/robots.txt
Redirect Domain www.indegene.com
Redirect Base indegene.com
Domain IPs 108.156.133.102, 108.156.133.114, 108.156.133.17, 108.156.133.74
Redirect IPs 108.156.133.102, 108.156.133.114, 108.156.133.17, 108.156.133.74, 2600:9000:2135:1400:0:4cfb:9c00:93a1, 2600:9000:2135:1c00:0:4cfb:9c00:93a1, 2600:9000:2135:4c00:0:4cfb:9c00:93a1, 2600:9000:2135:9800:0:4cfb:9c00:93a1, 2600:9000:2135:9c00:0:4cfb:9c00:93a1, 2600:9000:2135:a000:0:4cfb:9c00:93a1, 2600:9000:2135:c400:0:4cfb:9c00:93a1, 2600:9000:2135:d000:0:4cfb:9c00:93a1
Response IP 108.156.133.17
Found Yes
Hash 463eab6fdd5f039c4fd865c90f716282c400f21a8a644c48dcf73f673462faf9
SimHash 070ece50e732

Groups

*

Rule Path
Allow /
Disallow /api/

Other Records

Field Value
crawl-delay 0

Other Records

Field Value
sitemap https://www.indegene.com/sitemap.xml

Comments

  • robots.txt
  • CSS, JS, Images