ensembl.org
robots.txt

Robots Exclusion Standard data for ensembl.org

Resource Scan

Scan Details

Site Domain ensembl.org
Base Domain ensembl.org
Scan Status Ok
Last Scan2024-11-12T02:37:00+00:00
Next Scan 2024-11-19T02:37:00+00:00

Last Scan

Scanned2024-11-12T02:37:00+00:00
URL https://ensembl.org/robots.txt
Redirect https://www.ensembl.org/robots.txt
Redirect Domain www.ensembl.org
Redirect Base ensembl.org
Domain IPs 193.62.193.83
Redirect IPs 193.62.193.83
Response IP 193.62.193.83
Found Yes
Hash cbde7a352641a2519be18f24344b59536892424e45a09d0e8d64206872adc08d
SimHash 4cee06e34513

Groups

*

Rule Path
Disallow /Multi/
Disallow /biomart/
Disallow /Account/
Disallow */DataExport/
Disallow */ImageExport/
Disallow */Ajax/
Disallow */Config/
Disallow */Export/
Disallow */Experiment/
Disallow */Experiment*
Disallow */Family/
Disallow */ImageExport
Disallow */Location/
Disallow */LRG/
Disallow */Marker/
Disallow */Phenotype/
Disallow */Regulation/
Disallow */Search/
Disallow */Share
Disallow */StructuralVariation/
Disallow */UserConfig/
Disallow */UserData/
Disallow */Variation/
Disallow */*view
Disallow /*/Psychic
Disallow */Gene/A*
Disallow */Transcript/A*
Disallow */Gene/B*
Disallow */Transcript/B*
Disallow */Gene/C*
Disallow */Transcript/C*
Disallow */Gene/D*
Disallow */Transcript/D*
Disallow */Gene/E*
Disallow */Transcript/E*
Disallow */Gene/F*
Disallow */Transcript/F*
Disallow */Gene/G*
Disallow */Transcript/G*
Disallow */Gene/H*
Disallow */Transcript/H*
Disallow */Gene/I*
Disallow */Transcript/I*
Disallow */Gene/J*
Disallow */Transcript/J*
Disallow */Gene/K*
Disallow */Transcript/K*
Disallow */Gene/L*
Disallow */Transcript/L*
Disallow */Gene/M*
Disallow */Transcript/M*
Disallow */Gene/N*
Disallow */Transcript/N*
Disallow */Gene/O*
Disallow */Transcript/O*
Disallow */Gene/P*
Disallow */Transcript/P*
Disallow */Gene/Q*
Disallow */Transcript/Q*
Disallow */Gene/R*
Disallow */Transcript/R*
Disallow */Gene/T*
Disallow */Transcript/T*
Disallow */Gene/U*
Disallow */Transcript/U*
Disallow */Gene/V*
Disallow */Transcript/V*
Disallow */Gene/W*
Disallow */Transcript/W*
Disallow */Gene/X*
Disallow */Transcript/X*
Disallow */Gene/Y*
Disallow */Transcript/Y*
Disallow */Gene/Z*
Disallow */Transcript/Z*
Disallow */Gene/a*
Disallow */Transcript/a*
Disallow */Gene/b*
Disallow */Transcript/b*
Disallow */Gene/c*
Disallow */Transcript/c*
Disallow */Gene/d*
Disallow */Transcript/d*
Disallow */Gene/e*
Disallow */Transcript/e*
Disallow */Gene/f*
Disallow */Transcript/f*
Disallow */Gene/g*
Disallow */Transcript/g*
Disallow */Gene/h*
Disallow */Transcript/h*
Disallow */Gene/i*
Disallow */Transcript/i*
Disallow */Gene/j*
Disallow */Transcript/j*
Disallow */Gene/k*
Disallow */Transcript/k*
Disallow */Gene/l*
Disallow */Transcript/l*
Disallow */Gene/m*
Disallow */Transcript/m*
Disallow */Gene/n*
Disallow */Transcript/n*
Disallow */Gene/o*
Disallow */Transcript/o*
Disallow */Gene/p*
Disallow */Transcript/p*
Disallow */Gene/q*
Disallow */Transcript/q*
Disallow */Gene/r*
Disallow */Transcript/r*
Disallow */Gene/t*
Disallow */Transcript/t*
Disallow */Gene/u*
Disallow */Transcript/u*
Disallow */Gene/v*
Disallow */Transcript/v*
Disallow */Gene/w*
Disallow */Transcript/w*
Disallow */Gene/x*
Disallow */Transcript/x*
Disallow */Gene/y*
Disallow */Transcript/y*
Disallow */Gene/z*
Disallow */Transcript/z*
Disallow */Gene/Species*
Disallow */Transcript/Species*
Disallow */Gene/Secondary*
Disallow */Transcript/Secondary*
Disallow */Gene/Similarity*
Disallow */Transcript/Similarity*
Disallow */Gene/Supporting*
Disallow */Transcript/Supporting*
Disallow */Gene/Sequence*
Disallow */Transcript/Sequence*
Disallow */Gene/Structural*
Disallow */Transcript/Structural*
Disallow */Gene/Splice*
Disallow */Transcript/Splice*
Disallow /Gene/Summary
Disallow /Transcript/Summary
Disallow /info/docs/Doxygen

w3c-checklink

Rule Path
Allow /info

blekkobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.ensembl.org/sitemaps/index.xml