crigenetics.com
robots.txt

Robots Exclusion Standard data for crigenetics.com

Resource Scan

Scan Details

Site Domain crigenetics.com
Base Domain crigenetics.com
Scan Status Ok
Last Scan2024-11-21T07:21:05+00:00
Next Scan 2024-12-05T07:21:05+00:00

Last Scan

Scanned2024-11-21T07:21:05+00:00
URL https://crigenetics.com/robots.txt
Redirect https://www.crigenetics.com/robots.txt
Redirect Domain www.crigenetics.com
Redirect Base crigenetics.com
Domain IPs 107.20.177.255, 35.172.168.59
Redirect IPs 199.60.103.2, 199.60.103.254, 2606:2c40::c73c:6702, 2606:2c40::c73c:67fe
Response IP 199.60.103.254
Found Yes
Hash e0030d05f020c80ab0fb4c4e0d566e494cb3c42204a9369992723bc085aec9e8
SimHash 2a268c440efa

Groups

*

Rule Path
Disallow /sample-*
Disallow /blog/sample-*
Disallow /thank_you_page
Disallow /consent
Disallow /indexyou
Disallow /blog/tag/health
Disallow /orderftc-jun19-ctr
Disallow /blog/tag/israel
Disallow /health-fb-0
Disallow /fb/vsl-wayne
Disallow /blog/tag/neanderthals
Disallow /blog/mendelian-genetics
Disallow /health-test-2
Disallow /index-july16-var
Disallow /ancestry-oct26-ctr
Disallow /orderftc-archived-nov19
Disallow /ancestry-oct26-var
Disallow /indexg-july8-ctr
Disallow /blog/tag/austria
Disallow /blog/tag/alzheimers
Disallow /blog/tag/transcription
Disallow /blog/tag/news
Disallow /index-nov15-var
Disallow /blog/social-connectedness
Disallow /blog/tag/ashkenazi
Disallow /index-archived-nov29
Disallow /blog/tag/allergies
Disallow /blog/tag/mtdna
Disallow /blog/vestigial-organs
Disallow /blog/tag/german
Disallow /blog/tag/jewish
Disallow /blog/tag/hair
Disallow /blog/tag/education
Disallow /blog/tag/native-american
Disallow /blog/tag/genghis-khan
Disallow /blog/tag/polish-genes
Disallow /tbla/ancestry-archived-jun29
Disallow /tbla/wayne-new-blog
Disallow /ancestry?ucacid=2105172261.519703
Disallow /testblog/author/ryan-freeman
Disallow /paternity/first-time-customer
Disallow /blog/author/sam-bollen
Disallow /portal-cyber-monday-2022
Disallow /blog/tag/dna-testing
Disallow /blog/tag/covid-19
Disallow /fb/ancestry/independence-day-sale
Disallow /fb/ancestry/orderftcfb40-july7-var
Disallow /blog/tag/peas-on-earth
Disallow /fb/ancestry/orderftcfb40-july7-ctr
Disallow /blog/tag/health/page/2
Disallow /testblog/the-language-of-dna
Disallow /tbla/wayne-new-blog-apr5-var
Disallow /archived/mothers-day-sale-cws-2021
Disallow /tbla/new-dna-test-method-blog
Disallow /ancestry?fbp=fb.1.1661212800267.1269040533
Disallow /ancestry?fbp=fb.1.1660867200279.530740933
Disallow /ancestry?fbp=fb.1.1661385600288.719784407
Disallow /fb/100x-ancestry-order-page-w
Disallow /indexg-july8-ctr?wtime=%7Bseek_to_second_number%7D
Disallow /testblog/tag/ancestry
Disallow /blog/author/andr%C3%A9-la-crout-catherine-waalkes
Disallow /health?fbp=fb.1.1680991200238.1958219242
Disallow /ancestry?fbp=fb.1.1678939200293.1425989515
Disallow /health?fbp=fb.1.1678176000244.702029895
Disallow /health?fbp=fb.1.1679835600301.1663080082
Disallow /ancestry?fbp=fb.1.1678698000183.83399123
Disallow /ancestry?fbp=fb.1.1679230800346.1913670822
Disallow /ancestry?fbp=fb.1.1678388400212.1958219242
Disallow /health?fbp=fb.1.1677985200244.83399123
Disallow /ancestry?fbp=fb.1.1681333200215.1958219242
Disallow /ancestry?fbp=fb.1.1681178400219.1958219242
Disallow /ancestry?fbp=fb.1.1679882400232.23501133
Disallow /ancestry?fbp=fb.1.1681059600267.885837191
Disallow /ancestry?fbp=fb.1.1679184000271.463715816
Disallow /ancestry?fbp=fb.1.1679162400274.885837191
Disallow /blog/tag/ancestry?fbp=fb.1.1680652800287.417342198
Disallow /health?fbp=fb.1.1678734000272.1615451382
Disallow /ancestry?fbp=fb.1.1679623200188.1615451382
Disallow /ancestry?fbp=fb.1.1681282800273.1483468724
Disallow /health?fbp=fb.1.1677963600217.1659739761
Disallow /ancestry?fbp=fb.1.1679382000201.1663702708
Disallow /ancestry?fbp=fb.1.1679036400242.1142540229
Disallow /ancestry?fbp=fb.1.1678788000184.463715816
Disallow /ancestry?fbp=fb.1.1679374800162.81433148
Disallow /ancestry?fbp=fb.1.1679342400316.1663080082
Disallow /ancestry?fbp=fb.1.1680015600244.885837191
Disallow /ancestry?fbp=fb.1.1681153200195.20255042
Disallow /ancestry?fbp=fb.1.1678338000478.1480889170
Disallow /ancestry?fbp=fb.1.1679594400168.1142540229
Disallow /ancestry?fbp=fb.1.1681160400215.1958219242
Disallow /ancestry?fbp=fb.1.1679547600256.1142540229
Disallow /health?fbp=fb.1.1677801600205.1615451382
Disallow /ancestry?fbp=fb.1.1678269600241.702029895
Disallow /ancestry?fbp=fb.1.1681135200240.1615451382
Disallow /ancestry?fbp=fb.1.1679850000219.1615451382
Disallow /ancestry?fbp=fb.1.1680008400249.1958219242
Disallow /health?fbp=fb.1.1678611600283.1663080082
Disallow /ancestry?fbp=fb.1.1679749200251.1142540229
Disallow /ancestry?fbp=fb.1.1678579200255.1563190848
Disallow /ancestry?fbp=fb.1.1681250400218.885837191
Disallow /ancestry?fbp=fb.1.1677837600375.702029895
Disallow /health?fbp=fb.1.1678446000282.1663080082
Disallow /ancestry?fbp=fb.1.1678802400221.1768026875
Disallow /ancestry?fbp=fb.1.1679464800212.83399123
Disallow /health?fbp=fb.1.1681326000215.896333133
Disallow /ancestry?fbp=fb.1.1679180400295.1341034795
Disallow /ancestry?fbp=fb.1.1680894000248.1958219242
Disallow /ancestry?fbp=fb.1.1679043600311.1659739761
Disallow /ancestry?fbp=fb.1.1680912000214.1615451382
Disallow /ancestry?fbp=fb.1.1678557600232.23501133
Disallow /health?fbp=fb.1.1681232400200.1659739761
Disallow /ancestry?fbp=fb.1.1681034400283.896333133
Disallow /ancestry?fbp=fb.1.1680033600233.1958219242
Disallow /ancestry?fbp=fb.1.1677927600295.1663080082
Disallow /health?fbp=fb.1.1677906000299.1615451382
Disallow /health?fbp=fb.1.1677906000299.1615451382
Disallow /ancestry?fbp=fb.1.1679720400236.83399123
Disallow /ancestry?fbp=fb.1.1679209200315.1253302092
Disallow /health?fbp=fb.1.1681196400189.896333133
Disallow /ancestry?fbp=fb.1.1679511600241.1958219242
Disallow /ancestry?fbp=fb.1.1679508000190.1768026875
Disallow /ancestry?fbp=fb.1.1677909600182.463715816
Disallow /health?fbp=fb.1.1678525200204.702029895
Disallow /ancestry?fbp=fb.1.1678611600283.1663080082
Disallow /health?fbp=fb.1.1679464800212.83399123
Disallow /ancestry?fbp=fb.1.1679047200250.896333133
Disallow /ancestry?fbp=fb.1.1679018400258.1142540229
Disallow /ancestry?fbp=fb.1.1679176800148.23501133
Disallow /ancestry?fbp=fb.1.1678262400211.1659739761
Disallow /ancestry?fbp=fb.1.1679875200279.1663080082
Disallow /ancestry?fbp=fb.1.1677873600175.975481560
Disallow /ancestry?fbp=fb.1.1679803200221.23501133
Disallow /ancestry?fbp=fb.1.1681182000166.20255042
Disallow /ancestry?fbp=fb.1.1679155200271.1341034795
Disallow /index-july16-ctr?utm_expid=.mVm0o1YGRVeFy7sjjK2QqQ.1&utm_referrer=
Disallow /ancestry?fbp=fb.1.1679032800203.1937835283
Disallow /ancestry?fbp=fb.1.1679983200262.885837191
Disallow /ancestry?fbp=fb.1.1681070400248.1804877439
Disallow /blog/page/2?fbp=fb.1.1669766400291.1480204119
Disallow /health?fbp=fb.1.1677891600304.1615451382
Disallow /blog/author/cri-genetics?fbp=fb.1.1669766400328.1663702708
Disallow /blog/author/hunter-wilson?fbp=fb.1.1680825600307.1292351815
Disallow /blog/tag/ancestry/page/4?fbp=fb.1.1680825600279.1480204119
Disallow /blog/tag/ancestry/page/2?fbp=fb.1.1680134400299.1371518722
Disallow /blog/tag/ancestry/page/5?fbp=fb.1.1677542400289.44546679
Disallow /blog/tag/ancestry/page/13?fbp=fb.1.1680739200327.1480204119
Disallow /blog/author/ryan-freeman/page/3?fbp=fb.1.1662681600276.1480204119
Disallow /blog/author/cri-genetics/page/4?fbp=fb.1.1679443200325.1371518722
Disallow /blog/mindfulness-meditation?hs_amp=true
Disallow /blog/tag/relationships?ucacid=117944100.445078&fbp=fb.1.1637539200275.1314780943
Disallow /blog/tag/genes?ucacid=1395880968.849992&fbp=fb.1.1632182400229.539837299
Disallow /blog/tag/paternity?ucacid=1826414947.149509&fbp=fb.1.1644969600279.81433148
Disallow /blog/tag/ethnicity?ucacid=1707466627.204899&fbp=fb.1.1632614400246.1224184972
Disallow /blog/tag/curious-research-information/page/0?fbp=fb.1.1670025600313.1788068356
Disallow /blog/tag/gregor-mendel?ucacid=1395880968.849992&fbp=fb.1.1632096000242.539837299
Disallow /blog/tag/genetic-testing?ucacid=125090161.114628&fbp=fb.1.1632009600227.539837299
Disallow /blog/tag/asian-genetics?ucacid=44546679.479256&fbp=fb.1.1635465600258.539837299
Disallow /blog/tag/ancestry/page/7?ucacid=1276457980.405603&fbp=fb.1.1632355200207.672697106
Disallow /blog/tag/ancestry/page/6?ucacid=125090161.114628&fbp=fb.1.1631923200231.1224184972
Disallow /blog/tag/ancestry/page/3?ucacid=34264411.984044&fbp=fb.1.1640131200285.1819120589
Disallow /index-july16-ctr?utm_expid=.mVm0o1YGRVeFy7sjjK2QqQ.1&utm_referrer=%3Fwtime%3Fwtime=%7Bseek_to_second_number%7D
Disallow /blog/tag/health/page/3?ucacid=1759038828.180884&fbp=fb.1.1655337600341.967060102
Disallow /blog/tag/ancestry/page/4?ucacid=179029966.916633&fbp=fb.1.1654732800239.672697106
Disallow /testblog/tag/ancestry/page/2?ucacid=1083533393.995440&fbp=fb.1.1640822400285.1827530304
Disallow /blog/author/cri-genetics/page/2?ucacid=857170056.100849&fbp=fb.1.1648771200268.1819120589
Disallow /blog/ouch-your-dna-may-affect-how-you-feel-pain?fbp=fb.1.1677801600309.1489328295
Disallow /_hcms/preview/
Disallow /hs/manage-preferences/
Disallow /hs/preferences-center/
Disallow /*?*hs_preview=*
Disallow /*?*hsCacheBuster=*

Other Records

Field Value
sitemap https://www.crigenetics.com/sitemap.xml