nature.com
robots.txt

Robots Exclusion Standard data for nature.com

Resource Scan

Scan Details

Site Domain nature.com
Base Domain nature.com
Scan Status Ok
Last Scan2024-11-15T23:49:34+00:00
Next Scan 2024-11-22T23:49:34+00:00

Last Scan

Scanned2024-11-15T23:49:34+00:00
URL https://nature.com/robots.txt
Redirect https://www.nature.com/robots.txt
Redirect Domain www.nature.com
Redirect Base nature.com
Domain IPs 199.232.44.95
Redirect IPs 151.101.0.95, 151.101.128.95, 151.101.192.95, 151.101.64.95
Response IP 199.232.44.95
Found Yes
Hash 583cbf571b254942844283090129d70bc3e3e9c9a244b19be53baa289e2ec837
SimHash 7138e962c087

Groups

*

Rule Path
Disallow /search
Disallow */1000$
Disallow /*/*/*/pf/
Disallow /*.otmi$
Disallow /*/*/*/*/otmi/
Disallow /*/*/*/*/fp/
Disallow /protocolexchange/labgroups/
Disallow /naturecareers/jobs/search
Disallow /webcasts/*
Disallow /*draft%3D*
Disallow /*foxtrotcallback%3D*
Disallow /*origin%3D*
Disallow /my-account
Disallow /*proof%3Dt%2Btarget%3D%5C*
Disallow /*proof%3D*
Disallow /*/figures
Disallow /*/tables
Disallow /*/schemes
Disallow /*/structures
Disallow /*/metrics
Disallow /platform/contextual
Disallow /articles/*.ris
Disallow /nature-index/article-api/
Disallow /nature-index/articles/saudi-arabia
Disallow /nature-index/articles/saudi-arabia-altmetric
Disallow /nature-index/city-maps/
Disallow /nature-index/country-outputs-api/
Disallow /nature-index/country-suggestion
Disallow /nature-index/country-suggestion/news-archive
Disallow /nature-index/global-city-map/data
Disallow /nature-index/institution-outputs-api/
Disallow /nature-index/institution-suggestion
Disallow /nature-index/institution-suggestion/news-archive
Disallow /naturecareers/session-img/
Disallow /naturecareers/jobsrss/
Disallow /nature-index/annual-tables/export/
Disallow /nature-index/country-outputs/export/
Disallow /nature-index/country-territory-research-output/export
Disallow /nature-index/institution-outputs/export/
Disallow /nature-index/institution-research-output/export
Disallow /nature-index/news/archive/search/by-country
Disallow /nature-index/news/archive/search/by-institution
Disallow /nature-index/annual-tables/2021/academic-normalized
Disallow */platform/disqus*
Disallow */cas-redirect/*

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nature.com/sitemap.xml
sitemap https://www.nature.com/subjects/sitemap.xml
sitemap https://www.nature.com/naturecareers/sitemapindex.xml
sitemap https://www.nature.com/latest-news/sitemap.xml