discovery.researcher.life
robots.txt

Robots Exclusion Standard data for discovery.researcher.life

Resource Scan

Scan Details

Site Domain discovery.researcher.life
Base Domain researcher.life
Scan Status Ok
Last Scan2024-09-16T02:00:40+00:00
Next Scan 2024-09-30T02:00:40+00:00

Last Scan

Scanned2024-09-16T02:00:40+00:00
URL https://discovery.researcher.life/robots.txt
Domain IPs 13.33.30.21, 13.33.30.68, 13.33.30.81, 13.33.30.98, 2600:9000:229f:1000:16:74aa:5500:93a1, 2600:9000:229f:1600:16:74aa:5500:93a1, 2600:9000:229f:1800:16:74aa:5500:93a1, 2600:9000:229f:4400:16:74aa:5500:93a1, 2600:9000:229f:7400:16:74aa:5500:93a1, 2600:9000:229f:9200:16:74aa:5500:93a1, 2600:9000:229f:d200:16:74aa:5500:93a1, 2600:9000:229f:d800:16:74aa:5500:93a1
Response IP 13.33.30.68
Found Yes
Hash 01d7b4f6ba32b6f6ba604ea4c6339b822cb430af31896901ba1511c331d8a879
SimHash 69148853a691

Groups

*

Rule Path
Allow /

bingbot

Rule Path
Allow /
Disallow /internal/qa/deeplinks-notification/

perplexitybot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://discovery.researcher.life/sitemap_journal_articles.xml
sitemap https://discovery.researcher.life/sitemap-index.xml

Comments

  • Sitemaps