europepmc.org
robots.txt

Robots Exclusion Standard data for europepmc.org

Resource Scan

Scan Details

Site Domain europepmc.org
Base Domain europepmc.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-20T11:57:37+00:00
Next Scan 2025-12-19T11:57:37+00:00

Last Successful Scan

Scanned2025-07-30T11:08:23+00:00
URL https://europepmc.org/robots.txt
Domain IPs 193.62.193.83
Response IP 193.62.193.83
Found Yes
Hash bf63b304ea4ba2583bc75bc214281e32ff591c7712e230325cf7895fb812bea4
SimHash 0a5b7a51f112

Groups

googlebot

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

slurp

Rule Path
Disallow /classic
Disallow /*/articles/*/pdf/
Disallow /articles/*/pdf/
Disallow /articles/*?pdf=render
Disallow /articles/*?*blobtype=pdf*
Disallow /advancedsearch
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /search/*
Disallow /search?*
Disallow /abstract/*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /exception/*
Disallow /Funders/rss/*

bingbot

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

msnbot

Rule Path
Disallow /classic
Disallow /*/articles/*/pdf/
Disallow /articles/*/pdf/
Disallow /articles/*?pdf=render
Disallow /articles/*?*blobtype=pdf*
Disallow /advancedsearch
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /ftp/oa/*
Disallow /search/*
Disallow /search?*
Disallow /abstract/*
Disallow /*?europe_pmc_extredirect=*
Disallow /Funders/rss/*
Disallow /exception/*

baiduspider

Rule Path
Disallow /classic
Disallow /*/articles/*/pdf/
Disallow /articles/*/pdf/
Disallow /articles/*?pdf=render
Disallow /articles/*?*blobtype=pdf*
Disallow /advancedsearch
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /ftp/oa/*
Disallow /search/*
Disallow /search?*
Disallow /abstract/*
Disallow /*?europe_pmc_extredirect=*
Disallow /Funders/rss/*
Disallow /exception/*

oai-searchbot

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

chatgpt-user

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

gptbot

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

perplexitybot

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

perplexity‑user

Rule Path
Disallow /classic
Disallow /feedback/*
Disallow /*?wicket%3Ainterface*
Disallow /*?europe_pmc_extredirect=*
Disallow /ftp/oa/*
Disallow /Funders/rss/*
Disallow /exception*
Disallow /*/*jsessionid*

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://europepmc.org/sitemap_abstract_index.xml
sitemap http://europepmc.org/sitemap_fulltext_index.xml
sitemap http://europepmc.org/sitemap_authors_index.xml
sitemap http://europepmc.org/sitemap_funders_index.xml
sitemap http://europepmc.org/sitemap_search_index.xml
sitemap http://europepmc.org/sitemap_grants_index.xml

Comments

  • UKPMC robots.txt
  • Google
  • Yahoo
  • Bing
  • For all other bots