imjsu.org
robots.txt

Robots Exclusion Standard data for imjsu.org

Resource Scan

Scan Details

Site Domain imjsu.org
Base Domain imjsu.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-08-23T17:57:30+00:00
Next Scan 2025-11-21T17:57:30+00:00

Last Successful Scan

Scanned2024-04-08T16:20:07+00:00
URL https://www.imjsu.org/robots.txt
Domain IPs 104.21.9.147, 172.67.160.47, 2606:4700:3031::ac43:a02f, 2606:4700:3037::6815:993
Response IP 172.67.160.47
Found Yes
Hash 2201ada59a94d7e371bdd6eb4887a7f9b27749e7710f5bab1639da4340a3572a
SimHash 4efcf0f8a573

Groups

googlebot

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 50

msnbot

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 40

slurp

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 40

charlotte

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

goldfire server

Rule Path
Disallow /

googlebot-docs

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • User-agent: *
  • Disallow: /printarticle.asp
  • Disallow: /imageresult.asp
  • Disallow: /medlineresult.asp
  • Disallow: /citeman.asp
  • Disallow: /citation.asp
  • Disallow: /favorites.asp
  • Disallow: /notifyme.asp
  • Disallow: /addremark.asp
  • Disallow: /getarticleimages.asp
  • Disallow: /_aagraph.asp
  • Disallow: /adminlogin.asp
  • Disallow: /emailarticle.asp
  • Disallow: /readercomments.asp
  • Disallow: /temp/
  • User-Agent: Charlotte
  • Disallow: /

Warnings

  • `acap-crawler` is not a known field.
  • `acap-disallow-crawl` is not a known field.
  • `noarchive` is not a known field.
  • `nofollow` is not a known field.