ijo.in
robots.txt

Robots Exclusion Standard data for ijo.in

Resource Scan

Scan Details

Site Domain ijo.in
Base Domain ijo.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-12T04:37:47+00:00
Next Scan 2025-12-11T04:37:47+00:00

Last Successful Scan

Scanned2024-03-30T12:38:48+00:00
URL https://ijo.in/robots.txt
Domain IPs 104.21.38.160, 172.67.168.43, 2606:4700:3032::6815:26a0, 2606:4700:3037::ac43:a82b
Response IP 172.67.168.43
Found Yes
Hash 2201ada59a94d7e371bdd6eb4887a7f9b27749e7710f5bab1639da4340a3572a
SimHash 4efcf0f8a573

Groups

googlebot

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 50

msnbot

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 40

slurp

Rule Path
Disallow /printarticle.asp
Disallow /imageresult.asp
Disallow /medlineresult.asp
Disallow /citeman.asp
Disallow /citation.asp
Disallow /favorites.asp
Disallow /notifyme.asp
Disallow /addremark.asp
Disallow /getarticleimages.asp
Disallow /_aagraph.asp
Disallow /adminlogin.asp
Disallow /emailarticle.asp
Disallow /readercomments.asp
Disallow /getarticleimages.asp
Disallow /temp/*.pdf$
Disallow /searchresult.asp

Other Records

Field Value
crawl-delay 40

charlotte

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

yandex

Rule Path
Disallow /

goldfire server

Rule Path
Disallow /

googlebot-docs

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Comments

  • User-agent: *
  • Disallow: /printarticle.asp
  • Disallow: /imageresult.asp
  • Disallow: /medlineresult.asp
  • Disallow: /citeman.asp
  • Disallow: /citation.asp
  • Disallow: /favorites.asp
  • Disallow: /notifyme.asp
  • Disallow: /addremark.asp
  • Disallow: /getarticleimages.asp
  • Disallow: /_aagraph.asp
  • Disallow: /adminlogin.asp
  • Disallow: /emailarticle.asp
  • Disallow: /readercomments.asp
  • Disallow: /temp/
  • User-Agent: Charlotte
  • Disallow: /

Warnings

  • `acap-crawler` is not a known field.
  • `acap-disallow-crawl` is not a known field.
  • `noarchive` is not a known field.
  • `nofollow` is not a known field.