elephind.com
robots.txt

Robots Exclusion Standard data for elephind.com

Resource Scan

Scan Details

Site Domain elephind.com
Base Domain elephind.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-12T18:58:17+00:00
Next Scan 2026-03-13T18:58:17+00:00

Last Successful Scan

Scanned2025-10-22T15:14:22+00:00
URL https://elephind.com/robots.txt
Redirect https://www.elephind.com/robots.txt
Redirect Domain www.elephind.com
Redirect Base elephind.com
Domain IPs 103.187.7.134
Redirect IPs 104.21.85.9, 172.67.200.112, 2606:4700:3030::6815:5509, 2606:4700:3034::ac43:c870
Response IP 172.67.200.112
Found Yes
Hash e81266e79d4c82a591202a4e3da5919e5a7dcccd416ad296dc705ba6384eaf32
SimHash 3e748d31f775

Groups

*

Rule Path
Disallow /

applebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

archive.org_bot

Rule Path Comment
Disallow /cgi-bin/imageserver.pl Block imageserver requests
Disallow /?a=a Block authentication
Disallow /?a=cb Block content blocking
Disallow /?a=gs Block graphserver requests
Disallow /?a=is Block imageserver requests
Disallow /?a=pme Block publication metadata editor
Disallow /?a=tc Block text correction
Disallow /?a=ua Block user account
Disallow /?a=ur Block user registration
Disallow /*iiif* Block all IIIF requests
Disallow /?*&e=* Block all internal links

Other Records

Field Value Comment
crawl-delay 1 Wait one second between requests

bingbot

Rule Path Comment
Disallow /cgi-bin/imageserver.pl Block imageserver requests
Disallow /?a=a Block authentication
Disallow /?a=cb Block content blocking
Disallow /?a=gs Block graphserver requests
Disallow /?a=is Block imageserver requests
Disallow /?a=pme Block publication metadata editor
Disallow /?a=tc Block text correction
Disallow /?a=ua Block user account
Disallow /?a=ur Block user registration
Disallow /*iiif* Block all IIIF requests
Disallow /?*&e=* Block all internal links

Other Records

Field Value Comment
crawl-delay 1 Wait one second between requests

googlebot

Rule Path Comment
Disallow /cgi-bin/imageserver.pl Block imageserver requests
Disallow /?a=a Block authentication
Disallow /?a=cb Block content blocking
Disallow /?a=gs Block graphserver requests
Disallow /?a=is Block imageserver requests
Disallow /?a=pme Block publication metadata editor
Disallow /?a=tc Block text correction
Disallow /?a=ua Block user account
Disallow /?a=ur Block user registration
Disallow /*iiif* Block all IIIF requests
Disallow /?*&e=* Block all internal links

Other Records

Field Value Comment
crawl-delay 1 Wait one second between requests

yahoo

Rule Path Comment
Disallow /cgi-bin/imageserver.pl Block imageserver requests
Disallow /?a=a Block authentication
Disallow /?a=cb Block content blocking
Disallow /?a=gs Block graphserver requests
Disallow /?a=is Block imageserver requests
Disallow /?a=pme Block publication metadata editor
Disallow /?a=tc Block text correction
Disallow /?a=ua Block user account
Disallow /?a=ur Block user registration
Disallow /*iiif* Block all IIIF requests
Disallow /?*&e=* Block all internal links

Other Records

Field Value Comment
crawl-delay 1 Wait one second between requests

Comments

  • Elephind robots.txt file
  • =========================================================
  • Block all web crawlers from accessing the site
  • =========================================================
  • Applebot needs to be specifically told to stop; otherwise, it follows Googlebot
  • Explicitly state that it is not for Google’s machine learning purposes
  • =========================================================
  • Only allow the following bots
  • =========================================================