hymnary.org
robots.txt

Robots Exclusion Standard data for hymnary.org

Resource Scan

Scan Details

Site Domain hymnary.org
Base Domain hymnary.org
Scan Status Ok
Last Scan2025-12-31T18:02:16+00:00
Next Scan 2026-01-07T18:02:16+00:00

Last Scan

Scanned2025-12-31T18:02:16+00:00
URL https://hymnary.org/robots.txt
Domain IPs 2400:52e0:1500::977:1, 84.17.38.251
Response IP 156.146.56.170
Found Yes
Hash 280456d0d984b54acd52f0345baf382c5b6592662d7eec44f8712da6178f0a20
SimHash 4d041311c6f8

Groups

meta-externalagent

Rule Path
Disallow /

googlebot

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

googlebot-image

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

googlebot-news

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

googlebot-video

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

storebot-google

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

apis-google

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

adsbot-google

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

adsbot-google-mobile

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

mediapartners-google

Rule Path
Allow /result/*
Allow /*?extended=*
Allow /*%26extended%3D*

*

Rule Path
Disallow /cgi-bin/
Disallow /mediawiki/
Disallow /wiki/Special%3ASearch
Disallow /wiki/Special%3ARandom
Disallow /ThML/
Disallow /bible/
Disallow *osisRef%3D
Disallow *sub%3D
Disallow /*?cat=*
Disallow /*%26cat%3D*
Disallow /flexscore-demo/
Disallow /melody/search*
Disallow /result/*
Disallow /*?extended=*
Disallow /*%26extended%3D*
Disallow /pro/pass/*
Disallow /database/
Disallow /includes/
Disallow /modules/
Disallow /themes/
Disallow /scripts/
Disallow /updates/
Disallow /profiles/
Disallow /xmlrpc.php
Disallow /cron.php
Disallow /update.php
Disallow /install.php
Disallow /INSTALL.txt
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /CHANGELOG.txt
Disallow /MAINTAINERS.txt
Disallow /LICENSE.txt
Disallow /UPGRADE.txt
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /contact/
Disallow /logout/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /user/login?destination=*
Disallow /user/register?destination=*
Disallow /user?destination=*
Disallow /browse/lectionary/*?rlpage=*
Disallow /recommendation/*/click/*
Disallow /recommendation/click/*
Allow /info/email.html?to=feedback
Disallow /info/email.html?*
Disallow /apache403.html

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://hymnary.org/sitemap.xml

Comments

  • Drupal stuff
  • Directories
  • Disallow: /misc/
  • Disallow: /sites/
  • Files
  • Paths (clean URLs)