northshield.org
robots.txt

Robots Exclusion Standard data for northshield.org

Resource Scan

Scan Details

Site Domain northshield.org
Base Domain northshield.org
Scan Status Ok
Last Scan2026-01-03T02:57:57+00:00
Next Scan 2026-02-02T02:57:57+00:00

Last Scan

Scanned2026-01-03T02:57:57+00:00
URL https://northshield.org/robots.txt
Domain IPs 35.215.120.58
Response IP 35.215.120.58
Found Yes
Hash ef0dd343c03386f86f3840aa9b6421baf28bfdd045595a2499d8aae96bf43b7e
SimHash e8051dbef344

Groups

*

Rule Path
Disallow *

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

facebookexternalhit

Rule Path
Allow /
Disallow admin_*.php
Disallow /attic
Disallow /audio
Disallow *.txt
Disallow /bin
Disallow /datafiles
Disallow /dblog
Disallow /js
Disallow /phpsession
Disallow *.sql
Disallow /setup
Disallow /sql
Disallow /synch
Disallow /temp
Disallow /text_files
Disallow *.csv
Disallow /vendor

freefind

Rule Path
Allow /
Disallow admin_*.php
Disallow /attic
Disallow /audio
Disallow *.txt
Disallow /bin
Disallow /datafiles
Disallow /dblog
Disallow /js
Disallow /maps
Disallow /phpsession
Disallow *.sql
Disallow /setup
Disallow /sql
Disallow /synch
Disallow /temp
Disallow /text_files
Disallow *.csv
Disallow /vendor

Comments

  • Allow access to the entire site, overriding any general disallow rules

Warnings

  • `bitnami@land` is not a known field.