jungmar.org
robots.txt

Robots Exclusion Standard data for jungmar.org

Resource Scan

Scan Details

Site Domain jungmar.org
Base Domain jungmar.org
Scan Status Ok
Last Scan2025-08-03T23:37:54+00:00
Next Scan 2025-09-02T23:37:54+00:00

Last Scan

Scanned2025-08-03T23:37:54+00:00
URL https://jungmar.org/robots.txt
Domain IPs 185.189.49.217, 194.68.59.6, 2001:67c:750::5
Response IP 185.189.49.217
Found Yes
Hash 72f2a186e62d189cca3d1c527fbb2064e5317ac8eb608fc87a1c97022b3db02c
SimHash 9b4d430837c2

Groups

aliyunsecbot/aliyun (aliyunsecbot@service.alibaba.com)
aliyunsecbot/nutch-1.21-snapshot
admantx
adsbot
ahrefsbot
amazonbot
antbot
aspiegelbot
awario
barkrowler
blexbot
bytespider
ccbot
censysinspect
chatgpt-user
claudebot
dataforseobot
dotbot
expanse
facebookbot
fidget-spinner-bot
foregenix
friendlycrawler
go-http-client
google-extended
gptbot
grapeshot
honolulu-bot
ia_archiver
internet-measurement
ioncrawl
java
linabot
linguee
megaindex.ru
mj12bot
netestate ne
omgilibot
panscient
petalbot
phxbot
proximic
python-requests
scrapy
seekportbot
semrushbot
serpstatbot
seokicks
sitekiosk
test-bot
tinytestbot
turnitin
wp_is_mobile
xovibot
yisouspider
zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /genealogy/admin
Disallow /genealogy/manager
Disallow /genealogy/editor
Disallow /genealogy/account
Disallow /genealogy/tree/jungmar/ancestors
Disallow /genealogy/tree/jungmar/calendar
Disallow /genealogy/tree/jungmar/compact
Disallow /genealogy/tree/jungmar/descendants
Disallow /genealogy/tree/jungmar/family-book
Disallow /genealogy/tree/jungmar/family-list
Disallow /genealogy/tree/jungmar/fan-chart
Disallow /genealogy/tree/jungmar/hourglass
Disallow /genealogy/tree/jungmar/individual-list
Disallow /genealogy/tree/jungmar/lifespans
Disallow /genealogy/tree/jungmar/pedigree
Disallow /genealogy/tree/jungmar/report
Disallow /genealogy/tree/jungmar/timeline
Disallow /genealogy/tree/lindberg/ancestors
Disallow /genealogy/tree/lindberg/calendar
Disallow /genealogy/tree/lindberg/compact
Disallow /genealogy/tree/lindberg/descendants
Disallow /genealogy/tree/lindberg/family-book
Disallow /genealogy/tree/lindberg/family-list
Disallow /genealogy/tree/lindberg/fan-chart
Disallow /genealogy/tree/lindberg/hourglass
Disallow /genealogy/tree/lindberg/individual-list
Disallow /genealogy/tree/lindberg/lifespans
Disallow /genealogy/tree/lindberg/pedigree
Disallow /genealogy/tree/lindberg/report
Disallow /genealogy/tree/lindberg/timeline

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://jungmar.org/genealogy/sitemap.xml

Comments

  • robots.txt for https://jungmar.org/genealogy