jungmar.org
robots.txt
Robots Exclusion Standard data for jungmar.org
Resource Scan
Scan Details
Site Domain | jungmar.org |
Base Domain | jungmar.org |
Scan Status | Ok |
Last Scan | 2025-08-03T23:37:54+00:00 |
Next Scan | 2025-09-02T23:37:54+00:00 |
Last Scan
Scanned | 2025-08-03T23:37:54+00:00 |
URL | https://jungmar.org/robots.txt |
Domain IPs | 185.189.49.217, 194.68.59.6, 2001:67c:750::5 |
Response IP | 185.189.49.217 |
Found | Yes |
Hash | 72f2a186e62d189cca3d1c527fbb2064e5317ac8eb608fc87a1c97022b3db02c |
SimHash | 9b4d430837c2 |
Groups
aliyunsecbot/aliyun (aliyunsecbot@service.alibaba.com)
aliyunsecbot/nutch-1.21-snapshot
admantx
adsbot
ahrefsbot
amazonbot
antbot
aspiegelbot
awario
barkrowler
blexbot
bytespider
ccbot
censysinspect
chatgpt-user
claudebot
dataforseobot
dotbot
expanse
facebookbot
fidget-spinner-bot
foregenix
friendlycrawler
go-http-client
google-extended
gptbot
grapeshot
honolulu-bot
ia_archiver
internet-measurement
ioncrawl
java
linabot
linguee
megaindex.ru
mj12bot
netestate ne
omgilibot
panscient
petalbot
phxbot
proximic
python-requests
scrapy
seekportbot
semrushbot
serpstatbot
seokicks
sitekiosk
test-bot
tinytestbot
turnitin
wp_is_mobile
xovibot
yisouspider
zoominfobot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /genealogy/admin |
Disallow | /genealogy/manager |
Disallow | /genealogy/editor |
Disallow | /genealogy/account |
Disallow | /genealogy/tree/jungmar/ancestors |
Disallow | /genealogy/tree/jungmar/calendar |
Disallow | /genealogy/tree/jungmar/compact |
Disallow | /genealogy/tree/jungmar/descendants |
Disallow | /genealogy/tree/jungmar/family-book |
Disallow | /genealogy/tree/jungmar/family-list |
Disallow | /genealogy/tree/jungmar/fan-chart |
Disallow | /genealogy/tree/jungmar/hourglass |
Disallow | /genealogy/tree/jungmar/individual-list |
Disallow | /genealogy/tree/jungmar/lifespans |
Disallow | /genealogy/tree/jungmar/pedigree |
Disallow | /genealogy/tree/jungmar/report |
Disallow | /genealogy/tree/jungmar/timeline |
Disallow | /genealogy/tree/lindberg/ancestors |
Disallow | /genealogy/tree/lindberg/calendar |
Disallow | /genealogy/tree/lindberg/compact |
Disallow | /genealogy/tree/lindberg/descendants |
Disallow | /genealogy/tree/lindberg/family-book |
Disallow | /genealogy/tree/lindberg/family-list |
Disallow | /genealogy/tree/lindberg/fan-chart |
Disallow | /genealogy/tree/lindberg/hourglass |
Disallow | /genealogy/tree/lindberg/individual-list |
Disallow | /genealogy/tree/lindberg/lifespans |
Disallow | /genealogy/tree/lindberg/pedigree |
Disallow | /genealogy/tree/lindberg/report |
Disallow | /genealogy/tree/lindberg/timeline |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://jungmar.org/genealogy/sitemap.xml |
Comments