Log In Sign Up

strombotne.com
robots.txt

Robots Exclusion Standard data for strombotne.com

Resource Scan

Scan Details

Site Domain strombotne.com
Base Domain strombotne.com
Scan Status Ok
Last Scan2025-10-10T03:58:38+00:00
Next Scan 2025-11-09T03:58:38+00:00

Last Scan

Scanned2025-10-10T03:58:38+00:00
URL https://strombotne.com/robots.txt
Domain IPs 104.21.78.34, 172.67.215.99, 2606:4700:3031::6815:4e22, 2606:4700:3035::ac43:d763
Response IP 104.21.78.34
Found Yes
Hash 43c935516be6713516316ed5f21019c81dfcd43c1e853f5b84b7846be842eec6
SimHash 46254b118694

Groups

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

admantx
ai2bot
adsbot
aisearchbot
ahrefsbot
ai2bot-dolma
aliyunsecbot
amazonbot
andibot
antbot
applebot
aspiegelbot
awario
blexbot
barkrowler
brightbot
bytespider
ccbot
censysinspect
chatgpt-user
claude-searchbot
claude-user
claude-web
claudebot
cotoyogi
crawlspace
dataforseobot
datenbank crawler
devin
diffbot
dotbot
duckassistbot
echobot bot
echoboxbot
expanse
facebookbot
factset_spyderbot
firecrawlagent
foregenix
friendlycrawler
gptbot
gemini-deep-research
go-http-client
google-cloudvertexbot
google-extended
googleagent-mariner
googleother
grapeshot
honolulu-bot
icc-crawler
isscyberriskcrawler
imagesiftbot
ioncrawl
java
kangaroo bot
linguee
mj12bot
megaindex.ru
meta-externalagent
meta-externalfetcher
mistralai-user
mycentralaiscraperbot
novaact
oai-searchbot
operator
pangubot
panscient
perplexity-user
perplexitybot
petalbot
phindbot
poseidon research crawler
qualifiedbot
quillbot
sbintuitionsbot
seokicks
scrapy
seekportbot
semrushbot
sidetrade indexer bot
sitekiosk
summalybot
thinkbot
tiktokspider
timpibot
tinytestbot
turnitin
velenpublicwebcrawler
wardbot
webzio-extended
xovibot
yandexadditional
yisouspider
youbot
zoominfobot
aihitbot
aiohttp
anthropic-ai
bedrockbot
cohere-ai
cohere-training-data-crawler
facebookexternalhit
fidget-spinner-bot
iaskspider
img2dataset
internet-measurement
linabot
meta-externalagent
meta-externalfetcher
netestate
omgili
panscient
phxbot
proximic
python-requests
quillbot.com
wpbot
serpstatbot
test-bot
wp_is_mobile

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /manager
Disallow /editor
Disallow /account
Disallow /tree/strombotne/ancestors
Disallow /tree/strombotne/calendar
Disallow /tree/strombotne/compact
Disallow /tree/strombotne/descendants
Disallow /tree/strombotne/family-book
Disallow /tree/strombotne/family-list
Disallow /tree/strombotne/fan-chart
Disallow /tree/strombotne/hourglass
Disallow /tree/strombotne/individual-list
Disallow /tree/strombotne/lifespans
Disallow /tree/strombotne/pedigree
Disallow /tree/strombotne/report
Disallow /tree/strombotne/timeline

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://strombotne.com/sitemap.xml
Back to top

Comments

  • As a condition of accessing this website, you agree to abide by the following
  • content signals:
  • (a) If a content-signal = yes, you may collect content for the corresponding
  • use.
  • (b) If a content-signal = no, you may not collect content for the
  • corresponding use.
  • (c) If the website operator does not include a content signal for a
  • corresponding use, the website operator neither grants nor restricts
  • permission via content signal with respect to the corresponding use.
  • The content signals and their meanings are:
  • search: building a search index and providing search results (e.g., returning
  • hyperlinks and short excerpts from your website's contents). Search does not
  • include providing AI-generated search summaries.
  • ai-input: inputting content into one or more AI models (e.g., retrieval
  • augmented generation, grounding, or other real-time taking of content for
  • generative AI search answers).
  • ai-train: training or fine-tuning AI models.
  • ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
  • RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
  • AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
  • robots.txt for https://strombotne.com
Back to top

Warnings

  • `content-signal` is not a known field.
Back to top