silicon-alliance.com
robots.txt

Robots Exclusion Standard data for silicon-alliance.com

Resource Scan

Scan Details

Site Domain silicon-alliance.com
Base Domain silicon-alliance.com
Scan Status Ok
Last Scan2025-05-18T22:58:03+00:00
Next Scan 2025-06-17T22:58:03+00:00

Last Scan

Scanned2025-05-18T22:58:03+00:00
URL https://silicon-alliance.com/robots.txt
Redirect https://silicon-alliance.insight.com/robots.txt
Redirect Domain silicon-alliance.insight.com
Redirect Base insight.com
Domain IPs 50.18.131.123, 50.18.53.50
Redirect IPs 50.18.131.123, 50.18.53.50
Response IP 50.18.131.123
Found Yes
Hash 45ddd08bf7718a40705abe6edf15f63b1337891e32d01e66eee85a45e880b3e0
SimHash 7c6619118ec4

Groups

agent gpt
agentgpt
ai article writer
ai content detector
ai dungeon
ai search engine
ai seo crawler
ai writer
ai21 labs
ai2bot
ai2bot-dolma
aibot
aisearchbot
alexatm
alpha ai
alphaai
amazon bedrock
amazon lex
amazonbot
amelia
anthropic-ai
anthropicai
anypicker
anyword
applebot
applebot-extended
articoolo
autogpt
automated writer
awariorssbot
awariosmartbot
brave leo ai
bytespider
catboost
cc-crawler
ccbot
chatgpt
chatgpt-user
claudebot
claude-web
clearscope
cohere-ai
cohere-training-data-crawler
content harmony
content king
content optimizer
content samurai
contentatscale
contentbot
contentedge
conversion ai
copyai
copymatic
copyscape
crawlq ai
crawlspace
crew ai
crewai
dall-e
dataforseobot
deepai
deepl
deepmind
deepseek
depolarizinggpt
dialogpt
diffbot
duckassistbot
facebookbot
firecrawl
flyriver
fraze ai
friendlycrawler
gemma
genai
google bard ai
google-cloudvertexbot
googleother
googleother-image
googleother-video
gpt-2
gpt-3
gpt-4
gptbot
gptzero
grammarly
grok
hemmingway editor
hugging face
hypotenuse ai
iaskspider
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
ink editor
inkforall
inferkit
intelliseek.ai
isscyberriskcrawler
jasperai
kafkai
kangaroo
kangaroo bot
keyword density ai
leftwinggpt
llama
magpie-crawler
marketmuse
meltwater
meta ai
metaai
meta.ai
meta-ai
meta llama
meta-externalagent
meta-externalfetcher
metatagbot
mistral
narrative device
neural text
neuralseo
oai-searchbot
oai searchbot
omgili
omgilibot
omnigpt
open ai
openai
opentext ai
outwrite
page analyzer ai
pangubot
paraphraser.io
peer39_crawler
peer39_crawler/1.0
perplexitybot
petalbot
piplbot
prowritingbot
quillbot
rightwinggpt
robotspider
rytr
saplingai
scalenut
scoop.it
scrapy
scriptbook
searchgpt
seekr
seo content machine
seo robot
sidetrade
sidetrade indexer bot
simplified ai
slickwrite
spin rewriter
spinbot
stability
sudowrite
surfer ai
text blaze
textcortex
the knowledge ai
timpibot
velenpublicwebcrawler
vidnami ai
webchatgpt
webzio
webzio-extended
whisper
wordai
wordtune
writecream
writerzen
writescope
writesonic
x.ai
xai
youbot
zero gtp
zimmwriter

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot

Rule Path
Disallow /admin/
Disallow /api/
Disallow /fonts/
Disallow /login
Disallow /login/
Disallow /forgotpassword
Disallow /%7Burl%7D

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /fonts/
Disallow /js/
Disallow /login
Disallow /login/
Disallow /forgotpassword
Disallow /%7Burl%7D

Other Records

Field Value
sitemap https://silicon-alliance.insight.com/sitemap.xml