silicon-alliance.com
robots.txt
Robots Exclusion Standard data for silicon-alliance.com
Resource Scan
Scan Details
Site Domain | silicon-alliance.com |
Base Domain | silicon-alliance.com |
Scan Status | Ok |
Last Scan | 2025-05-18T22:58:03+00:00 |
Next Scan | 2025-06-17T22:58:03+00:00 |
Last Scan
Scanned | 2025-05-18T22:58:03+00:00 |
URL | https://silicon-alliance.com/robots.txt |
Redirect | https://silicon-alliance.insight.com/robots.txt |
Redirect Domain | silicon-alliance.insight.com |
Redirect Base | insight.com |
Domain IPs | 50.18.131.123, 50.18.53.50 |
Redirect IPs | 50.18.131.123, 50.18.53.50 |
Response IP | 50.18.131.123 |
Found | Yes |
Hash | 45ddd08bf7718a40705abe6edf15f63b1337891e32d01e66eee85a45e880b3e0 |
SimHash | 7c6619118ec4 |
Groups
agent gpt
agentgpt
ai article writer
ai content detector
ai dungeon
ai search engine
ai seo crawler
ai writer
ai21 labs
ai2bot
ai2bot-dolma
aibot
aisearchbot
alexatm
alpha ai
alphaai
amazon bedrock
amazon lex
amazonbot
amelia
anthropic-ai
anthropicai
anypicker
anyword
applebot
applebot-extended
articoolo
autogpt
automated writer
awariorssbot
awariosmartbot
brave leo ai
bytespider
catboost
cc-crawler
ccbot
chatgpt
chatgpt-user
claudebot
claude-web
clearscope
cohere-ai
cohere-training-data-crawler
content harmony
content king
content optimizer
content samurai
contentatscale
contentbot
contentedge
conversion ai
copyai
copymatic
copyscape
crawlq ai
crawlspace
crew ai
crewai
dall-e
dataforseobot
deepai
deepl
deepmind
deepseek
depolarizinggpt
dialogpt
diffbot
duckassistbot
facebookbot
firecrawl
flyriver
fraze ai
friendlycrawler
gemma
genai
google bard ai
google-cloudvertexbot
googleother
googleother-image
googleother-video
gpt-2
gpt-3
gpt-4
gptbot
gptzero
grammarly
grok
hemmingway editor
hugging face
hypotenuse ai
iaskspider
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
ink editor
inkforall
inferkit
intelliseek.ai
isscyberriskcrawler
jasperai
kafkai
kangaroo
kangaroo bot
keyword density ai
leftwinggpt
llama
magpie-crawler
marketmuse
meltwater
meta ai
metaai
meta.ai
meta-ai
meta llama
meta-externalagent
meta-externalfetcher
metatagbot
mistral
narrative device
neural text
neuralseo
oai-searchbot
oai searchbot
omgili
omgilibot
omnigpt
open ai
openai
opentext ai
outwrite
page analyzer ai
pangubot
paraphraser.io
peer39_crawler
peer39_crawler/1.0
perplexitybot
petalbot
piplbot
prowritingbot
quillbot
rightwinggpt
robotspider
rytr
saplingai
scalenut
scoop.it
scrapy
scriptbook
searchgpt
seekr
seo content machine
seo robot
sidetrade
sidetrade indexer bot
simplified ai
slickwrite
spin rewriter
spinbot
stability
sudowrite
surfer ai
text blaze
textcortex
the knowledge ai
timpibot
velenpublicwebcrawler
vidnami ai
webchatgpt
webzio
webzio-extended
whisper
wordai
wordtune
writecream
writerzen
writescope
writesonic
x.ai
xai
youbot
zero gtp
zimmwriter
Rule | Path |
---|---|
Disallow | / |
googlebot
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /fonts/ |
Disallow | /login |
Disallow | /login/ |
Disallow | /forgotpassword |
Disallow | /%7Burl%7D |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /fonts/ |
Disallow | /js/ |
Disallow | /login |
Disallow | /login/ |
Disallow | /forgotpassword |
Disallow | /%7Burl%7D |
Other Records
Field | Value |
---|---|
sitemap | https://silicon-alliance.insight.com/sitemap.xml |