nt1100forum.com
robots.txt

Robots Exclusion Standard data for nt1100forum.com

Resource Scan

Scan Details

Site Domain nt1100forum.com
Base Domain nt1100forum.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-08-04T19:58:39+00:00
Next Scan 2025-09-03T19:58:39+00:00

Last Successful Scan

Scanned2025-07-06T05:10:25+00:00
URL https://nt1100forum.com/robots.txt
Domain IPs 193.35.56.12
Response IP 193.35.56.12
Found Yes
Hash 58dc62e828583eac51da47e5556f4996cb05da75af94b58079f4391c9e0cd0d6
SimHash 5d46c00dd6c3

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

google-read-aloud

Rule Path
Allow /

*

Rule Path
Disallow /*action
Disallow /*PHPSESSID
Disallow /cgi-bin/
Disallow /docs/
Disallow /images/

Other Records

Field Value
crawl-delay 5

agentic
ai article writer
ai chat
ai content detector
ai dungeon
ai search
ai seo crawler
ai writer
ai-proxy
ai21 labs
ai2bot
ai2bot-dolma
aibot
aihitbot
aimatrix
aisearchbot
ai training
aitraining
alexa
alpha ai
alphaai
amazon bedrock
amazon-kendra
amazon lex
amazon comprehend
amazon sagemaker
amazon silk
amazon textract
amazonbot
amelia
anderspinkbot
andibot
anthropic
anthropic-ai
anypicker
anyword
applebot
applebot-extended
aria browse
articoolo
autoglm
automated writer
automl
awario
awariorssbot
awariosmartbot
azure
babyagi
bardbot
bedrockbot
brave leo
brightbot
brightbot 1.0
bytedance
bytespider
catboost
cc-crawler
ccbot
chatbot
chatglm
chatgpt-user
chinchilla
claude
claude-searchbot
claude-user
claude-web
claudebot
clearscope
cohere
cohere-ai
cohere-training-data-crawler
common crawl
commoncrawl
content harmony
content king
content optimizer
content samurai
contentatscale
contentbot
contentedge
conversion ai
copilot
copyai
copymatic
copyscape
cotoyogi
crawlq ai
crawlspace
crew ai
crewai
dall-e
dataforseobot
dataprovider
datenbank crawler
deepai
deepl
deepmind
deepseek
devin
diffbot
doubao ai
duckassistbot
echobot bot
echoboxbot
facebookbot
facebookexternalhit
factset
factset_spyderbot
falcon
firecrawl
firecrawlagent
flyriver
frase ai
friendlycrawler
gemini
gemini-deep-research
gemma
genai
genspark
glm
goose
gpt
gptbot
grammarly
grendizer
grok
gt bot
gtbot
hemingway editor
hugging face
hypotenuse ai
iaskspider
iaskspider/2.0
icc-crawler
imagegen
imagesiftbot
img2dataset
imgproxy
ink editor
inkforall
intelliseek
inferkit
isscyberriskcrawler
jasperai
kafkai
kangaroo
kangaroo bot
keyword density ai
knowledge
komobot
lensa
lightpanda
llama
llms
magpie-crawler
manus
marketmuse
meltwater
meta ai
meta-ai
meta-external
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
metaai
metatagbot
mistral
mistralai-user
mistralai-user/1.0
monica
mycentralaiscraperbot
narrative
neevabot
netestate imprint crawler
neural text
neuralseo
nova act
novaact
oai-searchbot
omgili
omgilibot
open ai
openai
openbot
opentext ai
operator
outwrite
page analyzer ai
pangubot
panscient
panscient.com
paperlibot
paraphraser.io
perplexity
perplexity-user
perplexitybot
petalbot
phind
phindbot
piplbot
poseidon research crawler
prowritingaid
puppeteer
qualified
qualifiedbot
quillbot
quillbot.com
qwen
robotspider
rytr
saplingai
sbintuitionsbot
scalenut
scraper
scrapy
scriptbook
seo content machine
seo robot
semrushbot
semrushbot-ocob
semrushbot-swa
sentibot
sidetrade
sidetrade indexer bot
simplified ai
sitefinity
skydancer
slickwrite
sonic
spin rewriter
spinbot
stability
stablediffusionbot
sudowrite
super agent
surfer ai
text blaze
textcortex
the knowledge ai
tiktokspider
timpibot
traefik
velenpublicwebcrawler
vidnami ai
wardbot
webzio
webzio-extended
whisper
wordai
wordtune
wormsgtp
wpbot
writecream
writerzen
writescope
writesonic
xai
xbot
yaml
yandexadditional
yandexadditionalbot
youbot
zero gtp
zerochat
zhipu
zimm

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bingbot

Rule Path
Disallow /*action
Disallow /*PHPSESSID
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

blexbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

chatgpt-user/2.0

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Warnings

  • 1 invalid line.