draclaw.com
robots.txt
Robots Exclusion Standard data for draclaw.com
Resource Scan
Scan Details
| Site Domain | draclaw.com |
| Base Domain | draclaw.com |
| Scan Status | Ok |
| Last Scan | 2025-11-17T13:51:09+00:00 |
| Next Scan | 2025-12-17T13:51:09+00:00 |
Last Scan
| Scanned | 2025-11-17T13:51:09+00:00 |
| URL | https://draclaw.com/robots.txt |
| Domain IPs | 104.21.18.20, 172.67.179.161, 2606:4700:3030::6815:1214, 2606:4700:3037::ac43:b3a1 |
| Response IP | 172.67.179.161 |
| Found | Yes |
| Hash | 1d1f5ea971a6e7a0c08cd2f8013f763deee090ddba0eeb2be1ca92e5ecdf7830 |
| SimHash | 66774240cd97 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /program/bot/ |
| Disallow | /program/chatx/ |
| Disallow | /program/macgo/ |
| Disallow | /program/mail/ |
| Disallow | /program/newiine_app/ |
| Disallow | /program/RealTimeCount/ |
| Disallow | /program/referer/ |
| Disallow | /program/requbox/ |
| Disallow | /program/Kash/ |
| Disallow | /program/BIPC/ |
| Disallow | /script/ |
| Disallow | /satogo/VNuKq7ybRf/ |
| Disallow | /satogo/decision/ |
| Disallow | /satogo/parent/ |
| Disallow | /temporary/ |
| Disallow | /test/ |
| Disallow | /games/mv001/web/ |
| Disallow | */test.html |
| Disallow | */_template.html |
| Disallow | */_templa.html |
| Disallow | /_naiyo.html |
| Disallow | /img/ |
| Disallow | /gallery/treasure/img/ |
| Disallow | /gallery/treasure/icon/ |
| Disallow | /gallery/under/img/ |
| Disallow | /gallery/under/icon/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
cotoyogi
duckassistbot
gptbot
chatgpt-user
oai-searchbot
google-extended
googleother
applebot
applebot-extended
meta-externalagent
perplexitybot
mistralai-user
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /$ |
| Allow | /about.html |
| Allow | /admin.html |
| Allow | /ok/thumbnail/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
phxbot
aliyunsecbot
deepseek
deepseekbot
xai-bot
googleother-image
googleother-video
livelapbot
petalbot
baiduspider
baidu
adequat
adequat-systems
ai2bot
alexibot
alvinetspider
amazonbot
amisoftware
antenne hatena
anthropic-ai
apocalxexplorerbot
applebot-extended
argus
ask n read
asknread.com
asterias
augure
auramundi
bizinformation
bloomberg
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
bytespider
ccbot
cegbfeieh
chatgpt-user
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cision
claude-web
claudebot
coexel
cohere-ai
converacrawler
copyrightcheck
corporama
cosmos
crescent
crescent internet toolpak http ole control v.1.0
cydralspider
diffbot
digimind
disco pump 3.1
dittospyder
dotbot
download ninja
downloadexpress
duckassistbot
ellisphere
emailcollector
emailsiphon
emailwolf
erocrawler
eureka
europresse
explore
extractorpro
facebookbot
fasterfox
fetch
flamingo_searchengine
foobot
gammaspider
google-extended
gptbot
grok-deepsearch
grokbot
grub-client
hloader
httplib
httrack
httrack 3.0
humanlinks
igentia
indexer
infonavirobot
infoseek
jennybot
jetbot
jikespider
k2spider
kantar
kbcrawl
kenjin spider
knowings
larbin
leadbox
lexibot
libweb/clshttp
libwww
linkextractorpro
linkfluence
linko
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
manageo
mata hari
mediacompil
meltwater
mention
meta-externalagent
mister pix
mistralai-user
mlbot
moget
moget/2.1
moreover
msiecrawler
mytwip
naverbot
netants
netattache
netmechanic
newscan-online
newsnow
newzbin
nicerspro
npbot
oai-searchbot
objectssearch
offline explorer
omgili
omgilibot
openfind
openindexspider
opinion-tracker
perplexitybot
pimptrain
propowerbot/2.14
prowebwalker
proxem
psbot
quepasacreep
queryn metasearch
qwam content intelligence
raven
readability.com
repomonkey
rma
scoop.it
score3
sightupbot
sindup
sitebot
sitecheck.internetseer.com
sitesnagger
sitesucker
sogou web spider
sosospider
spankbot
speedy
spotter
suggybot
superbot
superbot/2.6
suzuran
synthesio
szukacz/1.4
talkwalker
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
timpibot
titan
tocrawl/urldispatcher
toscrawler
trendeo
trendybuzz
true_robot
true_robot/1.0
turingos
turnitinbot
up2news
urlpouls
urly warning
vci
vecteurplus
verif
verticalsearch
vsw
wapspider
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webedia
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzinger
webzio-extended
webzip
wget
wikiofeedbot
winello
winhttrack
www-collector-e
xai-grok
xenu link sleuth/1.3.8
yacy
yandex
youbot
youmag
yrspider
zealbot
zeus
zite
zookabot
zyborg
semrushbot
ahrefsbot
mj12bot
blexbot
yandexbot
imagesiftbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://draclaw.com/sitemap.xml |
Warnings
- 5 invalid lines.
- `content-signal` is not a known field.
Comments