arch.b4k.dev
robots.txt
Robots Exclusion Standard data for arch.b4k.dev
Resource Scan
Scan Details
| Site Domain | arch.b4k.dev |
| Base Domain | b4k.dev |
| Scan Status | Ok |
| Last Scan | 2025-09-13T08:39:38+00:00 |
| Next Scan | 2025-09-27T08:39:38+00:00 |
Last Scan
| Scanned | 2025-09-13T08:39:38+00:00 |
| URL | https://arch.b4k.dev/robots.txt |
| Domain IPs | 104.21.36.151, 172.67.195.159, 2606:4700:3034::6815:2497, 2606:4700:3037::ac43:c39f |
| Response IP | 172.67.195.159 |
| Found | Yes |
| Hash | 7008d163cfbe5a276242b70281fb7b3892bfc25be078fdfe34bcc7dd4c95fbd1 |
| SimHash | f4b7484089d6 |
Groups
ai2bot
ai2bot-dolma
amazonbot
anthropic-ai
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
diffbot
duckassistbot
facebookbot
friendlycrawler
google-extended
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
isscyberriskcrawler
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /admin |
| Disallow | /data |
| Disallow | /files |
| Disallow | /media |
| Disallow | /_/search |
| Disallow | /_/api |
| Disallow | /_/language |
| Disallow | /g/chunk |
| Disallow | /g/full_image |
| Disallow | /g/gallery |
| Disallow | /g/image |
| Disallow | /g/last |
| Disallow | /g/page |
| Disallow | /g/page_mode |
| Disallow | /g/post |
| Disallow | /g/redirect |
| Disallow | /g/report |
| Disallow | /g/search |
| Disallow | /g/thread |
| Disallow | /jp/chunk |
| Disallow | /jp/full_image |
| Disallow | /jp/gallery |
| Disallow | /jp/image |
| Disallow | /jp/last |
| Disallow | /jp/page |
| Disallow | /jp/page_mode |
| Disallow | /jp/post |
| Disallow | /jp/redirect |
| Disallow | /jp/report |
| Disallow | /jp/search |
| Disallow | /jp/thread |
| Disallow | /mlp/chunk |
| Disallow | /mlp/full_image |
| Disallow | /mlp/gallery |
| Disallow | /mlp/image |
| Disallow | /mlp/last |
| Disallow | /mlp/page |
| Disallow | /mlp/page_mode |
| Disallow | /mlp/post |
| Disallow | /mlp/redirect |
| Disallow | /mlp/report |
| Disallow | /mlp/search |
| Disallow | /mlp/thread |
| Disallow | /pol/chunk |
| Disallow | /pol/full_image |
| Disallow | /pol/gallery |
| Disallow | /pol/image |
| Disallow | /pol/last |
| Disallow | /pol/page |
| Disallow | /pol/page_mode |
| Disallow | /pol/post |
| Disallow | /pol/redirect |
| Disallow | /pol/report |
| Disallow | /pol/search |
| Disallow | /pol/thread |
| Disallow | /pw/chunk |
| Disallow | /pw/full_image |
| Disallow | /pw/gallery |
| Disallow | /pw/image |
| Disallow | /pw/last |
| Disallow | /pw/page |
| Disallow | /pw/page_mode |
| Disallow | /pw/post |
| Disallow | /pw/redirect |
| Disallow | /pw/report |
| Disallow | /pw/search |
| Disallow | /pw/thread |
| Disallow | /qb/chunk |
| Disallow | /qb/full_image |
| Disallow | /qb/gallery |
| Disallow | /qb/image |
| Disallow | /qb/last |
| Disallow | /qb/page |
| Disallow | /qb/page_mode |
| Disallow | /qb/post |
| Disallow | /qb/redirect |
| Disallow | /qb/report |
| Disallow | /qb/search |
| Disallow | /qb/thread |
| Disallow | /v/chunk |
| Disallow | /v/full_image |
| Disallow | /v/gallery |
| Disallow | /v/image |
| Disallow | /v/last |
| Disallow | /v/page |
| Disallow | /v/page_mode |
| Disallow | /v/post |
| Disallow | /v/redirect |
| Disallow | /v/report |
| Disallow | /v/search |
| Disallow | /v/thread |
| Disallow | /vg/chunk |
| Disallow | /vg/full_image |
| Disallow | /vg/gallery |
| Disallow | /vg/image |
| Disallow | /vg/last |
| Disallow | /vg/page |
| Disallow | /vg/page_mode |
| Disallow | /vg/post |
| Disallow | /vg/redirect |
| Disallow | /vg/report |
| Disallow | /vg/search |
| Disallow | /vg/thread |
| Disallow | /vm/chunk |
| Disallow | /vm/full_image |
| Disallow | /vm/gallery |
| Disallow | /vm/image |
| Disallow | /vm/last |
| Disallow | /vm/page |
| Disallow | /vm/page_mode |
| Disallow | /vm/post |
| Disallow | /vm/redirect |
| Disallow | /vm/report |
| Disallow | /vm/search |
| Disallow | /vm/thread |
| Disallow | /vmg/chunk |
| Disallow | /vmg/full_image |
| Disallow | /vmg/gallery |
| Disallow | /vmg/image |
| Disallow | /vmg/last |
| Disallow | /vmg/page |
| Disallow | /vmg/page_mode |
| Disallow | /vmg/post |
| Disallow | /vmg/redirect |
| Disallow | /vmg/report |
| Disallow | /vmg/search |
| Disallow | /vmg/thread |
| Disallow | /vp/chunk |
| Disallow | /vp/full_image |
| Disallow | /vp/gallery |
| Disallow | /vp/image |
| Disallow | /vp/last |
| Disallow | /vp/page |
| Disallow | /vp/page_mode |
| Disallow | /vp/post |
| Disallow | /vp/redirect |
| Disallow | /vp/report |
| Disallow | /vp/search |
| Disallow | /vp/thread |
| Disallow | /vr/chunk |
| Disallow | /vr/full_image |
| Disallow | /vr/gallery |
| Disallow | /vr/image |
| Disallow | /vr/last |
| Disallow | /vr/page |
| Disallow | /vr/page_mode |
| Disallow | /vr/post |
| Disallow | /vr/redirect |
| Disallow | /vr/report |
| Disallow | /vr/search |
| Disallow | /vr/thread |
| Disallow | /vrpg/chunk |
| Disallow | /vrpg/full_image |
| Disallow | /vrpg/gallery |
| Disallow | /vrpg/image |
| Disallow | /vrpg/last |
| Disallow | /vrpg/page |
| Disallow | /vrpg/page_mode |
| Disallow | /vrpg/post |
| Disallow | /vrpg/redirect |
| Disallow | /vrpg/report |
| Disallow | /vrpg/search |
| Disallow | /vrpg/thread |
| Disallow | /vst/chunk |
| Disallow | /vst/full_image |
| Disallow | /vst/gallery |
| Disallow | /vst/image |
| Disallow | /vst/last |
| Disallow | /vst/page |
| Disallow | /vst/page_mode |
| Disallow | /vst/post |
| Disallow | /vst/redirect |
| Disallow | /vst/report |
| Disallow | /vst/search |
| Disallow | /vst/thread |
| Disallow | /vt/chunk |
| Disallow | /vt/full_image |
| Disallow | /vt/gallery |
| Disallow | /vt/image |
| Disallow | /vt/last |
| Disallow | /vt/page |
| Disallow | /vt/page_mode |
| Disallow | /vt/post |
| Disallow | /vt/redirect |
| Disallow | /vt/report |
| Disallow | /vt/search |
| Disallow | /vt/thread |
| Disallow | /xs/chunk |
| Disallow | /xs/full_image |
| Disallow | /xs/gallery |
| Disallow | /xs/image |
| Disallow | /xs/last |
| Disallow | /xs/page |
| Disallow | /xs/page_mode |
| Disallow | /xs/post |
| Disallow | /xs/redirect |
| Disallow | /xs/report |
| Disallow | /xs/search |
| Disallow | /xs/thread |
Comments