srcbox.net
robots.txt
Robots Exclusion Standard data for srcbox.net
Resource Scan
Scan Details
| Site Domain | srcbox.net |
| Base Domain | srcbox.net |
| Scan Status | Ok |
| Last Scan | 2025-12-09T23:16:09+00:00 |
| Next Scan | 2026-01-08T23:16:09+00:00 |
Last Scan
| Scanned | 2025-12-09T23:16:09+00:00 |
| URL | https://srcbox.net/robots.txt |
| Domain IPs | 152.53.246.159, 2a0a:4cc0:c0:9ec7:1862:1bff:fee2:dc99 |
| Response IP | 152.53.246.159 |
| Found | Yes |
| Hash | 4679e35a40590a7a3a659c778da7d36611bbdcbd5d6328e4ca78c1684480c243 |
| SimHash | f6540913c2a6 |
Groups
ai2bot
ai2bot-dolma
amazonbot
applebot-extended
awariobot
awariorssbot
awariosmartbot
bytespider
ccbot
claude-searchbot
claude-user
claude-web
claudebot
cotoyogi
dataforseobot
diffbot
duckassistbot
facebookbot
factset_spyderbot
firecrawlagent
gptbot
google-cloudvertexbot
google-extended
googlebot-extended
icc-crawler
imagesiftbot
kangaroo bot
meltwater
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
omgilibot
pangubot
perplexitybot
perplexityâuser
petalbot
scrapy
seekr
semrushbot-ocob
sentibot
tiktokspider
timpibot
turnitinbot
velenpublicwebcrawler
youbot
aihitbot
cohere-ai
cohere-training-data-crawler
diffbot
facebookexternalhit
img2dataset
meta-externalagent
peer39_crawler
webzio-extended
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.srcbox.net/sitemap.xml |
Warnings
- `content-usage` is not a known field.
- `disallowaitraining` is not a known field.