spoki.tvnet.lv
robots.txt
Robots Exclusion Standard data for spoki.tvnet.lv
Resource Scan
Scan Details
| Site Domain | spoki.tvnet.lv |
| Base Domain | tvnet.lv |
| Scan Status | Ok |
| Last Scan | 2025-10-19T21:56:54+00:00 |
| Next Scan | 2025-11-18T21:56:54+00:00 |
Last Scan
| Scanned | 2025-10-19T21:56:54+00:00 |
| URL | https://spoki.tvnet.lv/robots.txt |
| Redirect | https://spoki.lv/robots.txt |
| Redirect Domain | spoki.lv |
| Redirect Base | spoki.lv |
| Domain IPs | 185.154.222.232 |
| Redirect IPs | 185.154.222.232 |
| Response IP | 185.154.222.232 |
| Found | Yes |
| Hash | 729b8e6197a542ebbd0907be48365a51303642ebc77453f701cfe42673fde58f |
| SimHash | 77b25341dcc7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin* |
| Disallow | /*.php |
| Disallow | /upload/articles/* |
| Disallow | /upload2/articles/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
discobot
dotbot
yacybot
petalbot
semrushbot
grapeshot
barkrowler
discobot
dotbot
yacybot
semrushbot
grapeshot
barkrowler
ai2bot
amazonbot
anthropic-ai
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
diffbot
duckassistbot
facebookbot
google-extended
mistral-client
mistralai
gptbot
kangaroo bot
meta-externalagent
meta-externalfetcher
oai-searchbot
omgili
pangubot
perplexitybot
timpibot
webzio-extended
youbot
kagi-search
kagibot
kagibot-image
phindbot
openai
openai-crawler
quora-content-bot
quora link preview
neevabot
neevaai
dataforseobot
sensityai
surferbot
yandexgptbot
yandexdatabot
exabot
femtosearchbot
| Rule | Path |
|---|---|
| Disallow | * |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spoki.lv/upload/sitemaps/sitemap.xml |