tork.buzz
robots.txt

Robots Exclusion Standard data for tork.buzz

Resource Scan

Scan Details

Site Domain tork.buzz
Base Domain tork.buzz
Scan Status Ok
Last Scan2025-10-08T03:45:39+00:00
Next Scan 2025-10-15T03:45:39+00:00

Last Scan

Scanned2025-10-08T03:45:39+00:00
URL https://tork.buzz/robots.txt
Domain IPs 2600:9000:2837:2200:17:4590:2640:93a1, 2600:9000:2837:2a00:17:4590:2640:93a1, 2600:9000:2837:3200:17:4590:2640:93a1, 2600:9000:2837:ae00:17:4590:2640:93a1, 2600:9000:2837:b800:17:4590:2640:93a1, 2600:9000:2837:c000:17:4590:2640:93a1, 2600:9000:2837:da00:17:4590:2640:93a1, 2600:9000:2837:e000:17:4590:2640:93a1, 3.169.71.107, 3.169.71.26, 3.169.71.63, 3.169.71.70
Response IP 3.169.71.70
Found Yes
Hash b87b91ba6989ab59c3c39f6a424c2bfa786769f399dc47de42c0716e1c9e8a6a
SimHash 205e5390c4a5

Groups

applebot
baiduspider
bingbot
discordbot
facebookexternalhit
facebookbot
googlebot
googlebot-news
googlebot-mobile
mediapartners-google
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
googlebot-image
googlebot-video
storebot-google
apis-google
linkedinbot
msnbot
naverbot
pinterestbot
petalbot
seznambot
slurp
teoma
telegrambot
twitterbot
yeti
exabot
criteobot/0.1
duckduckbot
amazonadbot
adidxbot
bingpreview
microsoftpreview
googleother
googleother-image
googleother-video
google-inspectiontool
oai-searchbot
perplexitybot
claude-searchbot
meta-webindexer
meta-externalads

Rule Path
Disallow /_req/
Disallow /*contenidos/
Disallow /vipcontent/
Disallow /buscar.html
Allow /

anthropic-ai
applebot-extended
gptbot
claudebot
duckassistbot
google-extended
meta-externalagent

Rule Path
Disallow /_req/
Disallow /*contenidos/
Disallow /vipcontent/
Disallow /buscar.html
Allow /

*

Rule Path
Disallow /

Comments

  • AI training control