robotina.us
robots.txt
Robots Exclusion Standard data for robotina.us
Resource Scan
Scan Details
| Site Domain | robotina.us |
| Base Domain | robotina.us |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-25T12:24:43+00:00 |
| Next Scan | 2025-11-08T12:24:43+00:00 |
Last Successful Scan
| Scanned | 2025-10-09T13:08:18+00:00 |
| URL | https://robotina.us/robots.txt |
| Redirect | https://www.robotina.us/robots.txt |
| Redirect Domain | www.robotina.us |
| Redirect Base | robotina.us |
| Domain IPs | 104.21.50.237, 172.67.213.218, 2606:4700:3032::ac43:d5da, 2606:4700:3037::6815:32ed |
| Redirect IPs | 2600:9000:269b:2200:1a:5336:5000:93a1, 2600:9000:269b:4000:1a:5336:5000:93a1, 2600:9000:269b:5400:1a:5336:5000:93a1, 2600:9000:269b:8200:1a:5336:5000:93a1, 2600:9000:269b:b200:1a:5336:5000:93a1, 2600:9000:269b:c600:1a:5336:5000:93a1, 2600:9000:269b:ea00:1a:5336:5000:93a1, 2600:9000:269b:f000:1a:5336:5000:93a1, 3.160.196.11, 3.160.196.121, 3.160.196.124, 3.160.196.35 |
| Response IP | 65.9.112.78 |
| Found | Yes |
| Hash | 23113bbb47c6a7327bdf38c52eb54711720b395e8166a3257c428ef4c0e88c2a |
| SimHash | 205c5380c4a5 |
Groups
applebot
baiduspider
bingbot
discordbot
facebookexternalhit
facebookbot
googlebot
googlebot-news
googlebot-mobile
mediapartners-google
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
googlebot-image
googlebot-video
storebot-google
apis-google
linkedinbot
msnbot
naverbot
pinterestbot
petalbot
seznambot
slurp
teoma
telegrambot
twitterbot
yeti
exabot
criteobot/0.1
duckduckbot
amazonadbot
adidxbot
bingpreview
microsoftpreview
googleother
googleother-image
googleother-video
google-inspectiontool
oai-searchbot
perplexitybot
claude-searchbot
meta-webindexer
meta-externalads
grapeshot
| Rule | Path |
|---|---|
| Disallow | /_req/ |
| Disallow | /*contenidos/ |
| Disallow | /vipcontent/ |
| Disallow | /buscar.html |
| Allow | / |
anthropic-ai
applebot-extended
gptbot
claudebot
duckassistbot
google-extended
meta-externalagent
| Rule | Path |
|---|---|
| Disallow | /_req/ |
| Disallow | /*contenidos/ |
| Disallow | /vipcontent/ |
| Disallow | /22655596684/ |
| Disallow | /noticias/*/ |
| Disallow | /entretenimiento/*/ |
| Disallow | /buscar.html |
| Disallow | /sinaloa/ |
| Disallow | /opinion/ |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments