soycarmin.com
robots.txt
Robots Exclusion Standard data for soycarmin.com
Resource Scan
Scan Details
| Site Domain | soycarmin.com |
| Base Domain | soycarmin.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-10-22T10:35:19+00:00 |
| Next Scan | 2025-11-05T10:35:19+00:00 |
Last Successful Scan
| Scanned | 2025-10-07T09:37:34+00:00 |
| URL | https://soycarmin.com/robots.txt |
| Redirect | https://www.soycarmin.com/robots.txt |
| Redirect Domain | www.soycarmin.com |
| Redirect Base | soycarmin.com |
| Domain IPs | 104.21.75.95, 172.67.219.97, 2606:4700:3031::ac43:db61, 2606:4700:3035::6815:4b5f |
| Redirect IPs | 2600:9000:2024:1a00:12:5bf4:cd40:93a1, 2600:9000:2024:3000:12:5bf4:cd40:93a1, 2600:9000:2024:3400:12:5bf4:cd40:93a1, 2600:9000:2024:4c00:12:5bf4:cd40:93a1, 2600:9000:2024:b400:12:5bf4:cd40:93a1, 2600:9000:2024:d000:12:5bf4:cd40:93a1, 2600:9000:2024:e00:12:5bf4:cd40:93a1, 2600:9000:2024:ea00:12:5bf4:cd40:93a1, 52.84.45.115, 52.84.45.117, 52.84.45.13, 52.84.45.18 |
| Response IP | 65.9.112.97 |
| Found | Yes |
| Hash | 23113bbb47c6a7327bdf38c52eb54711720b395e8166a3257c428ef4c0e88c2a |
| SimHash | 205c5380c4a5 |
Groups
applebot
baiduspider
bingbot
discordbot
facebookexternalhit
facebookbot
googlebot
googlebot-news
googlebot-mobile
mediapartners-google
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
googlebot-image
googlebot-video
storebot-google
apis-google
linkedinbot
msnbot
naverbot
pinterestbot
petalbot
seznambot
slurp
teoma
telegrambot
twitterbot
yeti
exabot
criteobot/0.1
duckduckbot
amazonadbot
adidxbot
bingpreview
microsoftpreview
googleother
googleother-image
googleother-video
google-inspectiontool
oai-searchbot
perplexitybot
claude-searchbot
meta-webindexer
meta-externalads
grapeshot
| Rule | Path |
|---|---|
| Disallow | /_req/ |
| Disallow | /*contenidos/ |
| Disallow | /vipcontent/ |
| Disallow | /buscar.html |
| Allow | / |
anthropic-ai
applebot-extended
gptbot
claudebot
duckassistbot
google-extended
meta-externalagent
| Rule | Path |
|---|---|
| Disallow | /_req/ |
| Disallow | /*contenidos/ |
| Disallow | /vipcontent/ |
| Disallow | /22655596684/ |
| Disallow | /noticias/*/ |
| Disallow | /entretenimiento/*/ |
| Disallow | /buscar.html |
| Disallow | /sinaloa/ |
| Disallow | /opinion/ |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments