opinautos.com
robots.txt
Robots Exclusion Standard data for opinautos.com
Resource Scan
Scan Details
| Site Domain | opinautos.com |
| Base Domain | opinautos.com |
| Scan Status | Ok |
| Last Scan | 2024-09-27T00:41:58+00:00 |
| Next Scan | 2024-10-04T00:41:58+00:00 |
Last Scan
| Scanned | 2024-09-27T00:41:58+00:00 |
| URL | https://opinautos.com/robots.txt |
| Redirect | https://www.opinautos.com/robots.txt |
| Redirect Domain | www.opinautos.com |
| Redirect Base | opinautos.com |
| Domain IPs | 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199 |
| Redirect IPs | 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199 |
| Response IP | 52.20.78.240 |
| Found | Yes |
| Hash | 343e95d2bf30dad57edc78944b34ef6e163f0c688ce7fa16ccd8efb21b424c2f |
| SimHash | f018df52e2a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /miembros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/miembros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /members/profile/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/members/profile/* |
*
| Rule | Path |
|---|---|
| Disallow | /membros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/membros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /auth/register/facebook |
simplepie
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
synthesio
synthesio crawler release monalisa (contact at synthesio dot fr)
proximic
freefind
dblbot
seznambot
caliperbot
mj12bot
spbot
dotbot
omgilibot
omgili
semrushbot-sa
bytedance
bytespider
gptbot
chatgpt-user
ccbot
seekportbot
imagesiftbot
anthropic-ai
claudebot
claude-web
awariorssbot
awariosmartbot
cohere-ai
img2dataset
magpie-crawler
meltwater
piplbot
seekr
applebot-extended
| Rule | Path |
|---|---|
| Disallow | / |