opinautos.com
robots.txt
Robots Exclusion Standard data for opinautos.com
Resource Scan
Scan Details
| Site Domain | opinautos.com |
| Base Domain | opinautos.com |
| Scan Status | Ok |
| Last Scan | 2024-06-13T15:49:02+00:00 |
| Next Scan | 2024-06-20T15:49:02+00:00 |
Last Scan
| Scanned | 2024-06-13T15:49:02+00:00 |
| URL | https://opinautos.com/robots.txt |
| Redirect | https://www.opinautos.com/robots.txt |
| Redirect Domain | www.opinautos.com |
| Redirect Base | opinautos.com |
| Domain IPs | 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199 |
| Redirect IPs | 3.220.57.224, 3.232.242.170, 52.20.78.240, 54.91.59.199 |
| Response IP | 54.91.59.199 |
| Found | Yes |
| Hash | c04125df1e2b89e3f0eff0a1233cbe79a84bba5377b9a622148d8f7c2a720f80 |
| SimHash | 7018df52e4a5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /miembros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/miembros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /members/profile/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/members/profile/* |
*
| Rule | Path |
|---|---|
| Disallow | /membros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /*/membros/perfil/* |
*
| Rule | Path |
|---|---|
| Disallow | /auth/register/facebook |
simplepie
simplepie/1.1.3 (feed parser; http://simplepie.org; allow like gecko) build/20081219
synthesio
synthesio crawler release monalisa (contact at synthesio dot fr)
proximic
freefind
dblbot
seznambot
caliperbot
mj12bot
spbot
dotbot
omgilibot
omgili
semrushbot-sa
bytedance
bytespider
gptbot
chatgpt-user
ccbot
seekportbot
imagesiftbot
anthropic-ai
claudebot
claude-web
awariorssbot
awariosmartbot
cohere-ai
img2dataset
magpie-crawler
meltwater
piplbot
seekr
| Rule | Path |
|---|---|
| Disallow | / |