prego.com.br
robots.txt
Robots Exclusion Standard data for prego.com.br
Resource Scan
Scan Details
Site Domain | prego.com.br |
Base Domain | prego.com.br |
Scan Status | Ok |
Last Scan | 2024-11-13T00:22:29+00:00 |
Next Scan | 2024-12-13T00:22:29+00:00 |
Last Scan
Scanned | 2024-11-13T00:22:29+00:00 |
URL | https://www.prego.com.br/robots.txt |
Domain IPs | 108.157.254.102, 108.157.254.15, 108.157.254.41, 108.157.254.49, 2600:9000:2753:2400:18:6adc:a600:93a1, 2600:9000:2753:2e00:18:6adc:a600:93a1, 2600:9000:2753:3000:18:6adc:a600:93a1, 2600:9000:2753:3c00:18:6adc:a600:93a1, 2600:9000:2753:8400:18:6adc:a600:93a1, 2600:9000:2753:9200:18:6adc:a600:93a1, 2600:9000:2753:e800:18:6adc:a600:93a1, 2600:9000:2753:fa00:18:6adc:a600:93a1 |
Response IP | 108.157.254.102 |
Found | Yes |
Hash | b84205d8f9ed48f5a6517a44425224482e342313c1d338de86b6fd70e769c19c |
SimHash | e818ff474fd5 |
Groups
*
Rule | Path |
---|---|
Disallow | /img/* |
Disallow | /account/* |
Disallow | /login/* |
Disallow | /logout/* |
Disallow | /checkout/* |
Disallow | /quick-view/* |
Disallow | /espiar/* |
Disallow | /esqueci-minha-senha/* |
Disallow | /meu-cadastro/* |
Disallow | /gerenciar-enderecos/* |
Disallow | /checkPassword/* |
Disallow | /nova-senha/* |
Disallow | /meus-pedidos/* |
Disallow | /busca/* |
Disallow | /admin/* |
Allow | /.js$ |
Allow | /.css$ |
Allow | /files |
Other Records
Field | Value |
---|---|
sitemap | https://www.prego.com.br/sitemap.xml |
Comments