cerealistasbrasil.com.br
robots.txt
Robots Exclusion Standard data for cerealistasbrasil.com.br
Resource Scan
Scan Details
| Site Domain | cerealistasbrasil.com.br |
| Base Domain | cerealistasbrasil.com.br |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-15T02:47:53+00:00 |
| Next Scan | 2024-12-14T02:47:53+00:00 |
Last Successful Scan
| Scanned | 2024-07-25T02:19:27+00:00 |
| URL | https://cerealistasbrasil.com.br/robots.txt |
| Redirect | https://www.cerealistasbrasil.com.br/robots.txt |
| Redirect Domain | www.cerealistasbrasil.com.br |
| Redirect Base | cerealistasbrasil.com.br |
| Domain IPs | 177.67.112.238 |
| Redirect IPs | 179.191.175.66, 179.191.175.67, 179.191.175.68, 179.191.175.70, 179.191.175.71, 179.191.175.73, 179.191.175.74, 179.191.177.66, 179.191.177.68, 179.191.177.77 |
| Response IP | 179.191.175.70 |
| Found | Yes |
| Hash | 36cbfe925be87a6984c2c22e30c02860f95a649e72a43a9979456f49199f255b |
| SimHash | 6d0e17c192bf |
Groups
*
googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-google
google-inspectiontool
googleother
google-extended
apis-google
mediapartners-google
feedfetcher-google
adsbot-google-mobile
googleproducer
google-site-verification
applebot
bingbot
pingdom
pingbot
ahrefssiteaudit
google-safety
seekportbot
bitsightbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
petalbot
claritybot
jooblebot
pinterestbot
adidxbot
bingpreview
microsoftpreview
cincraw
adsbot-google
pagepeeker
taboolabot
sitecheckerbotcrawler
monsidobot
seobility
seobilitybot
slackbot-linkexpanding
slack-imgproxy
slackbot
sitescorebot
facebookexternalhit
facebookcatalog
playstore-google
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /loja/carrinho.php* |
| Disallow | /loja/cartService.php |
| Disallow | /loja/pag_parcelado.php* |
| Disallow | /*transID* |
| Disallow | /checkout* |
| Disallow | /loja/comparador.php |
| Disallow | /pricing/* |
| Disallow | /loja/funcoes/* |
| Disallow | /loja/simular_frete2.php* |
| Disallow | /nocache/facebook-info.php |
| Disallow | /mvc/store/facebook_conversions/event/send |
| Disallow | /mvc/store/element/snippets/cart_preview |
| Disallow | /checkout/ |
| Disallow | /web_api/carts |
| Disallow | /web_api/carts/ |
| Disallow | /loja/redirect_cart_service.php |
| Disallow | /mvc/loja/mercado_livre/ml_clientes/index/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cerealistasbrasil.com.br/sitemap.xml |