caicobrindes.net.br
robots.txt
Robots Exclusion Standard data for caicobrindes.net.br
Resource Scan
Scan Details
Site Domain | caicobrindes.net.br |
Base Domain | caicobrindes.net.br |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-19T13:17:26+00:00 |
Next Scan | 2024-12-18T13:17:26+00:00 |
Last Successful Scan
Scanned | 2024-07-29T08:59:37+00:00 |
URL | https://www.caicobrindes.net.br/robots.txt |
Domain IPs | 179.191.175.66, 179.191.175.67, 179.191.175.68, 179.191.175.70, 179.191.175.71, 179.191.175.72, 179.191.175.73, 179.191.175.74, 179.191.177.68 |
Response IP | 179.191.175.66 |
Found | Yes |
Hash | c23032af303c3667a22210ce88a5a2145c8a6b6d0ca21e3e8f09729d3a67348c |
SimHash | 6d0e17c190bd |
Groups
*
googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-google
google-inspectiontool
googleother
google-extended
apis-google
mediapartners-google
feedfetcher-google
adsbot-google-mobile
googleproducer
google-site-verification
applebot
bingbot
pingdom
pingbot
ahrefssiteaudit
google-safety
seekportbot
bitsightbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
petalbot
claritybot
jooblebot
pinterestbot
adidxbot
bingpreview
microsoftpreview
cincraw
adsbot-google
pagepeeker
taboolabot
sitecheckerbotcrawler
monsidobot
seobility
seobilitybot
slackbot-linkexpanding
slack-imgproxy
slackbot
sitescorebot
facebookexternalhit
facebookcatalog
playstore-google
Rule | Path |
---|---|
Allow | / |
Disallow | /loja/carrinho.php* |
Disallow | /loja/cartService.php |
Disallow | /loja/pag_parcelado.php* |
Disallow | /*transID* |
Disallow | /checkout* |
Disallow | /loja/comparador.php |
Disallow | /pricing/* |
Disallow | /loja/funcoes/* |
Disallow | /loja/simular_frete2.php* |
Disallow | /nocache/facebook-info.php |
Disallow | /mvc/store/facebook_conversions/event/send |
Disallow | /mvc/store/element/snippets/cart_preview |
Disallow | /checkout/ |
Disallow | /web_api/carts |
Disallow | /web_api/carts/ |
Disallow | /loja/redirect_cart_service.php |
Disallow | /mvc/loja/mercado_livre/ml_clientes/index/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.caicobrindes.net.br/sitemap.xml |