cliever.com
robots.txt
Robots Exclusion Standard data for cliever.com
Resource Scan
Scan Details
Site Domain | cliever.com |
Base Domain | cliever.com |
Scan Status | Ok |
Last Scan | 2024-11-11T18:15:16+00:00 |
Next Scan | 2024-12-11T18:15:16+00:00 |
Last Scan
Scanned | 2024-11-11T18:15:16+00:00 |
URL | https://www.cliever.com/robots.txt |
Domain IPs | 104.21.73.229, 172.67.167.96, 2606:4700:3032::ac43:a760, 2606:4700:3037::6815:49e5 |
Response IP | 104.21.73.229 |
Found | Yes |
Hash | 47138aae1c6e7a75bf1a33f1d42325111c88971e24fe7d4f34261e54eb3f649f |
SimHash | 650c1741d6bd |
Groups
*
googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-google
google-inspectiontool
googleother
google-extended
apis-google
mediapartners-google
feedfetcher-google
adsbot-google-mobile
googleproducer
google-site-verification
applebot
bingbot
pingdom
pingbot
ahrefssiteaudit
google-safety
seekportbot
bitsightbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
splitsignalbot
semrushbot-coub
petalbot
claritybot
jooblebot
pinterestbot
adidxbot
bingpreview
microsoftpreview
cincraw
adsbot-google
pagepeeker
taboolabot
sitecheckerbotcrawler
monsidobot
seobility
seobilitybot
slackbot-linkexpanding
slack-imgproxy
slackbot
sitescorebot
facebookexternalhit
facebookcatalog
playstore-google
Rule | Path |
---|---|
Allow | / |
Disallow | /loja/carrinho.php* |
Disallow | /loja/pedido.php* |
Disallow | /loja/cartService.php |
Disallow | /loja/pag_parcelado.php* |
Disallow | /*transID* |
Disallow | /checkout* |
Disallow | /loja/comparador.php |
Disallow | /pricing/* |
Disallow | /loja/funcoes/* |
Disallow | /loja/simular_frete2.php* |
Disallow | /nocache/facebook-info.php |
Disallow | /mvc/store/facebook_conversions/event/send |
Disallow | /mvc/store/element/snippets/cart_preview |
Disallow | /checkout/ |
Disallow | /web_api/carts |
Disallow | /web_api/carts/ |
Disallow | /loja/redirect_cart_service.php |
Disallow | /mvc/loja/mercado_livre/ml_clientes/index/ |
Other Records
Field | Value |
---|---|
sitemap | https://cliever3d.commercesuite.com.br/sitemap.xml |