canaldapeca.com.br
robots.txt

Robots Exclusion Standard data for canaldapeca.com.br

Resource Scan

Scan Details

Site Domain canaldapeca.com.br
Base Domain canaldapeca.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T14:01:03+00:00
Next Scan 2024-10-03T14:01:03+00:00

Last Successful Scan

Scanned2024-08-27T09:56:43+00:00
URL https://canaldapeca.com.br/robots.txt
Domain IPs 54.207.23.193, 54.233.140.196
Response IP 54.207.23.193
Found Yes
Hash e3d7988e447d939671b15a5f4167d67a72733934ec554c9cb7f50335bf816427
SimHash 6256d8525a11

Groups

*

Rule Path
Allow

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Disallow /login
Disallow /logout
Disallow /securityInfo
Disallow /recuperar-senha
Disallow /enviar-verificacao
Disallow /nova-senha
Disallow /cadastrar
Disallow /completar-cadastro
Disallow /minha-conta
Disallow /rest
Disallow /termos-de-uso
Disallow /termos-de-uso-modal
Disallow /politica-de-privacidade
Disallow /politica-de-privacidade-modal
Disallow /duvidas-frequentes
Disallow /duvidas-frequentes-modal
Disallow /contato
Disallow /contato-modal
Disallow /carrinho
Disallow /escolher-oficina
Disallow /escolha-frete
Disallow /escolher-endereco
Disallow /gerar-pedido
Disallow /criar-endereco
Disallow /buscar-endereco
Disallow /efetuar-pagamento
Disallow /processar-pagamento
Disallow /sucesso
Disallow /autocomplete
Disallow /categoria/autopecas/black-friday-2015
Disallow /catalogos
Disallow /badgeBySkuId
Disallow */vendedores
Disallow /customError
Disallow /*/orcamento-express

etaospider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1