doisirmaoskitcompra.com.br
robots.txt

Robots Exclusion Standard data for doisirmaoskitcompra.com.br

Resource Scan

Scan Details

Site Domain doisirmaoskitcompra.com.br
Base Domain doisirmaoskitcompra.com.br
Scan Status Ok
Last Scan3/28/2025, 7:35:18 AM
Next Scan 4/27/2025, 7:35:18 AM

Last Scan

Scanned3/28/2025, 7:35:18 AM
URL https://doisirmaoskitcompra.com.br/robots.txt
Redirect https://loja.doisirmaoskitcompra.com.br/robots.txt
Redirect Domain loja.doisirmaoskitcompra.com.br
Redirect Base doisirmaoskitcompra.com.br
Domain IPs 186.209.113.242
Redirect IPs 13.226.61.104, 13.226.61.7, 13.226.61.8, 13.226.61.96
Response IP 3.170.229.26
Found Yes
Hash b0626bc43316cd26cc6db9cf58ff57d89b722c7583bbebe151c77561cd11134a
SimHash 7050db65d411

Groups

*
googlebot
googlebot-image
adsbot-google

Rule Path
Allow /
Disallow /conta/*
Disallow /carrinho/*
Disallow /buscar
Disallow /documentacao
Disallow /api/*
Disallow /*fq%3D*
Disallow /compre_junto/*
Disallow /_events/*
Disallow /tracking/convertion
Disallow /static/*
Disallow /store/*

Other Records

Field Value
crawl-delay 10

dirbuster-0.12
baiduspider
baiduspider-video
baiduspider-image
baiduspider+
twengabot-discover
twengabot
twengabot-2.0
mj12bot
bdcbot
spbot
linkpadbot
wbsearchbot
addthis.com robot tech.support@clearspring.com
addthis.com
exabot
yandeximages
yandex
slurp
spbot
ahrefsbot
everyonesocialbot
blexbot
seekport crawler
geedobot
gptbot
chatgpt-user
claude-web
claudebot
anthropic-ai
cohere-ai
bytespider
perplexitybot
diffbot
scrapy
magpie-crawler
ccbot
omgili
omgilibot
node/simplecrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://loja.doisirmaoskitcompra.com.br/sitemap.xml