shop.avira.com
robots.txt

Robots Exclusion Standard data for shop.avira.com

Resource Scan

Scan Details

Site Domain shop.avira.com
Base Domain avira.com
Scan Status Ok
Last Scan2024-11-02T05:37:28+00:00
Next Scan 2024-11-16T05:37:28+00:00

Last Scan

Scanned2024-11-02T05:37:28+00:00
URL https://shop.avira.com/robots.txt
Domain IPs 104.16.242.229, 104.16.243.229
Response IP 104.16.243.229
Found Yes
Hash fce4974e85623ce8dd5788086a738c75edd0e5472da3691a1292b14e0ad0f59f
SimHash 085791a3e841

Groups

*

Rule Path
Disallow /*/dk/
Disallow /*/p/
Disallow /*/pl/
Disallow /*/cp/
Disallow /*/s/
Disallow /*/smcx/
Disallow /*/cmcx/
Disallow /ajax/
Disallow /mail/
Disallow /pinvoice/
Disallow /invoice/
Disallow /2/
Disallow /10/
Disallow /16/
Disallow /26/
Disallow /30/
Disallow /36/
Disallow /40/
Disallow /59/
Disallow /148/
Disallow /156/
Disallow /243/
Disallow /278/
Disallow /282/
Disallow /300/
Disallow /305/
Disallow /329/
Disallow /342/
Disallow /355/
Disallow /380/
Disallow /389/
Disallow /400/
Disallow /502/
Disallow /505/
Disallow /540/
Disallow /542/
Disallow /576/
Disallow /582/
Disallow /627/
Disallow /682/
Disallow /747/
Disallow /767/
Disallow /781/
Disallow /848/
Disallow /849/
Disallow /852/
Disallow /865/
Disallow /881/
Disallow /884/
Disallow /1087/
Disallow /1103/
Disallow /1184/
Disallow /1316/
Disallow /1809/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

gwm-gsa-crawler

Rule Path
Disallow /

linguee

Rule Path
Disallow /

sosospider

Rule Path
Disallow /10/
Disallow /16/
Disallow /60/
Disallow /80/
Disallow /148/
Disallow /250/
Disallow /278/
Disallow /304/
Disallow /355/
Disallow /389/
Disallow /405/
Disallow /429/
Disallow /542/
Disallow /582/
Disallow /592/
Disallow /624/
Disallow /671/
Disallow /682/
Disallow /710/
Disallow /750/
Disallow /781/
Disallow /841/
Disallow /848/
Disallow /852/

bingbot

Rule Path
Disallow /*/csi/
Disallow /*/asi/
Disallow /1087/

appcodescrawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

fatbot 2.0

Rule Path
Disallow /

ahc/1.0

Rule Path
Disallow /

ahc/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bluechipbacklinks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

caliperbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /