farmaciaitaliashop.com
robots.txt

Robots Exclusion Standard data for farmaciaitaliashop.com

Resource Scan

Scan Details

Site Domain farmaciaitaliashop.com
Base Domain farmaciaitaliashop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-16T05:40:26+00:00
Next Scan 2024-06-15T05:40:26+00:00

Last Successful Scan

Scanned2024-03-25T05:32:31+00:00
URL https://farmaciaitaliashop.com/robots.txt
Redirect https://farmaciaitalia-shop.com/robots.txt
Redirect Domain farmaciaitalia-shop.com
Redirect Base farmaciaitalia-shop.com
Domain IPs 104.21.52.188, 172.67.202.220, 2606:4700:3030::6815:34bc, 2606:4700:3034::ac43:cadc
Redirect IPs 104.21.41.19, 172.67.189.9, 2606:4700:3030::6815:2913, 2606:4700:3037::ac43:bd09
Response IP 104.21.41.19
Found Yes
Hash 631fbaa059339f039b4c23089bbcc3c751ba06e2405aefe54531b6b9ba99c815
SimHash 0c0d5379e513

Groups

*

Rule Path
Disallow /cdn-cgi/l/email-protection
Disallow *?limit=*
Disallow */manufacturer*
Disallow */create-account/*
Disallow */login*
Disallow */search*
Disallow */transactions*
Disallow *route*
Disallow */cart/*
Disallow */checkout*
Disallow *sort%3D*
Disallow *order%3D*
Disallow */mfp/*
Disallow */logout*
Allow *.jpg*
Allow *.jpeg*
Allow *.js*
Allow *.css*
Allow *.png*
Allow *.gif*
Allow *.svg*
Allow *.webp*
Allow *.pdf*

ccbot
google-extended
gptbot
chatgpt-user
omgilibot
omgili
facebookbot
anthropic-ai
cohere-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://farmaciaitalia-shop.com/sitemap.xml
sitemap https://farmaciaitalia-shop.com/video-sitemap.xml