weine-des-piemont.com
robots.txt

Robots Exclusion Standard data for weine-des-piemont.com

Resource Scan

Scan Details

Site Domain weine-des-piemont.com
Base Domain weine-des-piemont.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-03T03:01:12+00:00
Next Scan 2026-01-01T03:01:12+00:00

Last Successful Scan

Scanned2023-03-18T15:20:57+00:00
URL https://weine-des-piemont.com/robots.txt
Domain IPs 176.9.76.189
Response IP 176.9.76.189
Found Yes
Hash 2bb886d9408d3126f519a889bcb3c54d71932bfcb9baa9ef76737acc8a29eb5b
SimHash 803446557732

Groups

googlebot-image

Rule Path
Allow /vac/5457/

*

Rule Path
Disallow /vac/
Disallow /intern/
Disallow /maila/
Disallow /pic/
Disallow /pics/
Disallow /js/
Disallow /pix/
Disallow /cadm/
Disallow /adm/
Disallow /*.xml$
Disallow /*.flv$
Disallow /*.swf$

sistrix

Rule Path
Disallow /

googlebot

Rule Path
Allow /vac/5457/
Disallow /vac/
Disallow /intern/
Disallow /maila/
Disallow /pic/
Disallow /pics/
Disallow /js/
Disallow /pix/
Disallow /cadm/
Disallow /adm/

ahrefsbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow *

npbot

Rule Path
Disallow *

fasterfox

Rule Path
Disallow /

semanticdiscovery

Rule Path
Disallow *

googlebot-image

Rule Path
Allow /vac/5457/
Disallow /
Disallow /vac/
Disallow /pic/
Disallow /pics/
Disallow /pix/
Disallow /includes/

mediapartners-google

Rule Path
Allow /vac/5457/

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow

Warnings

  • 2 invalid lines.