wine-sources.com
robots.txt

Robots Exclusion Standard data for wine-sources.com

Resource Scan

Scan Details

Site Domain wine-sources.com
Base Domain wine-sources.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-01T01:05:25+00:00
Next Scan 2025-12-30T01:05:25+00:00

Last Successful Scan

Scanned2023-03-16T17:12:19+00:00
URL https://wine-sources.com/robots.txt
Domain IPs 176.9.76.189
Response IP 176.9.76.189
Found Yes
Hash 2bb886d9408d3126f519a889bcb3c54d71932bfcb9baa9ef76737acc8a29eb5b
SimHash 803446557732

Groups

googlebot-image

Rule Path
Allow /vac/5457/

*

Rule Path
Disallow /vac/
Disallow /intern/
Disallow /maila/
Disallow /pic/
Disallow /pics/
Disallow /js/
Disallow /pix/
Disallow /cadm/
Disallow /adm/
Disallow /*.xml$
Disallow /*.flv$
Disallow /*.swf$

sistrix

Rule Path
Disallow /

googlebot

Rule Path
Allow /vac/5457/
Disallow /vac/
Disallow /intern/
Disallow /maila/
Disallow /pic/
Disallow /pics/
Disallow /js/
Disallow /pix/
Disallow /cadm/
Disallow /adm/

ahrefsbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow *

npbot

Rule Path
Disallow *

fasterfox

Rule Path
Disallow /

semanticdiscovery

Rule Path
Disallow *

googlebot-image

Rule Path
Allow /vac/5457/
Disallow /
Disallow /vac/
Disallow /pic/
Disallow /pics/
Disallow /pix/
Disallow /includes/

mediapartners-google

Rule Path
Allow /vac/5457/

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow

Warnings

  • 2 invalid lines.