wine-food-matcher.com
robots.txt

Robots Exclusion Standard data for wine-food-matcher.com

Resource Scan

Scan Details

Site Domain wine-food-matcher.com
Base Domain wine-food-matcher.com
Scan Status Ok
Last Scan2024-10-07T07:14:05+00:00
Next Scan 2024-10-14T07:14:05+00:00

Last Scan

Scanned2024-10-07T07:14:05+00:00
URL https://wine-food-matcher.com/robots.txt
Redirect https://www.wine-food-matcher.com/robots.txt
Redirect Domain www.wine-food-matcher.com
Redirect Base wine-food-matcher.com
Domain IPs 213.186.33.2
Redirect IPs 213.186.33.2
Response IP 213.186.33.2
Found Yes
Hash 4a7b6f818fed555081b1ceab0c3fa07a365bcb414f45634d036ad963f0619754
SimHash 196dc7242fc0

Groups

cliqzbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /