sip-sak.vertaafood.fi
robots.txt

Robots Exclusion Standard data for sip-sak.vertaafood.fi

Resource Scan

Scan Details

Site Domain sip-sak.vertaafood.fi
Base Domain vertaafood.fi
Scan Status Ok
Last Scan2025-09-24T13:52:42+00:00
Next Scan 2025-10-24T13:52:42+00:00

Last Scan

Scanned2025-09-24T13:52:42+00:00
URL https://sip-sak.vertaafood.fi/robots.txt
Domain IPs 104.21.55.64, 172.67.145.94, 2606:4700:3033::6815:3740, 2606:4700:3037::ac43:915e
Response IP 104.21.55.64
Found Yes
Hash c029c5a77e6cd850822c98dff054d767e687f51103bef6d32547d1125f8f3f40
SimHash 54c04d4545b4

Groups

*

Rule Path
Allow /index
Allow /menus
Allow /buffet
Allow /rest-info
Allow /ratings
Disallow /myorders
Disallow /vouchers
Disallow /vouchershistory
Disallow /profile
Disallow /addressbook
Disallow /checkouts
Disallow /users/social_redirect

googlebot

Rule Path
Allow /index

googlebot-image

Rule Path
Allow /index

bingbot

Rule Path
Allow /index

discordbot

Rule Path
Allow /index

facebookexternalhit

Rule Path
Allow /index

applebot

Rule Path
Allow /index

linkedinbot

Rule Path
Allow /index

pinterestbot

Rule Path
Allow /index

twitterbot

Rule Path
Allow /index

yandex

Rule Path
Allow /index

Comments

  • General settings for all crawlers
  • Specific rules for certain bots (optional)