Log In Sign Up

tomsund.com
robots.txt

Robots Exclusion Standard data for tomsund.com

Resource Scan

Scan Details

Site Domain tomsund.com
Base Domain tomsund.com
Scan Status Ok
Last Scan2025-10-10T03:45:37+00:00
Next Scan 2025-11-09T03:45:37+00:00

Last Scan

Scanned2025-10-10T03:45:37+00:00
URL https://tomsund.com/robots.txt
Domain IPs 104.21.70.123, 172.67.223.103, 2606:4700:3032::ac43:df67, 2606:4700:3035::6815:467b
Response IP 172.67.223.103
Found Yes
Hash 35cc9ad7acffbdc0de691508de6ee70b2bafd6d01f35782ff0e439177831424f
SimHash 7810dfc1c577

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

instagrambot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

pinterestbot

Rule Path
Allow /

applebot

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Comments

  • robots.txt file for your website
  • Allow Google
  • Allow Google Image
  • Allow Bing
  • Allow Yahoo
  • Allow Baidu
  • Allow Yandex
  • Allow DuckDuckGo
  • Allow Facebook
  • Allow Twitter
  • Allow Instagram
  • Allow LinkedIn
  • Allow Pinterest
  • Allow Apple
  • Default rule for all other bots
Back to top