Log In Sign Up

goodmecano.com
robots.txt

Robots Exclusion Standard data for goodmecano.com

Resource Scan

Scan Details

Site Domain goodmecano.com
Base Domain goodmecano.com
Scan Status Ok
Last Scan4/17/2025, 3:04:50 PM
Next Scan 4/24/2025, 3:04:50 PM

Last Scan

Scanned4/17/2025, 3:04:50 PM
URL https://goodmecano.com/robots.txt
Redirect https://www.goodmecano.com/robots.txt
Redirect Domain www.goodmecano.com
Redirect Base goodmecano.com
Domain IPs 104.26.0.116, 104.26.1.116, 172.67.73.195, 2606:4700:20::681a:174, 2606:4700:20::681a:74, 2606:4700:20::ac43:49c3
Redirect IPs 104.26.0.116, 104.26.1.116, 172.67.73.195, 2606:4700:20::681a:174, 2606:4700:20::681a:74, 2606:4700:20::ac43:49c3
Response IP 104.26.0.116
Found Yes
Hash 547d91910afffcf8688f9a93deab829233d296ab969cf6de333bdb931784684d
SimHash 503089d1c7c5

Groups

googlebot

Rule Path
Disallow

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

octopus

Rule Path
Disallow /

omgili1

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

*

Rule Path
Allow /mechanic/details
Allow /website/static/
Disallow /mechanic/
Disallow /website/
Disallow /require/
Back to top

Comments

  • Allow full access to Googlebot
  • Block specific AI crawlers
  • Specific allows and disallows for all other bots
Back to top