Log In Sign Up

lemmymorgan.com
robots.txt

Robots Exclusion Standard data for lemmymorgan.com

Resource Scan

Scan Details

Site Domain lemmymorgan.com
Base Domain lemmymorgan.com
Scan Status Ok
Last Scan6/13/2025, 6:31:47 AM
Next Scan 6/20/2025, 6:31:47 AM

Last Scan

Scanned6/13/2025, 6:31:47 AM
URL https://lemmymorgan.com/robots.txt
Domain IPs 104.21.82.42, 172.67.194.245, 2606:4700:3031::ac43:c2f5, 2606:4700:3035::6815:522a
Response IP 104.21.82.42
Found Yes
Hash afbefa3c04df370cdfb198ca51c51e4d2ca7624c7b894b48ce1881391af54af7
SimHash 5908c8c0e592

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

adsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.lemmymorgan.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top