enjoydevelopment.com
robots.txt

Robots Exclusion Standard data for enjoydevelopment.com

Resource Scan

Scan Details

Site Domain enjoydevelopment.com
Base Domain enjoydevelopment.com
Scan Status Ok
Last Scan2025-12-06T13:11:35+00:00
Next Scan 2026-01-05T13:11:35+00:00

Last Scan

Scanned2025-12-06T13:11:35+00:00
URL https://enjoydevelopment.com/robots.txt
Redirect https://www.enjoydevelopment.com/robots.txt
Redirect Domain www.enjoydevelopment.com
Redirect Base enjoydevelopment.com
Domain IPs 216.150.1.1
Redirect IPs 216.150.1.193, 216.150.16.193
Response IP 216.150.16.1
Found Yes
Hash e4e7b5da57fe73aadd80101f3a9a8c1b9362caa05fa599b70efb2ea36350641a
SimHash 6790e941e62f

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://enjoydevelopment.com/sitemap.xml

Comments

  • Enjoy Development - robots.txt
  • Allow all crawlers including AI models
  • AI Crawlers - Explicitly allow for AI optimization
  • Sitemap
  • Crawl-delay (optional, helps prevent server overload)