Log In Sign Up

deliciousemade.com
robots.txt

Robots Exclusion Standard data for deliciousemade.com

Resource Scan

Scan Details

Site Domain deliciousemade.com
Base Domain deliciousemade.com
Scan Status Ok
Last Scan2026-03-24T11:10:46+00:00
Next Scan 2026-03-31T11:10:46+00:00

Last Scan

Scanned2026-03-24T11:10:46+00:00
URL https://deliciousemade.com/robots.txt
Domain IPs 2a02:4780:a:2042:0:356c:c7d8:6, 88.222.216.29
Response IP 88.222.216.29
Found Yes
Hash 37f95ee6b78ec782daa8566879e4174d1cfeb111ed4e7502882c356b828f2aff
SimHash 60169f1363c0

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap http://deliciousemade.com/sitemap.xml
Back to top

Comments

  • Robots.txt for http://deliciousemade.com/
  • Allow all web crawlers to access the entire site
  • Sitemap location (update this URL if you have a sitemap)
  • Optional: Crawl delay (uncomment if needed to slow down aggressive crawlers)
  • Crawl-delay: 1
  • Block access to specific directories (uncomment and modify as needed)
  • Disallow: /admin/
  • Disallow: /private/
  • Disallow: /temp/
  • Disallow: /*.pdf$
  • Allow specific search engines (examples)
  • User-agent: Googlebot
  • Allow: /
  • User-agent: Bingbot
  • Allow: /
Back to top