Log In Sign Up

flirtrecipes.com
robots.txt

Robots Exclusion Standard data for flirtrecipes.com

Resource Scan

Scan Details

Site Domain flirtrecipes.com
Base Domain flirtrecipes.com
Scan Status Ok
Last Scan2026-02-09T21:29:18+00:00
Next Scan 2026-02-16T21:29:18+00:00

Last Scan

Scanned2026-02-09T21:29:18+00:00
URL https://flirtrecipes.com/robots.txt
Domain IPs 2a02:4780:84:1c3c:1f4a:6926:a8e2:938a, 2a02:4780:84:53bd:3db4:9b8:bcad:fce1, 84.32.84.205, 84.32.84.25
Response IP 77.37.66.164
Found Yes
Hash bf7eec70d9094240ca2605e50f606d26771c11efa68b8e62ec7bd1f96c254f64
SimHash 40169f3363c0

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.flirtrecipes.com/sitemap.xml
Back to top

Comments

  • Robots.txt for https://www.flirtrecipes.com/
  • Allow all web crawlers to access the entire site
  • Sitemap location (update this URL if you have a sitemap)
  • Optional: Crawl delay (uncomment if needed to slow down aggressive crawlers)
  • Crawl-delay: 1
  • Block access to specific directories (uncomment and modify as needed)
  • Disallow: /admin/
  • Disallow: /private/
  • Disallow: /temp/
  • Disallow: /*.pdf$
  • Allow specific search engines (examples)
  • User-agent: Googlebot
  • Allow: /
  • User-agent: Bingbot
  • Allow: /
Back to top