Log In Sign Up

toastware-games.com
robots.txt

Robots Exclusion Standard data for toastware-games.com

Resource Scan

Scan Details

Site Domain toastware-games.com
Base Domain toastware-games.com
Scan Status Ok
Last Scan2025-11-10T06:20:31+00:00
Next Scan 2025-11-17T06:20:31+00:00

Last Scan

Scanned2025-11-10T06:20:31+00:00
URL https://toastware-games.com/robots.txt
Domain IPs 160.153.0.93
Response IP 160.153.0.93
Found Yes
Hash ec6d793e5660dd63e57771467635ad0beaff8652c2a47883126e5db8adf62ded
SimHash a10ccd116180

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://toastware-games.com/sitemap.xml
Back to top

Comments

  • robots.txt for toastware-games.com
  • Allow all search engines to crawl the entire site
  • Sitemap location
  • Optional: Crawl delay to prevent server overload (uncomment if needed)
  • Crawl-delay: 10
  • Disallow access to common backend/private directories (if they exist)
  • Uncomment these lines if you have these directories and want to protect them
  • Disallow: /admin/
  • Disallow: /cgi-bin/
  • Disallow: /tmp/
  • Disallow: /private/
Back to top