incandescentgames.net
robots.txt

Robots Exclusion Standard data for incandescentgames.net

Resource Scan

Scan Details

Site Domain incandescentgames.net
Base Domain incandescentgames.net
Scan Status Ok
Last Scan2025-10-24T22:28:51+00:00
Next Scan 2025-11-23T22:28:51+00:00

Last Scan

Scanned2025-10-24T22:28:51+00:00
URL https://incandescentgames.net/robots.txt
Domain IPs 15.204.11.32
Response IP 15.204.11.32
Found Yes
Hash ee0bfed29e6586480a6f761ffaebe60ed9082f69cc0102d29eaddf226219afee
SimHash 407acd10e365

Groups

*

Rule Path
Disallow /dashboard/
Disallow /login/
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • robots.txt for PlanetSmith
  • Allow all web crawlers access to the main site
  • Disallow account-related routes
  • Allow access to all other content
  • Specify the location of your sitemap
  • Block specific crawlers if necessary (Optional)
  • User-agent: BadBot
  • Disallow: /
  • Crawl delay for all bots to reduce server load (Optional)