Log In Sign Up

incandescentgames.co.uk
robots.txt

Robots Exclusion Standard data for incandescentgames.co.uk

Resource Scan

Scan Details

Site Domain incandescentgames.co.uk
Base Domain incandescentgames.co.uk
Scan Status Ok
Last Scan2025-11-15T06:00:54+00:00
Next Scan 2025-12-15T06:00:54+00:00

Last Scan

Scanned2025-11-15T06:00:54+00:00
URL https://incandescentgames.co.uk/robots.txt
Domain IPs 15.204.11.32
Response IP 15.204.11.32
Found Yes
Hash ee0bfed29e6586480a6f761ffaebe60ed9082f69cc0102d29eaddf226219afee
SimHash 407acd10e365

Groups

*

Rule Path
Disallow /dashboard/
Disallow /login/
Allow /

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap /sitemap.xml
Back to top

Comments

  • robots.txt for PlanetSmith
  • Allow all web crawlers access to the main site
  • Disallow account-related routes
  • Allow access to all other content
  • Specify the location of your sitemap
  • Block specific crawlers if necessary (Optional)
  • User-agent: BadBot
  • Disallow: /
  • Crawl delay for all bots to reduce server load (Optional)
Back to top