Log In Sign Up

light-and-dance.com
robots.txt

Robots Exclusion Standard data for light-and-dance.com

Resource Scan

Scan Details

Site Domain light-and-dance.com
Base Domain light-and-dance.com
Scan Status Ok
Last Scan2026-02-27T09:01:36+00:00
Next Scan 2026-03-29T09:01:36+00:00

Last Scan

Scanned2026-02-27T09:01:36+00:00
URL https://light-and-dance.com/robots.txt
Domain IPs 185.198.232.19, 2a13:6602:1::10
Response IP 185.198.232.19
Found Yes
Hash 54b895124dba090a2376ad43442d0c855011e99047bd49f64e532473635d4109
SimHash 211edd736796

Groups

*

Rule Path
Allow /
Allow /css/
Allow /js/
Allow /Images/
Disallow /private/
Disallow /*.log$
Disallow /temp/
Disallow /cache/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

badbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://light-and-dance.com/sitemap.xml
Back to top

Comments

  • Allow all search engines to crawl the site
  • Disallow sensitive or unnecessary files
  • Sitemap location
  • Crawl delay (optional, helps with server load)
  • Specific rules for major search engines
  • Block bad bots
Back to top