Log In Sign Up

spellspace.com
robots.txt

Robots Exclusion Standard data for spellspace.com

Resource Scan

Scan Details

Site Domain spellspace.com
Base Domain spellspace.com
Scan Status Ok
Last Scan2025-10-26T07:35:09+00:00
Next Scan 2025-11-02T07:35:09+00:00

Last Scan

Scanned2025-10-26T07:35:09+00:00
URL http://spellspace.com/robots.txt
Redirect https://tarotroom.com/robots.txt
Redirect Domain tarotroom.com
Redirect Base tarotroom.com
Domain IPs 104.42.128.171
Redirect IPs 104.40.63.98
Response IP 104.40.63.98
Found Yes
Hash 2381a008d0a9f5cda3f3961002a5b2582d59163c920e27a8fd8e048f38aa79bb
SimHash 6e0399596545

Groups

*

Rule Path
Allow /Content/
Allow /Scripts/
Allow /bundles/
Disallow /bin/
Disallow /Controls/
Disallow /Services/
Disallow /api/
Disallow /account/
Disallow /profile/
Disallow /login/
Disallow /logout/
Disallow /signin/

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://tarotroom.com/sitemap.xml
Back to top

Comments

  • SEO-optimized robots.txt for tarotroom.com
  • This version combines best practices for a classic ASP.NET site using bundling.
  • Allow important asset folders and bundled resources for rendering
  • Disallow application folders, user controls, and services
  • Disallow user-specific pages that should not be indexed
  • A gentle delay for crawlers to manage server load (optional, as Google may ignore)
  • Location of the sitemap
Back to top