Log In Sign Up

spacer.com
robots.txt

Robots Exclusion Standard data for spacer.com

Resource Scan

Scan Details

Site Domain spacer.com
Base Domain spacer.com
Scan Status Ok
Last Scan2025-12-07T18:41:21+00:00
Next Scan 2026-01-06T18:41:21+00:00

Last Scan

Scanned2025-12-07T18:41:21+00:00
URL https://spacer.com/robots.txt
Redirect https://www.spacer.com/robots.txt
Redirect Domain www.spacer.com
Redirect Base spacer.com
Domain IPs 104.26.14.99, 104.26.15.99, 172.67.72.239, 2606:4700:20::681a:e63, 2606:4700:20::681a:f63, 2606:4700:20::ac43:48ef
Redirect IPs 104.26.14.99, 104.26.15.99, 172.67.72.239, 2606:4700:20::681a:e63, 2606:4700:20::681a:f63, 2606:4700:20::ac43:48ef
Response IP 104.26.14.99
Found Yes
Hash c7949a712dcc22ac1140c568a7fe70c0b11237076c0409e0554deab4e9370625
SimHash a2852d8de550

Groups

*

Rule Path
Disallow /en/waitlists/
Disallow /fr/waitlists/
Disallow /cdn-cgi/
Back to top

Other Records

Field Value
sitemap https://www.spacer.com/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Disallow: /
Back to top