Log In Sign Up

itest.bbspink.com
robots.txt

Robots Exclusion Standard data for itest.bbspink.com

Resource Scan

Scan Details

Site Domain itest.bbspink.com
Base Domain bbspink.com
Scan Status Ok
Last Scan2026-01-27T07:11:05+00:00
Next Scan 2026-02-26T07:11:05+00:00

Last Scan

Scanned2026-01-27T07:11:05+00:00
URL https://itest.bbspink.com/robots.txt
Domain IPs 104.21.26.15, 172.67.135.35, 2606:4700:3033::ac43:8723, 2606:4700:3035::6815:1a0f
Response IP 172.67.135.35
Found Yes
Hash ad0bae2c80a331e170c4b7a65b9e29569f662e4aefd22e637f2d284f35ad0c3b
SimHash b2850d8d7550

Groups

*

Rule Path
Disallow /cdn-cgi/
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top