Log In Sign Up

computerbb.org
robots.txt

Robots Exclusion Standard data for computerbb.org

Resource Scan

Scan Details

Site Domain computerbb.org
Base Domain computerbb.org
Scan Status Ok
Last Scan2025-11-09T23:30:16+00:00
Next Scan 2025-12-09T23:30:16+00:00

Last Scan

Scanned2025-11-09T23:30:16+00:00
URL https://computerbb.org/robots.txt
Redirect https://www.computerbb.org/robots.txt
Redirect Domain www.computerbb.org
Redirect Base computerbb.org
Domain IPs 104.21.48.170, 172.67.187.102, 2606:4700:3037::6815:30aa, 2606:4700:3037::ac43:bb66
Redirect IPs 104.21.48.170, 172.67.187.102, 2606:4700:3037::6815:30aa, 2606:4700:3037::ac43:bb66
Response IP 172.67.187.102
Found Yes
Hash 06595f6c0dc2fc9d550a57962b34773da291ba1a7be43b22a7249587b4b61586
SimHash 2c5422716554

Groups

*

Rule Path
Allow /viewforum.php
Allow /viewtopic.php
Allow /styles/
Allow /images/
Allow /ext/*/styles/
Disallow /ucp.php
Disallow /mcp.php
Disallow /posting.php
Disallow /adm/
Disallow /search.php
Disallow /memberlist.php
Disallow /viewonline.php
Disallow /download/file.php
Disallow /*?sid=
Disallow /*%26sid%3D
Back to top

Other Records

Field Value
sitemap https://www.computerbb.org/app.php/feed
sitemap https://www.computerbb.org/app.php/feed/forum/7
sitemap https://www.computerbb.org/app.php/feed/forum/1
sitemap https://www.computerbb.org/app.php/feed/forum/5
sitemap https://www.computerbb.org/app.php/feed/forum/13
sitemap https://www.computerbb.org/app.php/feed/forum/12
sitemap https://www.computerbb.org/app.php/feed/forum/26
sitemap https://www.computerbb.org/app.php/feed/forum/11
sitemap https://www.computerbb.org/app.php/feed/forum/8
Back to top

Comments

  • robots.txt for phpBB — block login/registration & non-content, allow content
  • --- Allow main content (forums & topics) ---
  • --- Allow static assets (so pages render properly) ---
  • --- Block authentication & posting endpoints (login, register, UCP, MCP, posting) ---
  • --- Block non-content & heavy endpoints ---
  • --- Prevent duplicate URLs from session IDs ---
  • --- Optional: slow down aggressive crawlers (Google ignores this) ---
  • Crawl-delay: 5
  • --- Optional: Sitemap (update to your URL if you have one) ---
Back to top