brisbanebbs.com
robots.txt

Robots Exclusion Standard data for brisbanebbs.com

Resource Scan

Scan Details

Site Domain brisbanebbs.com
Base Domain brisbanebbs.com
Scan Status Ok
Last Scan2025-12-01T19:35:27+00:00
Next Scan 2025-12-15T19:35:27+00:00

Last Scan

Scanned2025-12-01T19:35:27+00:00
URL https://brisbanebbs.com/robots.txt
Domain IPs 104.21.81.30, 172.67.156.121, 2606:4700:3031::ac43:9c79, 2606:4700:3037::6815:511e
Response IP 172.67.156.121
Found Yes
Hash ab1641ee6b031c8775c07007ca76865510e6e8a5ac78a05bbcbed0f42a3e5314
SimHash 604f4b44e1ca

Groups

*

Rule Path
Disallow /api/
Disallow /data/
Disallow /source/
Disallow /install/
Disallow /config/
Disallow /uc_client/
Disallow /uc_server/
Disallow /admin.php
Disallow /search.php
Disallow /member.php
Disallow /api.php
Disallow /misc.php
Disallow /connect.php
Disallow /forum.php?mod=redirect*
Disallow /forum.php?mod=post*
Disallow /home.php?mod=spacecp*
Disallow /userapp.php?mod=app&*
Disallow /*?mod=misc*
Disallow /*?mod=attachment*
Disallow /*mobile%3Dyes*

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://brisbanebbs.com/sitemap_index.xml

Comments

  • robots.txt for Discuz! X3
  • 屏蔽ClaudeBot爬虫