Log In Sign Up

benzobuddies.org
robots.txt

Robots Exclusion Standard data for benzobuddies.org

Resource Scan

Scan Details

Site Domain benzobuddies.org
Base Domain benzobuddies.org
Scan Status Ok
Last Scan2024-06-01T02:17:13+00:00
Next Scan 2024-07-01T02:17:13+00:00

Last Scan

Scanned2024-06-01T02:17:13+00:00
URL https://benzobuddies.org/robots.txt
Domain IPs 2600:9000:2163:1600:15:132:780:93a1, 2600:9000:2163:8000:15:132:780:93a1, 2600:9000:2163:8200:15:132:780:93a1, 2600:9000:2163:8800:15:132:780:93a1, 2600:9000:2163:9e00:15:132:780:93a1, 2600:9000:2163:aa00:15:132:780:93a1, 2600:9000:2163:c000:15:132:780:93a1, 2600:9000:2163:ea00:15:132:780:93a1, 65.9.112.10, 65.9.112.35, 65.9.112.6, 65.9.112.66
Response IP 18.165.171.84
Found Yes
Hash 126c4c2bd96d9bc511a6bbd66093806f2a02c52932c43cb7606910c965b22a54
SimHash 2cb04b01049a

Groups

*

Rule Path
Disallow /cmb-t35sdgx72ig
Disallow /startTopic/
Disallow /discover/unread/
Disallow /markallread/
Disallow /staff/
Disallow /cookie/
Disallow /online/
Disallow /discover/
Disallow /leaderboard/
Disallow /search/
Disallow /tags/
Disallow /*?advancedSearchForm=
Disallow /register/
Disallow /lostpassword/
Disallow /login/
Disallow /*?sortby=
Disallow /*?filter=
Disallow /*?tab=
Disallow /*?do=
Disallow /*ref%3D
Disallow /*?forumId*
Disallow /*?&controller=embed
Back to top

Other Records

Field Value
sitemap https://www.benzobuddies.org/sitemap.php
Back to top

Comments

  • Rules for BenzoBuddies (https://benzobuddies.org)
  • Block pages with no unique content
  • Block faceted pages and 301 redirect pages
  • Sitemap URL
Back to top