communitybeer.com
robots.txt

Robots Exclusion Standard data for communitybeer.com

Resource Scan

Scan Details

Site Domain communitybeer.com
Base Domain communitybeer.com
Scan Status Ok
Last Scan2025-11-26T12:46:51+00:00
Next Scan 2025-12-26T12:46:51+00:00

Last Scan

Scanned2025-11-26T12:46:51+00:00
URL https://communitybeer.com/robots.txt
Domain IPs 104.21.48.191, 172.67.156.14, 2606:4700:3033::6815:30bf, 2606:4700:3035::ac43:9c0e
Response IP 172.67.156.14
Found Yes
Hash 6d3c19cc98fe100c6a72dc875379c0537a769e2fe4a0fa762067c8528321a358
SimHash c909c8c2e49f

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Disallow /calendar/action*
Disallow /events/action*
Allow /*.css
Allow /*.js
Disallow /*?

Other Records

Field Value
crawl-delay 3

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /wp-json/
Disallow /?rest_route=

Other Records

Field Value
sitemap https://communitybeer.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK