board-game.co.uk
robots.txt

Robots Exclusion Standard data for board-game.co.uk

Resource Scan

Scan Details

Site Domain board-game.co.uk
Base Domain board-game.co.uk
Scan Status Ok
Last Scan2024-06-02T06:29:54+00:00
Next Scan 2024-07-02T06:29:54+00:00

Last Scan

Scanned2024-06-02T06:29:54+00:00
URL https://board-game.co.uk/robots.txt
Domain IPs 104.26.2.106, 104.26.3.106, 172.67.69.56, 2606:4700:20::681a:26a, 2606:4700:20::681a:36a, 2606:4700:20::ac43:4538
Response IP 104.26.2.106
Found Yes
Hash 6c2fa5daa1e0c03c6011051a9ce09fb38956199a1293a59a2898f2f59db782da
SimHash 636bd240e333

Groups

*

Rule Path
Allow /wp-content/uploads/
Allow /wp-content/plugins/wp-rocket/
Allow /wp-content/plugins/js_composer/assets/
Allow /wp-content/plugins/woocommerce-msrp-pricing/
Allow /wp-content/plugins/woocommerce-products-filter/
Allow /wp-content/plugins/bb-plugin/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /*add-to-cart%3D*
Disallow /*add_to_wishlist%3D*
Disallow /?s=*

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /
Disallow /wp-admin/admin-ajax.php
Disallow /

*

Rule Path
Disallow /wp-content/uploads/woo-import-export/

Other Records

Field Value
sitemap https://www.board-game.co.uk/sitemap_index.xml

Comments

  • Pinterestbot
  • WP Import Export Rule

Warnings

  • `user agent` is not a known field.