Log In Sign Up

thechessworld.com
robots.txt

Robots Exclusion Standard data for thechessworld.com

Resource Scan

Scan Details

Site Domain thechessworld.com
Base Domain thechessworld.com
Scan Status Ok
Last Scan2025-09-07T04:38:59+00:00
Next Scan 2025-10-07T04:38:59+00:00

Last Scan

Scanned2025-09-07T04:38:59+00:00
URL https://thechessworld.com/robots.txt
Domain IPs 104.26.12.155, 104.26.13.155, 172.67.73.69, 2606:4700:20::681a:c9b, 2606:4700:20::681a:d9b, 2606:4700:20::ac43:4945
Response IP 104.26.13.155
Found Yes
Hash 102ea9200fa2d4859c7b76a8a0cc6b35bd7f5a0d26c552907ce616bcd749046b
SimHash b3117c5ba3b5

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp.login/
Disallow /requests/
Disallow /landing/
Disallow /gallery/
Disallow /product-tag/
Disallow /wishlist/
Disallow /legal/
Disallow /cart/
Disallow /checkout/
Disallow /search/
Disallow /images/
Disallow /banners/
Disallow *add_to_wishlist
Disallow *add-to-cart
Disallow *replytocom
Disallow /?category=%E2%80%A2
Disallow /?list=%E2%80%A2
Disallow /?s=
Disallow *mailto
Disallow *openstat
Disallow /store/related-products/?tags=*
Disallow /canvaschess/
Disallow /store/product-category/
Disallow /supercharge/members/
Disallow /grandmasters/
Disallow /canvasviewer/
Disallow /academy/login/
Disallow /requests/
Disallow /comment-page
Disallow /store/courses/?price=*
Disallow /store/requests/
Disallow /requests/*
Disallow /supercharge/qid-checkout-complete/feed/
Disallow */feed/
Disallow */1list/
Disallow */cart/
Disallow *product-page%3D*
Disallow *category%3D
Disallow *type-of-video%3D
Disallow */tag/
Disallow /store/courses/label/

Other Records

Field Value
crawl-delay 50
Back to top

Other Records

Field Value
sitemap https://thechessworld.com/sitemap_index.xml
Back to top

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.
  • BEGIN Cloudflare Managed content
  • END Cloudflare Managed Content
Back to top