blog.thermoworks.com
robots.txt

Robots Exclusion Standard data for blog.thermoworks.com

Resource Scan

Scan Details

Site Domain blog.thermoworks.com
Base Domain thermoworks.com
Scan Status Ok
Last Scan2025-07-31T14:37:20+00:00
Next Scan 2025-08-30T14:37:20+00:00

Last Scan

Scanned2025-07-31T14:37:20+00:00
URL https://blog.thermoworks.com/robots.txt
Domain IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 104.18.37.69
Found Yes
Hash 2aa09410df8e381fa04b56828898d0b92eba2fe295003cdc1778762e389a0675
SimHash adf09e20e110

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow /bbq-grilling/
Disallow /tag/
Disallow /wp-admin/
Disallow /print
Disallow /search.php
Disallow /?preview_id
Disallow /?p
Disallow /?s
Disallow /?tw
Disallow /?msclkid=
Disallow /print
Allow /bbq-grilling/page
Allow /bbq-grilling/grilling-with-thermometers-probe-safety/
Allow /bbq-grilling/bbq-101-an-introduction-to-smoked-meat/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://blog.thermoworks.com/sitemap_index.xml

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots