howtofire.com
robots.txt

Robots Exclusion Standard data for howtofire.com

Resource Scan

Scan Details

Site Domain howtofire.com
Base Domain howtofire.com
Scan Status Ok
Last Scan2025-06-28T14:24:18+00:00
Next Scan 2025-07-05T14:24:18+00:00

Last Scan

Scanned2025-06-28T14:24:18+00:00
URL https://howtofire.com/robots.txt
Domain IPs 104.21.52.166, 172.67.201.86, 2606:4700:3032::6815:34a6, 2606:4700:3036::ac43:c956
Response IP 104.21.52.166
Found Yes
Hash c9c3dac501f7efd00134adecadc948907d72c3b0a25eda58ac41c2ef46945eff
SimHash c1645256e7b2

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /*.js***************
Allow /*.css**************
Allow /*.woff*
Allow /*.ttf*
Allow /*.php
Allow /*.php*
Allow /*?utm_expid*
Allow /*?utm_referrer*
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback
Disallow /feed
Disallow /comments
Disallow */comments
Disallow /tag
Disallow */trackback
Disallow */feed
Disallow /*?*
Disallow /*?
Disallow /site-vault-scripts

Other Records

Field Value
sitemap https://www.howtofire.com/sitemap_index.xml

Comments

  • Allow JS, CSS and fonts
  • Allow php
  • Dont block Google Optimize for A/B tests
  • Other standard pages not to index