securethoughts.com
robots.txt

Robots Exclusion Standard data for securethoughts.com

Resource Scan

Scan Details

Site Domain securethoughts.com
Base Domain securethoughts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-25T11:38:54+00:00
Next Scan 2025-10-02T11:38:54+00:00

Last Successful Scan

Scanned2025-08-25T09:35:03+00:00
URL https://securethoughts.com/robots.txt
Domain IPs 104.21.31.108, 172.67.176.58, 2606:4700:3032::ac43:b03a, 2606:4700:3034::6815:1f6c
Response IP 104.21.31.108
Found Yes
Hash d71d407bfcc79120b5466a405a939a7a7991dfa94172154ae08c9e055145789b
SimHash c1605a066794

Groups

*

Rule Path
Allow /*?utm_expid*
Allow /*?utm_referrer*
Allow /*.js***************
Allow /*.css**************
Allow /*/ubermenu/assets/css/*
Allow /*/wcms_widgets/fonts/*
Allow /*/public/css/*
Allow /*.woff*
Allow /*.ttf*
Allow /*.php
Allow /*.php*
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /tag/
Disallow /trackback
Disallow /feed
Disallow */feed
Disallow /comments
Disallow */trackback
Disallow */comments
Disallow /site-vault-scripts
Disallow /includes
Disallow /includes/
Disallow *replytocom
Disallow /?
Disallow /v2/
Disallow */v2/*
Disallow /med/
Disallow /go/
Disallow /*?*
Disallow /*?
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-login.php

Other Records

Field Value
sitemap https://securethoughts.com/sitemap_index.xml

Comments

  • Don’t block Google Optimize for A/B tests
  • Allow Java and CSS
  • Allow php
  • Other standard pages not to index