theconsideredman.org
robots.txt

Robots Exclusion Standard data for theconsideredman.org

Resource Scan

Scan Details

Site Domain theconsideredman.org
Base Domain theconsideredman.org
Scan Status Ok
Last Scan2025-12-26T08:00:16+00:00
Next Scan 2026-01-02T08:00:16+00:00

Last Scan

Scanned2025-12-26T08:00:16+00:00
URL https://theconsideredman.org/robots.txt
Domain IPs 104.21.64.213, 172.67.136.174, 2606:4700:3032::6815:40d5, 2606:4700:3035::ac43:88ae
Response IP 104.21.64.213
Found Yes
Hash b88cc2599cfd4312ce1048fd68cbdec05e9b684b1c725e6b4aced6755602d60f
SimHash a46c6a40e412

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://theconsideredman.org/sitemap_index.xml

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK