trostrum.com
robots.txt

Robots Exclusion Standard data for trostrum.com

Resource Scan

Scan Details

Site Domain trostrum.com
Base Domain trostrum.com
Scan Status Ok
Last Scan2026-01-14T21:40:33+00:00
Next Scan 2026-01-21T21:40:33+00:00

Last Scan

Scanned2026-01-14T21:40:33+00:00
URL https://trostrum.com/robots.txt
Domain IPs 104.21.71.228, 172.67.150.102, 2606:4700:3030::ac43:9666, 2606:4700:3033::6815:47e4
Response IP 104.21.71.228
Found Yes
Hash d187ddcc9412b53fd58ddfa8830b5946664b6ff656fe882b549e5b7769104f22
SimHash c9229e758591

Groups

*

Rule Path
Allow /
Allow /articles/
Allow /blogs.html
Allow /tools.html
Allow /css/
Allow /assets/
Allow /js/
Disallow /dist/
Disallow /node_modules/
Disallow /includes/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://trostrum.com/sitemap.xml

Comments

  • Sitemaps
  • Crawl-delay