td.org
robots.txt

Robots Exclusion Standard data for td.org

Resource Scan

Scan Details

Site Domain td.org
Base Domain td.org
Scan Status Ok
Last Scan2025-09-07T18:27:58+00:00
Next Scan 2025-10-07T18:27:58+00:00

Last Scan

Scanned2025-09-07T18:27:58+00:00
URL https://td.org/robots.txt
Redirect https://www.td.org/robots.txt
Redirect Domain www.td.org
Redirect Base td.org
Domain IPs 76.76.21.21
Redirect IPs 104.20.41.246, 172.66.173.57, 2606:4700:10::6814:29f6, 2606:4700:10::ac42:ad39
Response IP 104.20.41.246
Found Yes
Hash e38d3265a31f4404bbf9692ca9c198d09dc1f6bc5c141aa033fd81f040422b9e
SimHash 4940db36c931

Groups

screaming frog seo spider

Rule Path
Allow /

*

Rule Path
Disallow /api
Disallow /checkout
Disallow /cart
Disallow /sites/forum

Other Records

Field Value
sitemap https://www.td.org/sitemap/index.xml