stories.td.com
robots.txt

Robots Exclusion Standard data for stories.td.com

Resource Scan

Scan Details

Site Domain stories.td.com
Base Domain td.com
Scan Status Ok
Last Scan2025-03-03T16:33:51+00:00
Next Scan 2025-04-02T16:33:51+00:00

Last Scan

Scanned2025-03-03T16:33:51+00:00
URL https://stories.td.com/robots.txt
Domain IPs 96.17.96.21, 96.17.96.9
Response IP 23.32.29.88
Found Yes
Hash c49629aa05a537f661678e20da0beb45a5fecfb8c42cbafd8e591efb0a30fade
SimHash 6b00dc908383

Groups

*

Rule Path
Disallow /admin/
Disallow /ca/en/search
Disallow /ca/fr/chercher
Disallow /us/en/search

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://stories.td.com/sitemap.xml