torontolife.com
robots.txt
Robots Exclusion Standard data for torontolife.com
Resource Scan
Scan Details
Site Domain | torontolife.com |
Base Domain | torontolife.com |
Scan Status | Ok |
Last Scan | 2024-10-27T01:20:20+00:00 |
Next Scan | 2024-11-03T01:20:20+00:00 |
Last Scan
Scanned | 2024-10-27T01:20:20+00:00 |
URL | https://torontolife.com/robots.txt |
Domain IPs | 104.18.16.113, 104.18.17.113, 2606:4700::6812:1071, 2606:4700::6812:1171 |
Response IP | 104.18.16.113 |
Found | Yes |
Hash | ddf05e9ecc01100d2892cebf2f835b06e4f721f310e38ceda98cc3fbb2c80dfa |
SimHash | 281d9cd0cd93 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/* |
Disallow | /wp/* |
Disallow | /app/plugins/* |
Disallow | /wp-json* |
Other Records
Field | Value |
---|---|
sitemap | https://torontolife.com/sitemap-index.xml |