torontoist.com
robots.txt

Robots Exclusion Standard data for torontoist.com

Resource Scan

Scan Details

Site Domain torontoist.com
Base Domain torontoist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-10T21:47:52+00:00
Next Scan 2025-01-08T21:47:52+00:00

Last Successful Scan

Scanned2023-06-25T16:37:07+00:00
URL https://torontoist.com/robots.txt
Domain IPs 104.21.95.185, 172.67.146.248, 2606:4700:3035::ac43:92f8, 2606:4700:3036::6815:5fb9
Response IP 104.21.95.185
Found Yes
Hash 9311bab30d8b5d05f5fa5563a251b8c96b8470873bb77c62d3d17c146d7acab7
SimHash 4100c8004bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php