torontobook.ca
robots.txt

Robots Exclusion Standard data for torontobook.ca

Resource Scan

Scan Details

Site Domain torontobook.ca
Base Domain torontobook.ca
Scan Status Ok
Last Scan2025-09-14T04:22:28+00:00
Next Scan 2025-10-14T04:22:28+00:00

Last Scan

Scanned2025-09-14T04:22:28+00:00
URL https://torontobook.ca/robots.txt
Domain IPs 104.21.10.147, 172.67.131.136, 2606:4700:3033::6815:a93, 2606:4700:3033::ac43:8388
Response IP 104.21.10.147
Found Yes
Hash 0578ef1a7df68b006e56b80f9938a1553eb88aa71dde303afb6af3d4c4c1cb3c
SimHash 085357d73503

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandex

Rule Path
Allow /

applebot

Rule Path
Allow /
Allow /css/
Allow /js/
Allow /images/

Other Records

Field Value
sitemap https://torontobook.ca/sitemap_index.xml
sitemap https://torontobook.ca/post-sitemap.xml
sitemap https://torontobook.ca/post-sitemap2.xml
sitemap https://torontobook.ca/page-sitemap.xml
sitemap https://torontobook.ca/category-sitemap.xml