asqtoronto.org
robots.txt

Robots Exclusion Standard data for asqtoronto.org

Resource Scan

Scan Details

Site Domain asqtoronto.org
Base Domain asqtoronto.org
Scan Status Ok
Last Scan2025-11-22T04:14:32+00:00
Next Scan 2025-12-22T04:14:32+00:00

Last Scan

Scanned2025-11-22T04:14:32+00:00
URL https://asqtoronto.org/robots.txt
Domain IPs 104.21.17.192, 172.67.178.50, 2606:4700:3031::6815:11c0, 2606:4700:3035::ac43:b232
Response IP 104.21.17.192
Found Yes
Hash 0bc6d5ba025a3008cc72468618d82ef8d1e270420623e5b2dc5187b0401871d1
SimHash 0c14fb70e775

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://asqtoronto.org/sitemap.xml