Log In Sign Up

ccue.singtao.ca
robots.txt

Robots Exclusion Standard data for ccue.singtao.ca

Resource Scan

Scan Details

Site Domain ccue.singtao.ca
Base Domain singtao.ca
Scan Status Ok
Last Scan2024-10-31T08:43:01+00:00
Next Scan 2024-11-30T08:43:01+00:00

Last Scan

Scanned2024-10-31T08:43:01+00:00
URL https://ccue.singtao.ca/robots.txt
Domain IPs 104.26.14.193, 104.26.15.193, 172.67.69.213, 2606:4700:20::681a:ec1, 2606:4700:20::681a:fc1, 2606:4700:20::ac43:45d5
Response IP 104.26.15.193
Found Yes
Hash 1415610bf103c3847b98aaa7396c463e74aad89230f060a35e4a99beecb249a9
SimHash 577edd50d515

Groups

googlebot
googlebot-news
mediapartners-google
bingbot
msnbot
slurp
yandex
baiduspider
alexabot
facebot
ia_archiver

Rule Path
Allow /

Other Records

Field Value
crawl-delay 300

sosospider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ccue.singtao.ca/sitemap/generate/post/today
Back to top