dcu.org
robots.txt

Robots Exclusion Standard data for dcu.org

Resource Scan

Scan Details

Site Domain dcu.org
Base Domain dcu.org
Scan Status Ok
Last Scan2024-09-18T10:22:26+00:00
Next Scan 2024-10-18T10:22:26+00:00

Last Scan

Scanned2024-09-18T10:22:26+00:00
URL https://dcu.org/robots.txt
Redirect https://www.dcu.org/robots.txt
Redirect Domain www.dcu.org
Redirect Base dcu.org
Domain IPs 104.17.60.212, 104.17.61.212, 104.17.62.212, 104.17.63.212, 104.17.64.212, 2606:4700::6811:3cd4, 2606:4700::6811:3dd4, 2606:4700::6811:3ed4, 2606:4700::6811:3fd4, 2606:4700::6811:40d4
Redirect IPs 104.17.60.212, 104.17.61.212, 104.17.62.212, 104.17.63.212, 104.17.64.212, 2606:4700::6811:3cd4, 2606:4700::6811:3dd4, 2606:4700::6811:3ed4, 2606:4700::6811:3fd4, 2606:4700::6811:40d4
Response IP 104.17.63.212
Found Yes
Hash 97b8f5d5f8ca74bb36868646ac6560f29e15b354c1b3aec66ff066e79763256e
SimHash 2e0299412fd3

Groups

*

Rule Path
Disallow /*/search-redirects/*

baiduspider

Rule Path
Disallow /*

yandexbot

Rule Path
Disallow /*

yandeximages

Rule Path
Disallow /*

Other Records

Field Value
sitemap https://www.dcu.org/sitemap.xml

Comments

  • robots.txt for https://www.dcu.org/