Log In Sign Up

sydney.edu.au
robots.txt

Robots Exclusion Standard data for sydney.edu.au

Resource Scan

Scan Details

Site Domain sydney.edu.au
Base Domain sydney.edu.au
Scan Status Ok
Last Scan2024-10-20T03:15:40+00:00
Next Scan 2024-11-19T03:15:40+00:00

Last Scan

Scanned2024-10-20T03:15:40+00:00
URL https://sydney.edu.au/robots.txt
Redirect https://www.sydney.edu.au/robots.txt
Redirect Domain www.sydney.edu.au
Redirect Base sydney.edu.au
Domain IPs 20.248.131.216
Redirect IPs 23.209.46.159, 23.209.46.164, 2600:1413:b000:1c::17d1:2ec5, 2600:1413:b000:1c::17d1:2ed2
Response IP 23.209.46.159
Found Yes
Hash 8549c7cbf3331a5e1d75f374e4604dc433950979bc6e789c92d163cdfbc94f9d
SimHash f41d10440103

Groups

funnelback

Rule Path
Disallow /education_social_work/bulletin/

*

Rule Path
Allow /
Allow /myuni-content/
Allow /medicine-health/schools/sydney-school-of-health-sciences/academic-staff/
Allow /science/about/our-people/academic-staff/
Disallow /medicine/fmrc/icpc3dev/
Disallow /handbooks/archive/2011/
Disallow /medicine/people/academics-old/profiles/
Disallow /search/
Disallow /library/images/
Disallow /library/scripts/
Disallow /library/styles/
Disallow /library/test/
Disallow /library/templates/
Disallow /library/stream/
Disallow /library/screens/
Disallow /library/cgi-bin/
Disallow /library/unified-search/
Disallow /library/contacts/email-campaigns/
Disallow /styleguide/
Disallow /agents/
Disallow /errors/
Disallow /architecture/about/our-people/academic-staff/staff-profile.html
Disallow /law/about/our-people/academic-staff/staff-profile.html
Disallow /music/about/our-people/academic-staff/staff-profile.html
Disallow /engineering/about/our-people/academic-staff/staff-profile.html
Disallow /medicine-health/about/our-people/academic-staff/staff-profile.html
Disallow /medicine-health/schools/faculty-of-health-sciences/academic-staff/staff-profile.html
Disallow /arts/about/our-people/academic-staff/staff-profile.html
Disallow /content/dam/corporate/documents/agents-portal/
Disallow /content/dam/corporate/documents/study/guides/usyd-international-guide-2022.pdf
Disallow /content/dam/corporate/documents/study/guides/usyd-international-guide.pdf
Disallow /content/dam/corporate/documents/study/how-to-apply/international-admission-guide.pdf
Disallow /content/dam/corporate/documents/study/getting-started/welcome-guide_international.pdf
Disallow /content/dam/corporate/documents/business-school/study/mba/part-time-mba-brochure.pdf
Disallow /business/study/mba/part-time-mba/request-a-brochure/thank-you.html
Disallow /study/mba/full-time-mba/request-a-brochure/thank-you.html
Disallow /business/study/mba/global-executive-mba/request-a-brochure/thank-you.html
Disallow /content/dam/students/documents/graduations/programs/
Back to top

Other Records

Field Value
sitemap https://www.sydney.edu.au/sitemap.xml
Back to top