newcastle.edu.au
robots.txt
Robots Exclusion Standard data for newcastle.edu.au
Resource Scan
Scan Details
| Site Domain | newcastle.edu.au |
| Base Domain | newcastle.edu.au |
| Scan Status | Ok |
| Last Scan | 2024-10-06T20:43:39+00:00 |
| Next Scan | 2024-10-20T20:43:39+00:00 |
Last Scan
| Scanned | 2024-10-06T20:43:39+00:00 |
| URL | https://newcastle.edu.au/robots.txt |
| Redirect | https://www.newcastle.edu.au/robots.txt |
| Redirect Domain | www.newcastle.edu.au |
| Redirect Base | newcastle.edu.au |
| Domain IPs | 43.245.43.90 |
| Redirect IPs | 202.9.95.188 |
| Response IP | 202.9.95.188 |
| Found | Yes |
| Hash | 4fd46e94424137eeb3f385c8ef00e6f652db70bdac4b9854e9a2c1f29456a47c |
| SimHash | 6c6198150f71 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /__data/profile/ |
| Disallow | /__data/listing/ |
| Disallow | /degrees/teach-out |
| Disallow | /degrees/teach-out/ |
| Disallow | /degrees/compare/print |
| Disallow | /future-students/open-foundation/orientation |
| Disallow | /sandbox |
| Disallow | /sandbox/ |
| Disallow | /training |
| Disallow | /training/ |
| Disallow | /finnegans-beard |
| Disallow | /finnegans-beard/ |
| Disallow | /about-uon/governance-and-leadership/policy-library/ |
| Disallow | /study/applied |
| Disallow | /media |
googlebot-news
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /future-students/ |
| Disallow | /research-and-innovation/ |
| Disallow | /industry/ |
| Disallow | /international/ |
| Disallow | /community-and-alumni/ |
| Disallow | /about-uon/ |
| Disallow | /library/ |
| Disallow | /current-students/ |
| Disallow | /current-staff/ |
| Disallow | /events/ |
| Disallow | /about-uon/governance-and-leadership/policy-library/ |
| Allow | /newsroom/highlighted-news/ |
| Allow | /newsroom/highlighted-news |
| Allow | /newsroom/featured-news/ |
| Allow | /newsroom/featured-news |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/sitemaps-index |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/top-level-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/degrees-sitemap |
| sitemap | https://www.newcastle.edu.au/study/sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/our-uni-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/faculties-and-schools-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/engage-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/library-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/international-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/current-staff-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/current-students-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/courses-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/profile-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/news-sitemap |
| sitemap | https://www.newcastle.edu.au/research/sitemap |
| sitemap | https://www.newcastle.edu.au/research/centre/sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/campus-life-sitemap |
| sitemap | https://www.newcastle.edu.au/designs/uon-2016/sitemaps/hippocampus-sitemap |
| sitemap | https://www.newcastle.edu.au/newsSitemap |