griffith.edu.au
robots.txt
Robots Exclusion Standard data for griffith.edu.au
Resource Scan
Scan Details
| Site Domain | griffith.edu.au |
| Base Domain | griffith.edu.au |
| Scan Status | Ok |
| Last Scan | 2024-11-06T14:21:34+00:00 |
| Next Scan | 2024-11-20T14:21:34+00:00 |
Last Scan
| Scanned | 2024-11-06T14:21:34+00:00 |
| URL | https://griffith.edu.au/robots.txt |
| Redirect | https://www.griffith.edu.au/robots.txt |
| Redirect Domain | www.griffith.edu.au |
| Redirect Base | griffith.edu.au |
| Domain IPs | 43.245.41.70 |
| Redirect IPs | 104.18.42.202, 172.64.145.54 |
| Response IP | 104.18.42.202 |
| Found | Yes |
| Hash | 8b6bc253f9037265a997473666419dff1f0ba438edea069bd857dc6b83167f30 |
| SimHash | 6f413119a931 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /_designs/ |
| Disallow | /*?sq_content_src= |
| Disallow | /*_recache |
| Disallow | /*_edit |
| Disallow | /*_admin |
| Disallow | /*_nocache |
| Disallow | /*_local |
| Disallow | /*_login |
| Disallow | /*_performance |
| Disallow | /*_design |
| Disallow | /*_web_services |
| Disallow | /do-not-publish |
| Disallow | */nested-content |
| Disallow | /study2* |
| Disallow | /*?git= |
| Disallow | /*?tiq= |
| Disallow | /degree-feed-module |
| Disallow | /degree-finder-api |
| Disallow | /feeds |
| Disallow | /links |
| Disallow | /home |
| Disallow | /programs-and-courses-application |
| Disallow | /update-details |
| Disallow | /study/brochures |
| Disallow | /study/configuration |
| Disallow | /study/content-library |
| Disallow | /study/degree-finder-application/* |
| Disallow | /study/planner-data-import/* |
| Disallow | /study/dev/* |
| Disallow | /study/sit/* |
| Disallow | /study/ps/* |
| Disallow | /open-day/_kiosk/* |
| Disallow | /open-day/_scan/* |
| Disallow | /open-day/welcome |
| Disallow | /open-day/hello |
| Disallow | /open-day/register |
| Allow | /study/configuration/remote/content-library-rest |
| Allow | /_designs/git* |
| Allow | /_designs/css* |
| Allow | /_designs/js* |
| Disallow | /study/degrees/1* |
| Disallow | /study/degrees/2* |
| Disallow | /study/degrees/3* |
| Disallow | /study/degrees/4* |
| Disallow | /study/degrees/5* |
| Disallow | /study/degrees/6* |
| Disallow | /study/degrees/7* |
| Disallow | /study/degrees/8* |
| Disallow | /study/degrees/9* |
| Disallow | /study/degrees/0* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.griffith.edu.au/sitemap/degrees.xml |
| sitemap | https://www.griffith.edu.au/sitemap/study.xml |
| sitemap | https://www.griffith.edu.au/sitemap/top-level.xml |
Warnings
- 10 invalid lines.
Comments