Log In Sign Up

mq.edu.au
robots.txt

Robots Exclusion Standard data for mq.edu.au

Resource Scan

Scan Details

Site Domain mq.edu.au
Base Domain mq.edu.au
Scan Status Ok
Last Scan2025-04-08T11:46:49+00:00
Next Scan 2025-05-08T11:46:49+00:00

Last Scan

Scanned2025-04-08T11:46:49+00:00
URL https://mq.edu.au/robots.txt
Redirect https://www.mq.edu.au/robots.txt
Redirect Domain www.mq.edu.au
Redirect Base mq.edu.au
Domain IPs 43.245.41.37
Redirect IPs 2.58.104.10, 2.58.104.11
Response IP 2.58.104.10
Found Yes
Hash 58862b91a24a38574cc2015b7f4f174379406feed2f58d44c127fc51dd6e22bd
SimHash 6520ddd0e52b

Groups

funnelback

Rule Path
Allow /
Disallow /uat-landing/*
Disallow /pubstatic/*
Disallow /thisweek/*/feed/
Disallow /thisweek/feed/
Disallow /macquariematters/*/feed/
Disallow /newsroom/*/feed/
Disallow /newsroom/feed/
Disallow /research-impact/feed/
Disallow /research-impact/*/feed/
Disallow /mq_templates/*

bingbot

Rule Path
Disallow /search
Disallow /pubstatic/*
Disallow /mq_templates/*
Disallow /study/new-ia*
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /*_design
Disallow /*_web_services
Disallow /*_guide
Disallow /*_integration
Disallow /uat-landing/*
Disallow /squiz-sandbox/*

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Disallow /pubstatic/*
Disallow /mq_templates/*
Disallow /study/new-ia*
Disallow /*?sq_content_src=
Disallow /*_recache
Disallow /*_edit
Disallow /*_admin
Disallow /*_login
Disallow /*_performance
Disallow /*_design
Disallow /*_web_services
Disallow /*_guide
Disallow /*_integration
Disallow /uat-landing/*
Disallow /squiz-sandbox/*
Disallow /search
Back to top

Other Records

Field Value
sitemap http://www.mq.edu.au/sitemap.xml
Back to top

Comments

  • Limit Bingbot
  • Allow CSS and JS
  • Allow: /_design/css/*
  • Allow: /_design/js/*
  • Disallow some matrix defaults
  • Disallow UAT and sandbox pages
  • Disallow search page
  • sitemap
Back to top