university.atlassian.com
robots.txt

Robots Exclusion Standard data for university.atlassian.com

Resource Scan

Scan Details

Site Domain university.atlassian.com
Base Domain atlassian.com
Scan Status Ok
Last Scan2024-09-13T05:25:09+00:00
Next Scan 2024-09-27T05:25:09+00:00

Last Scan

Scanned2024-09-13T05:25:09+00:00
URL https://university.atlassian.com/robots.txt
Domain IPs 3.224.196.5, 44.196.204.227, 54.160.207.243
Response IP 54.160.207.243
Found Yes
Hash e4770229333d4925e22efa0271d6c62d12b97e5909d53f1b6c8dfda116496500
SimHash c24051455775

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /student/path/*
Allow /student/activity/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Required for activities shared to Twitter, see https://dev.twitter.com/cards/getting-started "URL Crawling & Caching"