learnaboutring.com
robots.txt

Robots Exclusion Standard data for learnaboutring.com

Resource Scan

Scan Details

Site Domain learnaboutring.com
Base Domain learnaboutring.com
Scan Status Ok
Last Scan2025-08-06T10:26:06+00:00
Next Scan 2025-08-20T10:26:06+00:00

Last Scan

Scanned2025-08-06T10:26:06+00:00
URL https://learnaboutring.com/robots.txt
Redirect https://www.learnaboutring.com:443/robots.txt
Redirect Domain www.learnaboutring.com
Redirect Base learnaboutring.com
Domain IPs 75.2.25.247
Redirect IPs 100.26.87.211, 34.238.113.230, 52.86.120.166
Response IP 34.238.113.230
Found Yes
Hash e4770229333d4925e22efa0271d6c62d12b97e5909d53f1b6c8dfda116496500
SimHash c24051455775

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /student/path/*
Allow /student/activity/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Required for activities shared to Twitter, see https://dev.twitter.com/cards/getting-started "URL Crawling & Caching"