learn.lvt.com
robots.txt

Robots Exclusion Standard data for learn.lvt.com

Resource Scan

Scan Details

Site Domain learn.lvt.com
Base Domain lvt.com
Scan Status Ok
Last Scan2025-07-27T23:45:03+00:00
Next Scan 2025-08-10T23:45:03+00:00

Last Scan

Scanned2025-07-27T23:45:03+00:00
URL https://learn.lvt.com/robots.txt
Domain IPs 107.21.253.177, 44.208.96.69, 52.23.113.133
Response IP 44.208.96.69
Found Yes
Hash e4770229333d4925e22efa0271d6c62d12b97e5909d53f1b6c8dfda116496500
SimHash c24051455775

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /student/path/*
Allow /student/activity/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Required for activities shared to Twitter, see https://dev.twitter.com/cards/getting-started "URL Crawling & Caching"