Log In Sign Up

tsl.mit.edu
robots.txt

Robots Exclusion Standard data for tsl.mit.edu

Resource Scan

Scan Details

Site Domain tsl.mit.edu
Base Domain mit.edu
Scan Status Ok
Last Scan2024-04-05T20:14:30+00:00
Next Scan 2024-05-05T20:14:30+00:00

Last Scan

Scanned2024-04-05T20:14:30+00:00
URL https://tsl.mit.edu/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash ef55c3eac5716a7ebe5857937a4540c3b97e979e1f45ceb1023b2d801fd719a5
SimHash e9284880e592

Groups

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://tsl.mit.edu/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top