middleton.edu.sg
robots.txt

Robots Exclusion Standard data for middleton.edu.sg

Resource Scan

Scan Details

Site Domain middleton.edu.sg
Base Domain middleton.edu.sg
Scan Status Ok
Last Scan2026-01-21T15:24:26+00:00
Next Scan 2026-02-20T15:24:26+00:00

Last Scan

Scanned2026-01-21T15:24:26+00:00
URL https://middleton.edu.sg/robots.txt
Redirect https://www.middleton.edu.sg/robots.txt
Redirect Domain www.middleton.edu.sg
Redirect Base middleton.edu.sg
Domain IPs 68.183.179.38
Redirect IPs 68.183.179.38
Response IP 68.183.179.38
Found Yes
Hash 5259bee9006fdedbf931da57a7c420bfe3e543ffff06a05b2ba46ce83ffa20bd
SimHash bf4b7a46cd11

Groups

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.middleton.edu.sg/sitemaps.xml