merton.org
robots.txt

Robots Exclusion Standard data for merton.org

Resource Scan

Scan Details

Site Domain merton.org
Base Domain merton.org
Scan Status Ok
Last Scan2025-10-15T22:20:35+00:00
Next Scan 2025-11-14T22:20:35+00:00

Last Scan

Scanned2025-10-15T22:20:35+00:00
URL https://merton.org/robots.txt
Domain IPs 104.21.14.85, 172.67.202.174, 2606:4700:3031::6815:e55, 2606:4700:3035::ac43:caae
Response IP 104.21.14.85
Found Yes
Hash 11cce7f138d73c31822953799fba6ccb8788b852168725356073847849c791ae
SimHash 97096f561d97

Groups

*

Rule Path
Disallow /*.asp$
Disallow /_fpclass
Disallow /_private
Disallow /_themes
Disallow /_vti_cnf
Disallow /_vti_log
Disallow /_vti_pvt
Disallow /_vti_script
Disallow /_vti_txt
Disallow /cgi-bin
Disallow /email
Disallow /fpdb
Disallow /image
Disallow /chrono.htm
Disallow /collection.htm
Disallow /book.htm
Disallow /ebook.htm
Disallow /index.asp
Disallow /index.htm
Disallow /links.htm
Disallow /othercollections.htm
Disallow /site-index.html
Disallow /visit.htm
Disallow /tmsq.htm
Disallow ITMS/index.asp
Disallow Research/copywrite.htm
Disallow Research/index.asp
Disallow Research/recordings.htm
Disallow Research/use.htm
Disallow Research/Correspondence/Correspondents-list.asp
Disallow Research/Correspondence/Correspondents-list2.asp
Disallow Research/Correspondence/Correspondents-list3.asp
Disallow Research/Correspondence/results.asp?phrase=
Disallow Research/Correspondence/results.asp*
Disallow Research/Correspondence/Standards.html
Disallow research/Correspondence/Standards.html
Disallow research/correspondence/Standards.html
Disallow Research/Correspondence/z48db.html
Disallow Research/Correspondence/z332e.html
Disallow Research/Correspondence/z.asp
Disallow research/correspondence/z.asp*
Disallow Research/Correspondence/z.asp*
Disallow Research/Correspondence/z-s.asp*
Disallow Research/Correspondence/z-d.asp*
Disallow Research/Manuscripts/default.asp
Disallow Research/Manuscripts/manu.asp
Disallow Research/Manuscripts/manu.asp*
Disallow Research/Manuscripts/Delius.html
Disallow Research/Manuscripts/Notebooks-DB-Index.html
Disallow Research/Manuscripts/Notebooks-DB-Journal.html
Disallow Research/Manuscripts/Subject.asp*

Comments

  • Disallow: /w3svc? #Change ? with the instance number please.