Log In Sign Up

massaro.university
robots.txt

Robots Exclusion Standard data for massaro.university

Resource Scan

Scan Details

Site Domain massaro.university
Base Domain massaro.university
Scan Status Ok
Last Scan2025-11-02T08:07:57+00:00
Next Scan 2025-11-16T08:07:57+00:00

Last Scan

Scanned2025-11-02T08:07:57+00:00
URL https://www.massaro.university/robots.txt
Domain IPs 162.159.128.53, 162.159.138.52
Response IP 162.159.128.53
Found Yes
Hash 16094fca9a07fb51b20ad08179b40f9fae39e646ed385aa6c0e375b06e1b8ec1
SimHash 43dce883a383

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/14206066*
Disallow /spaces/21071546*
Disallow /spaces/14629457*
Disallow /spaces/20007173*
Disallow /spaces/16717427*
Disallow /spaces/13339945*
Disallow /spaces/18551459*
Disallow /spaces/21283045*
Disallow /spaces/19456647*
Disallow /spaces/13339850*
Disallow /spaces/14226002*
Disallow /spaces/14226004*
Disallow /spaces/14225999*
Disallow /spaces/13866954*
Disallow /spaces/18770895*
Disallow /spaces/19456649*
Disallow /spaces/18265253*
Disallow /spaces/14629458*
Disallow /spaces/17019758*
Disallow /spaces/17019745*
Disallow /spaces/18276242*
Disallow /spaces/18757094*
Disallow /spaces/18766984*
Disallow /spaces/17019738*
Disallow /spaces/14225978*
Disallow /spaces/13866976*
Disallow /spaces/16103126*
Disallow /spaces/18550220*
Disallow /spaces/16997426*
Disallow /spaces/14226001*
Disallow /spaces/16238059*
Disallow /spaces/16463283*
Disallow /spaces/19375674*
Disallow /spaces/21301763*
Disallow /spaces/19456645*
Disallow /spaces/13318928*
Disallow /spaces/13867090*
Disallow /communities/
Back to top

Other Records

Field Value
sitemap https://www.massaro.university/sitemap.xml
Back to top