aspectfoundation.org
robots.txt
Robots Exclusion Standard data for aspectfoundation.org
Resource Scan
Scan Details
Site Domain | aspectfoundation.org |
Base Domain | aspectfoundation.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-20T05:21:36+00:00 |
Next Scan | 2025-12-19T05:21:36+00:00 |
Last Successful Scan
Scanned | 2023-02-10T12:46:46+00:00 |
URL | https://aspectfoundation.org/robots.txt |
Domain IPs | 104.21.36.46, 172.67.185.51, 2606:4700:3032::6815:242e, 2606:4700:3033::ac43:b933 |
Response IP | 172.67.185.51 |
Found | Yes |
Hash | c992c31be2a47bc56593c064ad96ff9191bfe9c80b072a3256461820e9d52b2d |
SimHash | 8154432a6af1 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ex_abroad/ |
Disallow | /ex_host/ |
Disallow | /ex_run/ |
Disallow | /ex_study/ |
Disallow | /exchange/ |
Disallow | /bin/ |
Disallow | /formmail/ |
Disallow | /ex_profiles.bak/ |
Disallow | /ex_profiles.bak_b/ |
Disallow | /ex_profiles_new/ |
Disallow | /ex_profiles_revsn/ |
Disallow | /ex_profiles_test/ |
Disallow | /ex_training/ |
Disallow | /slideshow/ |
Disallow | /ftp/ |
Disallow | /htdocs/ |
Disallow | /images/ |
Disallow | /photos/ |
Disallow | /Templates/ |
Disallow | /video/ |
Disallow | /Forms/ |
Disallow | /wordpress/ |
Disallow | /*.gif$ |
Disallow | /*.css$ |
Disallow | /alumni_club.html |
Disallow | /aspfn_home.html |
Disallow | /college.htm |
Disallow | /default.html |
Disallow | /host.htm |
Disallow | /letter.htm |
Disallow | /listng.htm |
Disallow | /main.htm |
Disallow | /old_index.htm |
Disallow | /opportun.htm |
Disallow | /out.htm |
Disallow | /rep.htm |
Disallow | /title.htm |
Disallow | /usa.htm |
Disallow | /ex_indexl |
Disallow | /student_hf_forms.html |
Disallow | /wp-content/uploads/ |
Disallow | /media/docs/ |
Disallow | /media/pdf/ |
Disallow | /media/Melting_Pot/ |
Disallow | /pdf/ |
Disallow | /videos/ |
Comments