aspectfoundation.org
robots.txt

Robots Exclusion Standard data for aspectfoundation.org

Resource Scan

Scan Details

Site Domain aspectfoundation.org
Base Domain aspectfoundation.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-20T05:21:36+00:00
Next Scan 2025-12-19T05:21:36+00:00

Last Successful Scan

Scanned2023-02-10T12:46:46+00:00
URL https://aspectfoundation.org/robots.txt
Domain IPs 104.21.36.46, 172.67.185.51, 2606:4700:3032::6815:242e, 2606:4700:3033::ac43:b933
Response IP 172.67.185.51
Found Yes
Hash c992c31be2a47bc56593c064ad96ff9191bfe9c80b072a3256461820e9d52b2d
SimHash 8154432a6af1

Groups

*

Rule Path
Disallow /admin/
Disallow /ex_abroad/
Disallow /ex_host/
Disallow /ex_run/
Disallow /ex_study/
Disallow /exchange/
Disallow /bin/
Disallow /formmail/
Disallow /ex_profiles.bak/
Disallow /ex_profiles.bak_b/
Disallow /ex_profiles_new/
Disallow /ex_profiles_revsn/
Disallow /ex_profiles_test/
Disallow /ex_training/
Disallow /slideshow/
Disallow /ftp/
Disallow /htdocs/
Disallow /images/
Disallow /photos/
Disallow /Templates/
Disallow /video/
Disallow /Forms/
Disallow /wordpress/
Disallow /*.gif$
Disallow /*.css$
Disallow /alumni_club.html
Disallow /aspfn_home.html
Disallow /college.htm
Disallow /default.html
Disallow /host.htm
Disallow /letter.htm
Disallow /listng.htm
Disallow /main.htm
Disallow /old_index.htm
Disallow /opportun.htm
Disallow /out.htm
Disallow /rep.htm
Disallow /title.htm
Disallow /usa.htm
Disallow /ex_indexl
Disallow /student_hf_forms.html
Disallow /wp-content/uploads/
Disallow /media/docs/
Disallow /media/pdf/
Disallow /media/Melting_Pot/
Disallow /pdf/
Disallow /videos/

Comments

  • robots.txt for http://www.aspectfoundation.org/
  • use this for all robots
  • Disallow the following directories.
  • Disallow the following files.