westvalley.edu
robots.txt
Robots Exclusion Standard data for westvalley.edu
Resource Scan
Scan Details
| Site Domain | westvalley.edu |
| Base Domain | westvalley.edu |
| Scan Status | Ok |
| Last Scan | 2024-11-20T05:54:45+00:00 |
| Next Scan | 2024-12-20T05:54:45+00:00 |
Last Scan
| Scanned | 2024-11-20T05:54:45+00:00 |
| URL | https://westvalley.edu/robots.txt |
| Redirect | https://www.westvalley.edu/robots.txt |
| Redirect Domain | www.westvalley.edu |
| Redirect Base | westvalley.edu |
| Domain IPs | 104.21.54.168, 172.67.140.173, 2606:4700:3033::ac43:8cad, 2606:4700:3037::6815:36a8 |
| Redirect IPs | 104.21.54.168, 172.67.140.173, 2606:4700:3033::ac43:8cad, 2606:4700:3037::6815:36a8 |
| Response IP | 104.21.54.168 |
| Found | Yes |
| Hash | 1710a8859d145ef943cf2f0fd98bf0c5b7d07955111930e8ab613a51dba2fdaf |
| SimHash | a79403aa4d62 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /documents/Educational_and_Facilities_Master_Plan/ |
| Disallow | /_academics/* |
| Disallow | /_archive/ |
| Disallow | /_campaigns/ |
| Disallow | /_data/ |
| Disallow | /*archive* |
| Disallow | /_resources/ |
| Disallow | /_services/* |
| Disallow | /_showcase |
| Disallow | /_testing/ |
| Disallow | /_testing-ss/ |
| Disallow | /_training/ |
| Disallow | /academics/fine_arts/theater/sign-up.html |
| Disallow | /admissions/metro.html |
| Disallow | /admissions/outreach/sign-up.html |
| Disallow | /catalog/_development-2022-2023/* |
| Disallow | /catalog/_development-2023-2024/* |
| Disallow | /common/ |
| Disallow | /committees/_archived-committees/* |
| Disallow | /committees/All_College_Day/calendar/* |
| Disallow | /committees/Basic_Skills_Advisory/calendar/* |
| Disallow | /committees/College_Council/calendar/* |
| Disallow | /committees/Distance_Learning_Committee/calendar/* |
| Disallow | /committees/Distance_Education/calendar/* |
| Disallow | /committees/Global_Education/calendar/* |
| Disallow | /department/graphics/requests/ |
| Disallow | /documents/ |
| Allow | /documents/schedules/ |
| Disallow | /email/ |
| Disallow | /errors/ |
| Disallow | /events/special/convocation/forms |
| Disallow | /faculty/lopez_a_faculty.xml |
| Disallow | /faculty/babakan.html |
| Disallow | /files/ |
| Disallow | /home/ |
| Disallow | /images/ |
| Disallow | /ldp-galleries/ |
| Disallow | /library/_library-testing/* |
| Disallow | /library/_library-testing/databases-internal.html |
| Disallow | /library/databases/databases-internal.html |
| Disallow | /library/new-materials/* |
| Disallow | /library/discovery.html |
| Disallow | /metro/ |
| Disallow | /mobile/ |
| Disallow | /resources/ |
| Disallow | /committees/_archive/ |
| Disallow | /test/ |
| Disallow | /migration-export/ |
| Disallow | /z-development/ |
| Disallow | /z-testing/ |
| Disallow | /ia/ |
| Disallow | /ia/pages/ |
| Disallow | /ia/pages/contact/ |
| Disallow | /id/ |
| Disallow | /business/bus_admin_re/ |
| Disallow | /faculty/SPECIAL_LINK* |
| Disallow | /faculty/_archive/ |
| Disallow | /wvcas/documents/ |
| Disallow | /wvcas/calendar/ |
| Disallow | /wvccs/calendar.html |
| Disallow | /wvccs/calendar.html/* |
| Disallow | /wvcsports/calendar/* |
| Disallow | /wvcsports/spirit-team/* |
| Disallow | /stuact/calendar/ |
| Disallow | /calendar/academic/ |
| Disallow | /search/ |
| Disallow | /ph |
| Disallow | /dir.html |
| Disallow | /*.pdf$ |
| Disallow | /*.doc$ |
| Disallow | /*.inc$ |
| Disallow | /*_faculty.xml$ |
| Disallow | /*.profile.xml$ |
| Disallow | /*_properties.xml$ |
| Disallow | *day.html? |
| Disallow | *day.php? |
| Disallow | *e_edit.php? |
gsa-crawler
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /documents/Educational_and_Facilities_Master_Plan/ |
| Disallow | /_academics/* |
| Disallow | /_archive/ |
| Disallow | /_campaigns/ |
| Disallow | /_data/ |
| Disallow | /_resources/ |
| Disallow | /_services/* |
| Disallow | /_showcase |
| Disallow | /_testing/ |
| Disallow | /_testing-ss/ |
| Disallow | /_training/ |
| Disallow | /academics/fine_arts/theater/sign-up.html |
| Disallow | /admissions/metro.html |
| Disallow | /admissions/outreach/sign-up.html |
| Disallow | /catalog/_development-2022-2023/* |
| Disallow | /catalog/_development-2023-2024/* |
| Disallow | /common/ |
| Disallow | /committees/_archived-committees/* |
| Disallow | /committees/All_College_Day/calendar/ |
| Disallow | /committees/Basic_Skills_Advisory/calendar/ |
| Disallow | /committees/College_Council/calendar/ |
| Disallow | /committees/Distance_Learning_Committee/calendar/ |
| Disallow | /committees/Distance_Education/calendar/ |
| Disallow | /committees/Global_Education/calendar/ |
| Disallow | /documents/ |
| Allow | /documents/schedules/ |
| Disallow | /email/ |
| Disallow | /errors/ |
| Disallow | /events/special/convocation/forms |
| Disallow | /files/ |
| Disallow | /faculty/lopez_a_faculty.xml |
| Disallow | /id/ |
| Disallow | /images/ |
| Disallow | /home/ |
| Disallow | /ldp-galleries/ |
| Disallow | /library/_library-testing/* |
| Disallow | /library/_library-testing/databases-internal.html |
| Disallow | /library/databases/databases-internal.html |
| Disallow | /library/new-materials/* |
| Disallow | /library/discovery.html |
| Disallow | /metro/ |
| Disallow | /mobile/ |
| Disallow | /resources/ |
| Disallow | /committees/_archive/ |
| Disallow | /test/ |
| Disallow | /migration-export/ |
| Disallow | /z-development/ |
| Disallow | /z-testing/ |
| Disallow | /ia/ |
| Disallow | /ia/pages/ |
| Disallow | /ia/pages/contact/ |
| Disallow | /business/bus_admin_re/ |
| Disallow | /faculty/index.html |
| Disallow | /ph |
| Disallow | /wvcas/documents/ |
| Disallow | /wvcas/calendar/ |
| Disallow | /wvccs/calendar.html |
| Disallow | /wvccs/calendar.html/* |
| Disallow | /wvcsports/calendar/* |
| Disallow | /wvcsports/spirit-team/* |
| Disallow | /dir.html |
| Disallow | /*.pdf$ |
| Disallow | /*.doc$ |
| Disallow | /*.inc$ |
| Disallow | /*_faculty.xml$ |
| Disallow | /*.profile.xml$ |
| Disallow | /*_properties.xml$ |
| Disallow | *day.html? |
| Disallow | *day.php? |
| Disallow | *e_edit.php? |
googlebot-image
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /_academics/* |
| Disallow | /_archive/ |
| Disallow | /campaigns/ |
| Disallow | /_data/ |
| Disallow | /_resources/ |
| Disallow | /_services/* |
| Disallow | /_showcase |
| Disallow | /_testing/ |
| Disallow | /_testing-ss/ |
| Disallow | /_training/ |
| Disallow | /admissions/metro.html |
| Disallow | /campus-center/* |
| Disallow | /catalog/_development-2022-2023/* |
| Disallow | /catalog/_development-2023-2024/* |
| Disallow | /common/ |
| Disallow | /committees/_archived-committees/* |
| Disallow | /documents/ |
| Disallow | /email/ |
| Disallow | /errors/ |
| Disallow | /events/special/convocation/forms/ |
| Disallow | /files/ |
| Disallow | /home/ |
| Disallow | /images/ |
| Disallow | /ldp-galleries/ |
| Disallow | /library/_library-testing/* |
| Disallow | /library/_library-testing/databases-internal.html |
| Disallow | /library/databases/databases-internal.html |
| Disallow | /library/new-materials/* |
| Disallow | /library/discovery.html |
| Disallow | /metro/ |
| Disallow | /mobile/ |
| Disallow | /resources/ |
| Disallow | /committees/_archive/ |
| Disallow | /test/ |
| Disallow | /migration-export/ |
| Disallow | /z-development/ |
| Disallow | /z-testing/ |
| Disallow | /ia/ |
| Disallow | /ia/pages/ |
| Disallow | /ia/pages/contact/ |
| Disallow | /id/ |
| Disallow | /business/bus_admin_re/ |
| Disallow | /faculty/index.html |
| Disallow | /ph |
| Disallow | /wvcas/documents/ |
| Disallow | /wvcas/calendar/ |
| Disallow | /wvccs/calendar.html |
| Disallow | /wvccs/calendar.html/* |
| Disallow | /wvcsports/calendar/* |
| Disallow | /wvcsports/spirit-team/* |
| Disallow | /dir.html |
| Disallow | /*.psd$ |
Comments