missioncollege.edu
robots.txt
Robots Exclusion Standard data for missioncollege.edu
Resource Scan
Scan Details
Site Domain | missioncollege.edu |
Base Domain | missioncollege.edu |
Scan Status | Ok |
Last Scan | 2024-09-21T00:21:25+00:00 |
Next Scan | 2024-10-21T00:21:25+00:00 |
Last Scan
Scanned | 2024-09-21T00:21:25+00:00 |
URL | https://missioncollege.edu/robots.txt |
Domain IPs | 104.21.77.52, 172.67.204.169, 2606:4700:3031::ac43:cca9, 2606:4700:3033::6815:4d34 |
Response IP | 172.67.204.169 |
Found | Yes |
Hash | cae30ee80b31b4ccf22e972a357459c7d576c1f1900fdcc59cc8aa8fffc16f84 |
SimHash | e11752e74d74 |
Groups
*
Rule | Path |
---|---|
Allow | /_resources/css/ |
Allow | /_resources/ |
Allow | /_resources/includes/ |
Allow | /_resources/javascript/ |
Allow | /_resources/images/ |
Disallow | /news/press/ |
Disallow | /_archive/ |
Disallow | /_test/ |
Disallow | /_training/ |
Disallow | /analytics_sandbox |
Disallow | /documents |
Disallow | /test/ |
Disallow | /z-developer/ |
Disallow | /datatable_test/ |
Disallow | /design-templates/ |
Disallow | /ldp/ |
Disallow | *omniUpdate |
Disallow | /slideshow/ |
Disallow | /dir.html |
Disallow | /*.pdf$ |
Disallow | /*.doc$ |
Disallow | /*.docx$ |
Disallow | /*.inc$ |
gsa-crawler
Rule | Path |
---|---|
Allow | /_resources/css/ |
Allow | /_resources/ |
Allow | /_resources/includes/ |
Allow | /_resources/javascript/ |
Allow | /_resources/images/ |
Disallow | /.private_ldp |
Disallow | /_test/ |
Disallow | /_training/ |
Disallow | /analytics_sandbox |
Disallow | /documents |
Disallow | /test/ |
Disallow | /z-developer/ |
Disallow | /datatable_test/ |
Disallow | /design-templates/ |
Disallow | *omniUpdate |
Disallow | /slideshow/ |
Disallow | /dir.html |
Disallow | /*.pdf$ |
Disallow | /*.doc$ |
Disallow | /*.docx$ |
Disallow | /*.inc$ |
googlebot-image
Rule | Path |
---|---|
Disallow | /news/press/ |
Disallow | /inside_mission/ |
Disallow | /.private_ldp |
Disallow | /_test/ |
Disallow | /_training/ |
Disallow | /analytics_sandbox |
Disallow | /resources/ |
Disallow | /test/ |
Disallow | /z-developer/ |
Disallow | /datatable_test/ |
Disallow | /design-templates/ |
Disallow | /omniUpdate/ |
Disallow | /slideshow/ |
Disallow | /dir.html |
Disallow | /*.pdf$ |
Disallow | /*.doc$ |
Disallow | /*.docx$ |
Disallow | /*.inc$ |
Disallow | /inside_mission/ |
Other Records
Field | Value |
---|---|
sitemap | https://missioncollege.edu/sitemap.xml |