smc.edu
robots.txt

Robots Exclusion Standard data for smc.edu

Resource Scan

Scan Details

Site Domain smc.edu
Base Domain smc.edu
Scan Status Ok
Last Scan2025-09-24T12:48:45+00:00
Next Scan 2025-10-24T12:48:45+00:00

Last Scan

Scanned2025-09-24T12:48:45+00:00
URL https://smc.edu/robots.txt
Redirect https://www.smc.edu/robots.txt
Redirect Domain www.smc.edu
Redirect Base smc.edu
Domain IPs 3.209.26.193
Redirect IPs 3.209.26.193, 34.236.193.193, 52.73.2.219
Response IP 52.73.2.219
Found Yes
Hash 52e4301e6768560414878e1bbf4f5226dbfec2c8a5a8e9b7476899136d85362e
SimHash 4882d824b750

Groups

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /
Disallow /_qa
Disallow /_resources/
Disallow /_showcase/
Disallow /_sandbox/
Disallow /_training/
Disallow /_uat/
Disallow /smc-community/
Disallow /search-1/
Disallow /*.inc$
Disallow */_props.pcf$
Disallow /*?d=*&m=*
Disallow /administration/information-technology/academic-computing/student-it-help/answer/
Disallow /news/in-focus/2018/vol-iv-issue-5/05-02-welcome-back.php
Disallow /news/in-focus/2018/vol-iv-issue-1/01-04-greg.php
Disallow /academics/classes/2018-19/
Disallow /academics/classes/2019-20/
Disallow /academics/classes/2020-21/
Disallow /academics/classes/2021-22/
Disallow /academics/classes/2022-23/
Disallow /academics/classes/2023-24/summer-2023/
Disallow /administration/information-technology/academic-computing/peterson_lee/

Other Records

Field Value
sitemap https://www.smc.edu/sitemap.xml

Comments

  • Group 1
  • Group 2