Program Evaluation
Annual Reports
2020 Annual Report Program Evaluation Results & Subsequent Program Modifications
Evaluation of the Counseling Program during 2020 while waiting for the Council for
Accreditation of Counseling and Related Programs (CACREP) scheduled visit, and with
course changes due to COVID-19 restrictions indicated the following results and modifications.
Most modifications provided below are applicable to both Clinical Mental Health Counseling
(CMHC) and School Counseling (SC) programs. When only relevant to one specialty area,
the individual program is identified.
Reporting Measures Coming Soon!
2019 Annual Report Program Evaluation Results & Subsequent Program Modifications
Evaluation of the Counseling Program during 2019 while completing the Council for Accreditation of Counseling and Related Programs (CACREP) self-study, indicated the following results and modifications. Most modifications provided below are applicable to both Clinical Mental Health Counseling (CMHC) and School Counseling (SC) programs. When only relevant to one specialty area, the individual program is identified. We applied for CACREP accreditation in Fall 2019.
Summary of Program Evaluation
- Overall our program performs well with 100% pass rates in both school counselor certification exam (i.e., TExES for school counselors) and professional counseling licensure exam (i.e., National Counselor Examination) exam.
- Stakeholders indicate that the program is meeting the needs of the students and their future clients. Stakeholder survey returns are low.
- Key Performance Indicators demonstrates that instruction is successful in most areas are meeting target expectations on standards.
- Disposition data indicate that student screening is efficient in minimizing dispositional issues through the program. Disposition completion at set point is low.
- Graduation rate indicate that students are graduating in a timely manner. Not all who enter complete the program. Most leave the program due to a lack of fit with career expectations.
- Transition I and II point data indicate that more than 97% of our students earn B or better grades.
- The Advisory Committee indicate that the Counseling Program meet the needs of the community.
- Overall results from program evaluation indicate that irrespective of program (i.e., CMHC or SC) and location (i.e., Clear Lake or Pearland), the program is meeting training needs of future counselors.
Subsequent Program Modifications
- Make intentional relationships with area employers to increase employer surveys
- Visit sites more frequently to build relationships to increase site supervisor surveys
- Involve alumni and site supervisors in the program through offering continuing education
- Remind faculty to complete KPIs and dispositions at the end of semester
- Discuss ways to retain students by intentional selection, interview, and orientation process.
- Request appropriate designation to separate programmatic evaluations by program focus (i.e., Clinical Mental Health Counseling [CMHC] and School Counseling [SC]). Separating by location is unnecessary due to the Counseling Program offered only at the Pearland from Summer 2020.
Other Substantial Program Changes
- Establish further written policies regarding student admission, retention, remediation, and dismissal
- Modify the admission process due to increased number of applicants.
- Develop marking material.
- Improve retention rates.
- Request faculty lines to replace faculty who have retired to maintain appropriate student to core faculty ratios.
- Increase School Counselor enrollment through launch of the approved Hybrid Program
Number of Graduates 2019
Semester/Year | Clinical Mental Health Counseling | School Counseling | ||
---|---|---|---|---|
C | P | C | P | |
Spring 2019 | 5 | 3 | ||
Summer 2019 | 4 | |||
Fall 2019 | 3 | 6 | 1 | |
Total | 12 | 6 | 4 |
Completion Rate CMHC 2019
Category | Cohort | SP 19 CMHC |
Su 19 CMHC |
FA 19 CMHC |
|||
---|---|---|---|---|---|---|---|
C | P | C | P | C | P | ||
Starters | n/a | 16 | 15 | ||||
Graduates | n/a | 5 | 4 | 3 | 6 | ||
Completion Rates | Spring 16 | 100% | |||||
Completion Rates | Fall 16 cohort | 36% | 55%* | ||||
Completion Rates | Spring 17 cohort | 90%** |
Note: C = Clear Lake; P = Pearland;
* 3 dropped out during first semester; 2 students did not meet anticipated graduation
date
** 1 student did not meet anticipated graduation date
Completion Rate SC 2019
Category | Cohort | SP 19 SC |
Su 19 SC |
FA 19 SC |
|||
---|---|---|---|---|---|---|---|
C | P | C | P | C | P | ||
Starters | n/a | 1 | 5 | ||||
Graduates | n/a | 1 | 1 | ||||
Completion Rates | Fall 16 cohort | 33%+ | 66%* | ||||
Completion Rates | Spring 17 cohort | 100% |
+ Early graduation' 1 of 3 dropped out
Job Placement Rate 2019
Semester/Year | Clinical Mental Health Counselors | School Counselors |
---|---|---|
Spring 2019 | 100% | 100% |
Summer 2019 | 0% | |
Fall 2019 | 55% | 100% |
State Licensing and Certification Results 2019
Semester/Year | Clinical Mental Health Counseling | School Counseling |
---|---|---|
Spring 2019 | 100% | 100% |
Fall 2019 | 100% | 100% |
Stakeholder Survey Return Rates 2019
Spring | Summer | Fall | ||||
---|---|---|---|---|---|---|
CMHC | SC | CMHC | SC | CMHC | SC | |
Completer | 2 | 9 | 2 | |||
Site Supervisor | 1 | 5 | 2 | |||
Alumni | 3 | |||||
Employer | 0 | 0 | 0 | 0 |
Completer Survey 2019
Summer 2019 CMHC | Fall 2019 CMHC | Fall 2019 SC | |
---|---|---|---|
Rate | 50% (2/4) | 100% | 100% |
Research, Workshop, Award | 100% No | 11% Yes 89% No |
100% -No |
Satisfied with courses | 50% Highly 50% Satisfied |
67% Highly 22% Satisfied 11% Highly Dissatisfied |
50% Highly 50% Satisfied |
Professional Orientation and Ethical Practice | 50% Advanced 50% Intermediate |
44% Advanced 56% Intermediate |
50% Advanced 50% Intermediate |
Social and Cultural Diversity | 100% Advanced | 56% Advanced 44% Intermediate |
100% Advanced |
Human Growth and Development | 100% Intermediate | 67% Advanced 33% Intermediate |
100% Intermediate |
Career Development | 100% Basic | 11% Advanced 67% Intermediate 22% Basic |
100% Basic |
Helping Relationships | 50% Advanced 50% Intermediate |
8% Advanced 11% Intermediate |
50% Advanced 50% Intermediate |
Group Work | 100% Intermediate | 67% Advanced 33% Intermediate |
100% Intermediate |
Assessment | 100% Intermediate | 11% Advanced 67% Intermediate 2% Basic |
100% Intermediate |
Research and Program Evaluation | 50% Intermediate 50% Basic |
22% Advanced 56% Intermediate 11% Basic 11% Limited |
50% Intermediate 50% Basic |
Site Supervisor Survey Results 2019
Summer 19 | Fall 19 | |||
---|---|---|---|---|
CMHC | SC | CMHC | SC | |
Return Rate | 25% | 5 | 2 | |
Professional Orientation and Ethical Practice | 9 | No response | no response | |
Social and Cultural Diversity | 9 | 9.6 | 10 | |
Human Growth and Development | 9 | 9.6 | 10 | |
Career Development | no response | 10 | 10 | |
Helping Relationships | 9 | 9.6 | 10 | |
Group Work | 9 | 9.6 | 10 | |
Assessment | 9 | 9.4 | 10 | |
Research and Program Evaluation | no response | 10 | 10 |
CMHC
Alumni Survey Results 2019
Item | # Completed |
---|---|
Number completed survey | 3 |
Gender | Female |
Professional Organizations | 3 |
Presentations | 2 |
Currently Employed | 3 |
Relevance to degree | 3 |
Identity and Wellness Survey Results 2019
Summer 19 | Summer 19 | Fall 19 | Fall 19 | |
---|---|---|---|---|
Location/Program | Clear Lake/CMHC | Clear Lake/SC | *Clear Lake & Pearland/CMHC | SC |
Response Rate | 100% | 89% | 0% | |
Number of Students | 4/4 | 8/9 | 1 | |
Wellness | ||||
Selected a career of interest and value | 100% A | 88% A 13% SA |
No response | |
Developed skills and keep them current | 100% A | 88%A 13%SA |
No response | |
Self-care and healthy habits | 50% A 50% SA |
75% A 25% SA |
No response | |
Engage in reflective activity | 50% A 50% SA |
88% A 13% SA |
No response | |
Professional Identity | ||||
Organization Membership | 100% | 88% | No response | |
Service | 75% | 50% | No response | |
Conference attendance | 50% | 25% | No response | |
Association Meeting | 50% | 25% | No response |
Note: A = Agree; SA = Somewhat agree
*cannot separate the data
KPI Aggregate Data for 2019
Standard/Area | Clear Lake | Pearland |
---|---|---|
2.F.1: Professional Counseling Orientation and Ethical Practice | 100% | 100% |
2.F.2: Social and Cultural Diversity | 100% | 100% |
2.F.3: Human Growth and Development | 99% | 99% |
2.F.4: Career Development | 99% | 99% |
2.F.5: Counseling and Helping Relationships | 97% | 97% |
2.F.6: Group Counseling and Group Work | 100% | 100% |
2.F.7: Assessment and Testing | 100% | 100% |
2.F.8: Research and Program Evaluation | 85.2% | 85.2% |
5.C: Specialty Area - Clinical Mental Health Counseling - 1st Measure | 92.6% | 92.6% |
5.C: Specialty Area - Clinical Mental Health Counseling - 2nd Measure Transcript and Treatment Plan Prac III |
90% | 90% |
5.G: Specialty Area- School Counseling -1st Measure Models |
100% | 100% |
5.G: Specialty Area- School Counseling - 2nd Measure | 100% | 100% |
Note: Percentage that met or exceeded expectations
Professional Disposition Aggregate Data 2019
Clear Lake | |||
---|---|---|---|
Disposition | Acceptable | Need Improvement | Unacceptable |
Professional Responsibility | 97% | 3% | |
Collegiality | 100% | ||
Diversity | 100% | ||
Learning | 100% | ||
Integrity | 100% |
Pearland | |||
---|---|---|---|
Disposition | Acceptable | Need Improvement | Unacceptable |
Professional Responsibility | 100% | ||
Collegiality | 100% | ||
Diversity | 100% | ||
Learning | 100% | ||
Integrity | 100% |
Grades Aggregate Data 2019
Semester | Transition Point 1 (by Pre Practicum) |
Transition Point 2 (by Practicum II) |
---|---|---|
Spring 2019 | 95% earned B or better | 93.75% earned a B or better |
Summer 2019 | 93.33% earned a B or better | |
Fall 2019 | None | 100% earned a B or better |
Applicant Demographics CMHC
Spring 2019 Pearland |
Fall 2019 Clear Lake |
|||
---|---|---|---|---|
CMHC | SC | CMHC | SC | |
Gender | ||||
Female | 22 | 6 | 48 | 10 |
Male | 6 | 1 | 8 | 0 |
Ethnicity | ||||
Asian | 2 | 1 | 3 | 0 |
American Indian | 0 | 0 | 0 | 0 |
Black | 3 | 1 | 8 | 2 |
Hispanic | 9 | 3 | 16 | 2 |
Multi | 1 | 0 | 3 | 1 |
White | 13 | 2 | 25 | 5 |
Not Specified | 0 | 0 | 1 | 0 |
2018 Annual Report Program Evaluation Results & Subsequent Program Modifications
Evaluation of the Counseling Program during 2018 while completing the Council for Accreditation of Counseling and Related Programs (CACREP) self-study, indicated the following modifications. Most modifications provided below are applicable to both Clinical Mental Health Counseling (CMHC) and School Counseling (SC) programs. When only relevant to one specialty area, the individual program is indicated.
- Establish additional written policies regarding student admission, retention, remediation, and dismissal.
Such policies were established and published. Policies affecting students directly are available in the Student Handbook. Other program operation related policies are available on the Faculty Shared Drive. - Adapt College of Education dispositional statement.
Counseling Program faculty modified and adapted the College of Education disposition statement. This document is available under professional dispositions.
- Update the Counseling Program Exit Interview to align with national accreditation standards and distribute through Qualtrics for
efficient data gathering.
The updated Counseling Program Exit Interview is now distributed through Qualtrics.
- Develop and disseminate an Alumni and Employer Survey aligned with national accreditation standards.
Survey results available upon request from Dr. Perera.
Because UHCL student emails are non-functional upon one year of graduation, student personal emails are collected during Practica experience to follow up with alumni surveys.
- Compile Site Supervisor Feedback and implement suggestions.
Site supervisor feedback on student performance did not indicate need for any significant changes. Feedback is collected on an ongoing basis and is reviewed in program meetings.
To capture site supervisor program evaluation, two questions were added to the existing site supervisor evaluation of student form.
- Solicit input from the Advisory Committee for programmatic changes.
Advisory Committee met in Fall 2017 and Spring 18. Suggestions and resultant changes.- Aligned the program to new LPC Board rules (CMHC)
- Improved student community involvement
- Marketed the program with new flyers
- Made site information available to students
- Changed summer class offerings to 8-week session
- Pursuing national accreditation
- Developing a different (online/hybrid) option to improve school counseling student enrollment (SC)
- Establish Key Performance Indicators(KPI) in Taskstream with rubrics for evaluation.
Key Performance Indicators identified and Rubrics for evaluation built into Taskstream for all eight core areas for national accreditation. Data collection for KPIs began in Spring 2018.
- Develop an online site-supervisor training option.
Online site-supervisor training option is available as of Spring 2019
- Develop marking material.
Flyers and promotional cards were developed and approved. Need to continue to develop more marketing material to recruit students.
- Revise Program’s Web presence.
Website was updated with video presence. Updated all pages of the Website with significant changes to the student resource section. Further, we aligned our Website to meet CACREP requirements. The following social media were developed and are maintained for the Counseling Program.
- Facebook: @uhclcounselingprogram
- Instagram: @uhclcounselingprogram
- LinkedIn: @uhclcounselingprogram
- Twitter: @UHCL_Counseling
- Improve community engagement of students.
Students and Faculty organized and participated in community events in Spring18 (i.e., Galveston Food Bank), Summer 18 (i.e., HIV/AIDS Walk) and Fall 18 (i.e., Suicide Prevention Walk, Food Drive for Bridge Over Troubled Waters, and a School Supply Drive for Kate Bell Elementary
- Conduct a scope and sequence evaluation.
Completed scope and sequence evaluation and submitted course change forms through the Academic Review Committee
- Separate programmatic evaluations by specialty (i.e., CMHC and SC).
CMHC Program Evaluation Results
Ø Continue with offering quality courses to maintain 100% pass rate on NCE
SC Program Evaluation Results
- Continue with offering quality courses to maintain 100% pass rate on TExES
- Offer a different (online/hybrid) option to improve school counseling student recruitment and enrollment
Number of Graduates
Semester/Year | Clinical Mental Health Counseling | School Counseling |
---|---|---|
Spring 2018 | 1 | 9 |
Fall 2018 | 4 | 0 |
Completion Rate
Category
Cohort
Spring 18 CMHC
Spring 18 SC
Fall 18 CMHC
Fall 18 SC
Starters
n/a
15
5
13
2
Graduates
n/a
1
9
n/a
n/a
Completion Rates
Spring 15 cohort
100%
n/a
n/a
n/a
Completion Rates
Fall 15 cohort
n/a
71%
66%
71%
Completion Rates
Spring 16 cohort
n/a
n/a
n/a
71%
Job Placement Rate
Term/Year | Clinical Mental Health Counselors | School Counselors |
---|---|---|
Spring 2018 | 100% | 100% |
Fall 2018 | 100% | No graduates |
State Licensing and Certification Results
Term/Year | NCE for Clinical Mental Health Counselors | TExES for School Counselors |
---|---|---|
Spring 2018 | 100% | 100% |
Fall 2018 | 100% | 100% |