“Ginger Rogers did everything [Fred Astaire] did—only backwards and in high heels” (Thaves 1982). Small institutions can identify with Ms. Rogers, as they have the same operational, reporting and accreditation requirements as their larger counterparts but must carry them out with fewer human and other resources. Small institutions are too often “people poor.” That fact was brought home forcefully to the institutional self-study team at the University of Charleston (UC) when the Higher Learning Commission (HLC) published its revised Criteria for Accreditation in February 2012. The self-study team struggled with determining how to comply with the new Criterion 5.D., which mandated that the institution provide documentary evidence that it “works systematically to improve its performance” within the constraints of limited human and financial resources.
As is often the case at small institutions, many UC administrators have responsibility for multiple functions, and some are one-person departments. These individuals had little enthusiasm for initiating a process requiring an additional report and even less enthusiasm for the idea that their departments’ performance would be “judged” by others. No administrative office was willing to take responsibility for overseeing a new evaluation process or providing administrative support for the effort.
Faced with these challenges, the self-study team turned to the academic side of the institution for help implementing a new administrative assessment process. The assistant dean for Assessment, who was also co-chair of the institutional self-study team, was tasked with oversight of implementation using some guiding precepts:
- Recruit current or former members of the Academic Assessment Committee to volunteer their time as an ad hoc Quality Assurance Committee to evaluate the reports.
Initially, administrative and academic support departments were asked only to submit a plan for assessment. The report template for the plan asked for the following information:
- Vision for the future (including an analysis of strengths, weaknesses, opportunities and threats)
In subsequent years departments were asked to submit quality assurance (QA) reports. The QA reports document data collection and describe how the data are being used to make improvements to operations. Elements included in the QA report but not required in the plan document include the following:
- Plan for continuity of functions (Are employees cross-trained? Are procedure manuals in place?)
Reports are scored using a weighted rubric. Results are communicated to department heads and the vice president responsible for each department using a standard feedback sheet. A table reporting scores for all departments, selected feedback comments and identified resource needs is communicated to the board of trustees and the cabinet.
The QA process has proved itself useful for documenting evidence beyond that needed for Criterion 5.D. The QA report to the board of trustees and cabinet communicates resource needs for consideration in the budget process as required in Core Component 5.C.2. The questions about continuity of functions were initially included to identify and address areas of institutional risk related to employee turnover, a common problem at small institutions that may have only one or two staff members in a department. However, that question and the requirement to document employee credentials also provide evidence needed for Criterion 5.C. (institutional planning) and 3.C.6. and 5.A.4. (employee credentials).
The QA process is maturing each year, with better rubric language and more precise instructions. In fall 2015, UC formally institutionalized the QA process by creating a standing Quality Assurance Committee. Chaired by the assistant dean for Assessment, the committee membership includes key administrators, a vice president and a faculty officer. UC’s four vice presidents will rotate membership, serving a two-year term. Including a faculty officer is expected to improve understanding and communication between faculty members and administrators.
UC administrators are beginning to see value in the QA process. The process serves as an important institutional vehicle for publicly celebrating the accomplishments of its employees and offices. For example, UC’s Financial Aid Office documented significant decreases in cohort loan default rates, resulting in UC’s default rate being one-third that of the West Virginia average and one-half the national average. Facilities Services documented a significant increase in the tons of waste material sent for recycling. These accomplishments were noted in the report sent to the board of trustees and will be noted in the university’s Annual Assessment Report. In the past, these achievements would likely have been known to only a few people on campus.
The QA process has also resulted in departments identifying and eliminating tasks or initiatives that offer little return on their investment of time or money, streamlining operations or documenting resource needs. The Office of Advancement identified a particular event that consumed human and financial resources each spring but did not gain enough new donors to justify their investment.
In fall 2015 the time commitment for QA Committee members was approximately 25 hours. As department heads become more skilled at assessing their operations and collecting data, report preparation is taking less time. The director of the Academic Success Center commented that it took only 30 minutes to complete her 2015 report.
In December 2015, UC completed its fourth quality assurance cycle. The process is not yet perfect and may never be, as important lessons are being learned in the course of each cycle. Some of the more important advice UC can give to other institutions considering implementing a similar process includes the following points:
- Take advantage of the process to document evidence for other HLC Criteria.
The University of Charleston is satisfied that the process put in place meets the demands of Criterion 5.D. and is realistically sustainable with current human and financial resources. UC also believes that similar opportunities to adapt existing processes exist at other small institutions and should be considered as a means of documenting continuous operational improvement.
Thaves, R. 1982. Fred Astaire Film Festival (cartoon). Frank & Ernest. Kansas City, MO: Newspaper Enterprise Association, May 3. http://www.frankandernest.com/search/index.php?kw=astaire