What you need to know about assessment

Western Michigan University touts itself as a student-centered research university. As such, students are the main focus of our mission. We must be continually concerned with what our students learn and do what we can to improve. Assessment is at the core of the process by which we measure student learning and improve programs. Students should receive clear learning objectives so they know what they are expected to learn. Data should be collected that measures that learning, and most importantly, that data should be used to make improvements. The use of the data to improve student learning is the essence of assessment. In addition to contributing to the improvement of student learning, assessment results are used to address standards and requirements of professional and regional accreditation agencies. While "assessment for accountability" is often used as a driving factor for initiating assessment activities, on-going assessment is key for instructional planning and program development.

Gathering assessment data is in itself simply data collection. Assessment occurs when that data is analyzed to determine areas in which desired student learning is not occurring, or not occurring to the desired degree. Assessment in itself does not improve learning; it is the processes put in place due to the analysis of the data that improves learning.

Faculty and staff use assessment results when planning instruction, evaluating programs, and proposing curricular change. Assessment results provide information about the extent to which students have attained the intended learning outcomes and possess the knowledge, skills, and dispositions required for subsequent learning or professional practice.

Faculty and staff are deeply concerned that students leave their courses/programs with knowledge they didn’t possess when they entered. Assessment gives us the answer to this question and suggests areas in which improvement can be made. In this way, faculty and staff become engaged in the learning process of their students.

WMU has stated from the outset that assessment results will not be used to evaluate faculty or staff. Doing this defeats the purpose. If faculty thinks that results will be used against them, they will be hesitant to do assessment. In reality, faculty who are doing effective assessment should be rewarded no matter what the outcome of the data.

The easiest and possibly best way is to include this on the course syllabus and discuss on the first day of class or share with students prior to the start of a co-curricular program. It is always a good idea to link the specific learning outcomes of the course/program to the assessment methods being used. Faculty may feel that including this on the syllabus will make it too long. In that case, a short discussion of the assessment and how this relates to the learning outcomes can be given to the students as assignments are made.

In some programs, an outside accreditation body dictates the learning outcomes. When this is not the case, the faculty or staff of a particular unit can develop the outcomes. A simple way to develop these outcomes is to think about the skills or knowledge you want students to possess when they complete your program. Ideally, these would be skills or knowledge they do not have when they begin the program. An outcome could enhance a skill or knowledge the student has when they enter the program, however.

The fact that a student gets a grade at the end of the course, or receives grades on particular assignments and exams, usually is not effective assessment and often doesn’t supply much useful data. If a student gets a B in a class with 5 learning outcomes, it is impossible to tell how well the student achieved each one. One could assume that they learned each of the 5 at a B level, but this is only an assumption based upon no facts. It could be that the student achieved 4 of the 5 at an A level and flunked the fifth learning objective. The final grade of B does not indicate that the student did not achieve one of the learning outcomes. The same applies to grades on individual exams/assignments unless the exam/assignment is set up to assess only one learning objective.

Direct assessment is characterized by the use of a particular tool used to measure how well a student has achieved a particular learning outcome. Examples of direct assessment are rubrics, embedded exam questions, and evaluation of portfolio material. Indirect assessment occurs when impressions of learning are obtained. Indirect methods usually consist of a student or employer survey. Most accreditation bodies prefer direct methods of assessment.

Formative assessment refers to low-stakes tools that identify misconceptions, struggles, and learning gaps. These tools provide a means to give feedback to students on their learning at a certain point in time and can help instructors to improve their teaching.

Summative assessments evaluate student learning, knowledge, proficiency or success at the conclusion of an instructional period, like a unit, course or program.

Click on this link to visit the Carnegie Mellon University Eberly Center website for more in-depth information.

Not all assessment tools need to result in a numerical evaluation. It is fine to develop an objective way to measure certain outcomes as long as the assessment is as consistent as possible from student to student. In many cases, for example, portfolios are an excellent assessment tool. The material within a portfolio can be assessed in an objective way using specific learning outcomes. Judgments can be made about how well the student achieved the learning outcomes using non-numerical ratings.

Assessment reports help to show what assessment activities have occurred, what actions have been taken because of those activities, and if the actions had the desired outcome. They also provide information about how results were used to make improvements. Periodically completing an assessment report can be a catalyst for reflecting and acting upon assessment planning efforts including:

• Determining the current relevance of outcomes
• Thinking about news ways to assess outcomes (if needed)
• Providing time to ponder assessment results to help determine where to focus efforts for improvement

and

• Creating an action plan to address areas that have been found to need improvement.

There are many resources available on campus for help with assessment. Karen Stokes Chapo (@email) is available for assistance and to answer questions. This handbook contains numerous internal and external online resources. There are also people available to consult with departments, programs, and/or individuals, as well as provide more formal presentations on assessment-related topics. To request a visit and for more information, contact the Office of Institutional Effectiveness at: #387-3867.