Overview & Deadlines

Every department or program defines key learning outcomes for the major, prepares a curriculum map to link major courses to the outcomes, assesses student work to see how well the outcomes are being accomplished, and uses findings to improve curriculum, instruction, and assessment. Departments and programs also review their contributions to general education and assess selected courses to see how well students are achieving the general education outcomes. These activities are reported in an annual assessment update and triennial program report as indicated below.

Annual Assessment Update

Submit your Annual Assessment Update by June 30 each year.  Email your update to the chair of the Assessment Committee: Jeff Collett (jeffrey.a.collett@lawrence.edu).

Triennial Program Report

College:  Submit your Triennial Program Report by June 30 of the years indicated below.  Email your report to the Associate Dean of the Faculty: Bob Williams (robert.f.williams@lawrence.edu).

2017, 2020, 2023... 2018, 2021, 2024... 2019, 2022, 2025...

Humanities
Fine Arts
GER-competency

Natural Sciences
Math & Computer Science
Social Sciences
GER-distribution

Interdisciplinary Programs
GER-diversity

Conservatory: Submit your Triennial Program Report (form to be added) by June 30 of the years indicated below.  Email your report to the Associate Dean of the Conservatory: Andy Mast (andrew.mast@lawrence.edu).

2017, 2020, 2023... 2018, 2021, 2024... 2019, 2022, 2025...

Composition
Music Theory
Musicology

Music Performance
Jazz & Improv Music
Major Ensembles
Music Education

 

Academy of Music
Dance
Opera

 

+ Requirements

Every academic department or program does the following:

  • Defines key learning outcomes for the major and and prepares a curriculum map linking major requirements to those outcomes.
  • Assesses Senior Experiences and selected work in gateway courses to see how well students are achieving the outcomes.
  • Discusses findings to identify strengths and areas for improvement, and considers these in light of other evidence and past reports.
  • Plans follow-up actions, including probing areas of concern and adjusting curriculum, instruction, or assessment.
  • Summarizes these activities in annual assessment updates and triennial program reports.

The Assessment Committee does the following:

  • Assists departments with defining learning outcomes and creating assessment plans, including offering feedback on curriculum maps, rubrics, and assessment activities described in the annual update.
  • Coordinates GER assessment and summarizes findings across the university.
  • Compiles and archives assessment information for use by departments, the Curriculum Committee, the Provost's Office, and the Office of Research Administration.

To make assessment a manageable and valuable part of your department work, read the guiding principles (in the navigation menu) and use the templates and guide below.

 

+ Templates

  • Curriculum Map Template [XLS]
  • Rubric Template [DOC]
  • Department Report Template [DOC]
  • Committee Feedback Template [PDF]

 

Department & Program Assessment Guide

The sections below will guide you through the process of defining learning outcomes, creating a curriculum map, developing rubrics and assessment methods, using findings, and preparing an annual assessment update or triennial program report.

+ How to Define Learning Outcomes

Learning Outcomes

Learning outcomes say what students should be able to do upon completion of the major. While students are expected to grow in many ways and to develop their own interests and talents, every department or program should define a few key outcomes that all students in the major are expected to accomplish and that the department will assess to determine the effectiveness of its academic program.

Learning outcomes are written in the form:

Students should be able to <action verb> <object>.

Use just one action verb and one object to make the outcome assessable. State the outcome in language a student is likely to understand.

Examples:

<Department/program> majors should be able to:

Produce sound philosophical discourse.

Analyze a literary text.

Translate prose from Latin into English.

Critique a mathematical argument.

Design an experiment to test a hypothesis.

Describe monuments of art in historical context.

Design a performance environment for the production of a play.

Use tools of economic theory to analyze an economic problem.

Components

A useful strategy is to define one or more high-level outcomes that provide overarching goals for the major and then to define specific components that can be directly assessed in Senior Experiences and selected work from gateway courses for the major.  Each component can have its own rating scale or rubric.

Example:

Economics majors should be able to develop an economic analysis. Specifically, students should be able to:

Formulate a problem for economic analysis;

Find relevant literature that bears on the problem;

Interpret quantitative evidence and regression analyses;

(etc.)

Quality Standards

Quality standards for performance are spelled out in rubrics (see "How to Assess" below).


Tips:

  • Define learning outcomes for every major offered by the department or program. There is likely to be overlap, but there should also be differences that distinguish the majors.
  • Focus on a few key outcomes that are expected of all students and that will be assessed. Students should go beyond these outcomes in individual ways.
  • Avoid duplicating GER outcomes. For example, "Students will be able to follow disciplinary conventions when writing or speaking" is a GER outcome that can be assessed along with major outcomes when evaluating a Senior Experience.
  • State outcomes with just one action verb and one object. For high-level outcomes, define the components to be assessed
  • State outcomes plainly so that students, faculty, and others can understand what they mean and agree when they have been achieved.

 

+ How to Prepare a Curriculum Map

Map Outcomes to Requirements

Once learning outcomes have been defined, prepare a curriculum map that shows how the outcomes map onto major courses and other requirements.  The simplest way to do this is to make a table or spreadsheet with outcomes as rows and courses as columns.  Indicate which courses address each outcome and at what level: introductory / foundational / advanced - or - knowledge / application / synthesis, etc. The curriculum map will help you identify assessment points as well as gaps in the academic program.

Click here for a Curriculum Map Template (XLS).

 

+ How to Assess

This section describes how to make a rubric, use it to assess student work, and pool findings for review.


Make a rubric

For each outcome or component, create a rubric that describes performance at different levels of development.  Decide on a number of levels (from 3 to 5) and a label for each level (such as: 1 = initial, 2 = basic, 3 = proficient, 4 = advanced).  Make it clear which level is the target (3 = proficient).  Provide a description of performance at each level so faculty can rate work consistently and so students can use the rubric to check their own progress.

How to write a rubric

  1. Write a description for the "proficient" level first. This should clearly describe achievement of the outcome.
  2. Write a description for the "advanced" level next, indicating features that mark expert performance. This gives students a higher level to strive for and assessors a way to identify performance that is a model for others.
  3. Write a description for the "basic" level next, indicating features that are emerging but not yet mastered. This helps students identify how they are progressing.
  4. Write a description for the "initial" level last, identifying the foundation (prerequisite knowledge or skill) on which the outcome is built. This gives students and faculty a starting point for learning.
  5. Tweak the descriptions to clearly distinguish each level from the one just above and below, forming a progressive scale from initial to advanced.
  6. Edit descriptions to make them concise, and highlight the words or phrases that distinguish each level. This will make it easier to use the rubric to rate student work.
  7. Indicate which level is the target for students in the major.

Click here for a Rubric Template (DOC).

Sample rubrics:

Lawrence's GER rubrics

AAC&U VALUE rubrics

AALHE sample rubrics


Tips:

  • Give precise characteristics of performance at each level; avoid sweeping statements like "excellent," "average," or "poor."
  • State what is evident as well as what is lacking; avoid defining a level solely in terms of deficits ("lacks X, Y, Z... ").
  • Limit the criteria at each level; focus on the essential.
  • Contrast adjacent levels to make sure they distinguish performance well.
  • Avoid recapitulating the GER writing/speaking rubric. You can use that rubric alongside a rubric focused on major outcomes.
  • Test the rubric with samples of student work and check for consistency among raters. (Also do this for training before rating student work.)

Rate student work

To assess how well students are achieving key outcomes for the major, use the rubric to rate Senior Experiences (culminating projects or portfolios). Mark the level of achievement on the rating scale and jot comments on strengths and areas for improvement. This can be done for individual work, a collection of work, or samples from a larger body of work. The rubric can be incorporated into regular course grading or used separately to rate samples.

To assess the emergence of knowledge and skills at key points in the major, use the same rubric to assess selected work in gateway courses. Highlight the characteristics that resulted in work being classified at a particular level, and comment on strengths and areas for improvement. Look for patterns and compare findings to those for the Senior Experience.


Tips:

  • Focus the assessment: Select particular outcomes or components to assess at each point or in each cycle. Use findings from past assessments to guide you.
  • Sample widely: Rate a single item (a selected assignment) from many students to get a cross-section.
  • Divide the labor: Have one person rate major outcomes while another rates GER outcomes (writing or speaking), or have different people rate different components.
  • Check reliability: Have two or more assessors rate the same work and compare findings. (This is good training and can stimulate useful dialogue.)

Pool your findings

Gather faculty assessments of student work, both quantitative (ratings) and qualitative (comments). For each outcome, prepare a table, graph, or narrative summarizing the findings.  Describe common strengths and areas for improvement. Discuss these findings as a department and plan actions (see below).

Click here for a sample of how to report assessment data [PDF].

Click here for a sample Excel tool for computing results, from the Studio Art department [XLS].


Tips:

  1. Compare findings from your direct measures (assessment of student work) with those from indirect measures (surveys, focus groups, or structured interviews) to try to identify causes for the results you found.
  2. Use a chart or table to present the full range of data (not just the average). This will give a better sense of the variability in student performance.
  3. Look for patterns and compare to previous years.
  4. Relate your findings to your curriculum map as you consider what adjustments might improve student learning.

 

 

+ How to Use Findings

Assessment should stimulate useful conversations among department faculty.  Most important is that you use assessment findings to make improvements, large or small; otherwise, effort will have been expended for little benefit.  Accreditors are mainly interested in how we "close the loop" by using assessment findings for program improvement.

Discuss findings

Gather your ratings and comments and discuss them as a department.  Make this part of an annual retreat.

  1. Look for evidence of strengths and weaknesses in the academic program.
  2. Examine sample work as a group and discuss.
  3. Update your curriculum map and check where knowledge and skills are developed.
  4. Compare findings to previous years to identify trends.

Plan actions

  1. Consider possible changes to curriculum, instruction, or assessment.
  2. Plan follow-up (surveys, focus groups, student interviews) to gather more information on areas of concern.
  3. Decide how you will evaluate the impact of any program changes (what will you look for?).
  4. Document findings and planned actions for your annual assessment update.

Tips:

  • Tweak requirements, assignments, guides, etc., to close gaps in the academic program or strengthen areas of concern.
  • Refine your outcome statements, rubrics, and assessment methods to align them or to make them more useful and reliable (consistent across raters).
  • Identify earlier assessment points to gather developmental data or assess outcomes not addressed by the Senior Experience.  Selected assignments in required gateway courses can be used for this purpose.
  • Shift focus as needed: identify particular areas of concern to probe or follow up in the next assessment cycle.

 

+ How to Report

Every department or program submits an Annual Assessment Update summarizing learning outcomes, assessment methods, findings, and planned actions. The update should be concise and forthright: what you did, what you found, and what you're doing as a result. Your assessment update provides a record of progress and an important source of information for your Triennial Program Report. 

Prepare Annual Update

Use the Annual Assessment Update to prepare your update.  Fill in each section concisely as directed, and attach updated materials (curriculum map and rubrics).  Email your update by June 30 to the chair of the Assessment Committee (see top of page).

Prepare Triennial Report

Use the Triennial Program Report to prepare your report.  Gather material and write the State of the Department narrative.  Email your report by June 30 to the Associate Dean of the Faculty (see top of page).

 

+ What to Do After Reporting

Consult with the Assessment Committee

If you are planning to probe an area of concern or are considering changes to your learning outcomes, curriculum map, assessment methods, or rubrics, feel free to consult with the Assessment Committee for help.  Email the chair to get started.  If you receive feedback from the Assessment Committee on your annual update, please consider the committee's suggestions to improve your assessment processes or make them more useful to you.

Archive

Be sure to save your assessment materials (learning outcomes, curriculum map, and rubrics), updates and reports, and committee feedback in your department share space so they are available for follow-up studies and future reporting.

 

LarryU Facebook Twitter Instagram YouTube