You have a folder full of evidence. Syllabi, rubrics, exam papers, project reports, student surveys. The visiting team is months away and everything is fine. Then a course changes its code, a faculty member leaves, or a new accreditation criterion shifts the mapping — and suddenly half your evidence points to something that no longer exists.
This is what happens when evidence is collected but never reviewed. Collection is a faculty activity. Every instructor generates assessment data each term. Review is a coordinator activity — the systematic check that confirms every piece of evidence is still valid, still linked to the right criterion, and still strong enough to satisfy a visiting team that has never met you.
Accreditation standards require programs to demonstrate continuous monitoring of learning outcomes. Current accreditation criteria make this explicit: programs must show documented evidence that they review and act on assessment results. That review does not happen automatically. It requires a deliberate process that most programs do not have.
Here is how to build one.
Why Evidence Goes Stale (and Why It Matters)
Evidence has a shelf life. A rubric from Fall 2022 may have been perfect for the course as it was taught then. But if the course was revised in 2024 to add a new module, or if the grading scale changed, that rubric no longer represents current practice. The evidence is still in the folder. It just no longer proves what you think it proves.
Evidence goes stale for five common reasons:
- Course changes. A course is renamed, restructured, or retired. The evidence still points to the old version.
- Faculty turnover. The instructor who created the rubric leaves. The replacement teaches the same course differently, but nobody updates the evidence.
- Criterion shifts. The accreditor updates its criteria, and an indicator that was covered by three courses is now split between four. The old mapping is still in the system.
- Assessment method changes. A course switches from a written exam to a project-based assessment. The old exam paper is still linked as the primary evidence, even though it no longer represents how the outcome is measured.
- Time. Evidence from three years ago is simply too old to be relevant for a cycle that asks about current program performance.
Each of these is manageable on its own. Together, they create a silent decay that is only discovered when the visiting team asks a question and the coordinator cannot produce current evidence.
What a Systematic Evidence Review Looks Like
A systematic evidence review is not the same as a gap analysis. A gap analysis asks: "Do we have evidence for every indicator?" An evidence review asks a deeper set of questions: "Is the evidence we have still valid, still current, and still strong enough to support our self-study claims?"
The review follows four steps.
Step 1: Inventory
Start by listing every piece of evidence your program has collected for the current accreditation cycle. This means going indicator by indicator, course by course, and noting what evidence exists. Not whether it is good or bad — just whether it exists and where it lives.
If you are doing this from a spreadsheet, you will need to cross-reference three or four separate sheets. If you are using a connected evidence map, the inventory is a single view: every indicator, every course link, every evidence item, all on one screen.
During the inventory, flag anything that raises an immediate question. "This rubric is from 2021 — is it still in use?" "This course was retired in 2023 — why is evidence still linked to it?" "This indicator has only one piece of evidence — is that enough?"
Step 2: Validate
Validation means confirming that each piece of evidence still represents current program practice. For every flagged item from the inventory, you need a yes or no answer:
- Does this syllabus reflect the course as it is taught now?
- Does this rubric still match how the instructor grades?
- Is this student work sample from the current cohort, not from three years ago?
- Does this assessment data support the claim we are making in the self-study narrative?
Validation is the step where you involve course coordinators and faculty. You cannot validate evidence in a vacuum. You need the people who teach the courses to confirm that what is in the system matches what is happening in the classroom.
Step 3: Assess Strength
Not all evidence is created equal. A well-designed rubric with scoring data from 150 students is stronger than a rubric with no scoring data. A project report that explicitly maps to an outcome indicator is stronger than a general course description that mentions the indicator in passing.
During the strength assessment, you are looking for three things:
- Directness. Does the evidence directly measure the outcome it claims to support, or is it indirect? A rubric that scores problem-solving is direct evidence for that outcome. A syllabus that says "this course develops problem-solving" is not evidence at all.
- Recency. Is the evidence from the last 1-2 years, or is it from the previous accreditation cycle? Accreditors care about current program performance, not historical performance.
- Breadth. Do you have evidence from multiple courses for each indicator, or does everything depend on a single course? If that course is cancelled or revised, you have no fallback.
Rate each indicator on a simple scale: Strong (multiple direct, recent evidence items), Adequate (enough evidence but some gaps in directness or recency), or Weak (insufficient evidence to support the self-study claim).
Step 4: Act on Gaps
The review is not complete until you act on what it finds. For every indicator rated "Weak" or "Adequate," you need a plan:
- Replace stale evidence. Contact the course coordinator. Request updated syllabi, current rubrics, recent assessment data. Set a deadline.
- Strengthen thin coverage. If an indicator is supported by only one course, identify another course that could reasonably contribute evidence. Work with the instructor to add explicit outcome mapping to their assessment.
- Document the gap. If you cannot fill a gap before the self-study, acknowledge it in the narrative. Accreditation committees respect programs that are honest about limitations and have a plan to address them. It does not respect programs that present weak evidence as strong.
The Evidence Review Checklist
Use this checklist to run the review for each indicator in your program. Work through your outcomes systematically, indicator by indicator, and document results as you go.
| Check | What to Look For | Red Flag |
|---|---|---|
| Inventory complete | Every indicator has at least one evidence item listed | Indicator has no evidence listed at all |
| Evidence is current | Syllabi and rubrics are from the current or previous academic year | Evidence is older than 2 years with no update note |
| Course links are valid | Every course code in the mapping is an active course | Course was retired, merged, or renamed |
| Evidence is direct | Rubrics, exam questions, or project criteria explicitly reference the outcome | Evidence is indirect (syllabus mentions outcome but does not measure it) |
| Coverage is adequate | Each indicator is covered by at least 2-3 courses across the program | Single course carries the entire burden for an indicator |
| Assessment data exists | Grade distributions, rubric scores, or outcome achievement data is available | No quantitative data to support the claim of achievement |
| CI link is clear | Assessment data feeds into a continuous improvement action | Data is collected but never analyzed or acted on |
| Narrative matches evidence | Self-study claims are directly supported by the evidence on file | Narrative makes a claim that no evidence item substantiates |
When to Run the Review
The evidence review should not be a one-time activity crammed into the 90-day visit countdown. It is a recurring process that happens at three points in the accreditation cycle:
Annual review (every September). A lightweight pass through the checklist. Flag anything that has changed since last year — new courses, faculty departures, assessment method shifts. This takes 2-3 hours if your evidence is organized.
Mid-cycle review (Year 3-4 of a 7-year cycle). A deeper review covering all indicators. This is when you address the slow decay that happens between visits — rubrics that have drifted, courses that have been revised, evidence that has gone stale. Plan a full day for this.
Pre-self-study review (6-9 months before submission). The most thorough review. Every indicator gets validated, every piece of evidence gets assessed for strength, every gap gets an action plan. This is the review that determines whether your self-study narrative is credible or fragile.
Programs that only review evidence during the 90-day countdown are playing catch-up. By then, it is too late to request updated rubrics from faculty who have moved on, or to redesign assessments that do not map to outcomes. The review cadence determines how much scrambling happens at the end.
How a Connected Evidence Map Changes the Review
The evidence review is harder when your evidence lives in disconnected spreadsheets, shared folders, and faculty email inboxes. Every step of the review requires cross-referencing between systems. The inventory takes days. Validation requires chasing people down. Strength assessment is subjective because you cannot compare evidence items side by side.
With a connected evidence map, the review is a single workflow:
- The inventory is automatic — every indicator shows its linked evidence items, their source courses, and their last-update dates.
- Validation is visual — stale evidence is flagged by date. Retired courses appear as broken links. You can see the gap before you need to explain it.
- Strength assessment is comparable — evidence items for one indicator appear together, so you can judge directness, recency, and breadth without flipping between tabs.
- Gap closure is tracked — weak indicators are assigned to course coordinators with deadlines. You can see which gaps are closed and which still need attention.
The review does not disappear with a tool — the work is still yours. But the tool removes the friction that makes the review feel like a five-day scavenger hunt.
The Review Is Not Optional
Accreditors expect programs to demonstrate that they monitor learning outcomes continuously. Current criteria make this expectation more explicit than in previous cycles. Visiting teams look for evidence that the program reviews its own evidence — not just that it collects it.
A program that can show a documented evidence review process, with dated records of what was reviewed, what was found, and what actions were taken, is a program that understands accreditation as an ongoing practice. A program that only reviews evidence when the visiting team is on the horizon is a program that treats accreditation as an event.
The difference between those two approaches is visible on the day of the visit. The team asks a question. One coordinator clicks through a connected map and pulls up current evidence in seconds. The other opens a spreadsheet, cross-references three tabs, finds an item from two years ago, and hopes nobody notices.
The review is the bridge between collecting evidence and proving outcomes. Build the habit now, and the visit is a formality. Skip it, and you will find out what is broken at the worst possible moment.