Online course quality review where agents walk the course as a student would and draft each fix, and people decide and sign
Every course walked like a student would, every fix cited, and certified by two people.
See one case, screen by screen ↓Online course quality review is the check an online-learning office runs before a new or redesigned online course opens: the course shell is reviewed against a course design rubric for its overview, measurable objectives, aligned assessments, materials, interaction, technology, student support and accessibility. Online Course Quality Review puts agents on the first pass: they walk the course as a student would, map objectives to assessments, send accessibility items to remediation and draft each fix with the rubric quoted. A faculty peer decides each fix, the faculty author accepts every change, and the director signs the certification.
AI in education: a buyer's guide to agentic AI for colleges, universities and school districts →
Updated
Online course quality review is how an online-learning office checks a new or redesigned course before it opens: the course shell, against a course design rubric for the overview, measurable objectives, aligned assessments, materials, interaction, technology, student support and accessibility. Today an instructional designer clicks through the shell in the learning management system with the rubric in a spreadsheet, a faculty peer reads the course again, and the designer writes every fix from scratch. A course of 300 items has more than a thousand links, dozens of videos and quizzes, and the broken link or the video with no captions is found by a student in week 3.
Alignment is the standard courses miss most. An objective like "Understand pharmacokinetics" names nothing a student can show, and some objectives are never assessed at all; finding them means building a map by hand. The proof is scattered across the rubric spreadsheet, emails, a review tracker and the course itself, so at accreditation or state authorization the office rebuilds who reviewed what, and when. Online Course Quality Review puts agents on the first pass and keeps every decision with people: the designer prepares, a faculty peer decides each fix, the faculty author accepts every change, and the Director of Online Course Quality signs.
Estimated hours for one internal review of a 300-item course by a designer and a faculty peer, by hand and with the agents; 10 to 20 hours by hand is the design's estimate. The 'after' column counts the agents' run and the people's time. Our arithmetic, kept modest.
Six agents walk, map and draft each course; a faculty peer decides and the Director signs.
Review CQR-2026-0183: NURS 6200 Advanced Pharmacology for Advanced Practice, a 3-credit online course in Halden State University's MSN Family Nurse Practitioner program, redesigned for spring 2027 and launching Monday, January 11. Dr. Owen Takeda requested the review on October 5. The rubric is Halden Online Course Standards, 2025 edition: 101 standards in 8 areas, 31 of them essential. Here is the review, screen by screen, in the working solution.
The Walker signs in as a test student and takes NURS 6200 in order: 296 items opened, 1,184 links followed, 15 quizzes started in preview with no attempt recorded, 31 videos timed at 6 h 12 min. Three links fail, in Modules 3, 6 and 12, each with a replacement proposed. Weekly workload against the 9-hour week puts Module 4 at 13.5 hours.
Module 4, "Renal clearance and dosing": 41 min 12 s, no captions.
The Alignment agent threads 6 course objectives through 42 module objectives to 15 quizzes, 6 case studies and 9 discussions. 40 of 42 module objectives are assessed. Module 4's "Understand pharmacokinetics" and Module 9's "Appreciate the role of the prescriber in opioid stewardship" are not, and Module 7's podcast reflection serves no objective. The verbs "understand" and "appreciate" are flagged.
The Access agent sends four items to the Accessibility Services queue: captions for the Module 4 video, an untagged 14-page dosing PDF, a banner contrast fix and a vendor's missing accessibility statement. The captions come back on October 20 at 99.4% accuracy and the agent checks them again before marking them done. All 31 videos are now captioned and 214 of 214 images have alt text.
Mateo runs 9 of the 38 open reviews across 24 online programs. Each one is drawn from its request to the course's first day, with today, the certify-by date and the projected certification. The agents' brief cites every line; EDU 6120 and PH 6100 are at risk, and the one next step is the NURS 6200 peer session at 10:00 a.m.
The course map shows NURS 6200 the way a student sees it: Start here, Modules 1 to 14 and the Final, with 14 numbered pins where a standard fails. Dr. Achterberg opens pin 2.2 on Module 4. The rubric language is quoted above the drafted fix, the findings cite the module page and the alignment map, and the Fixer's confidence is 0.91. The line at the top reads 81 of 101 standards met, essential 25 of 31.
4.3 Calculate a renal dose adjustment for a given creatinine clearance. Aligned to Quiz 4, item 7.
Beside pin 2.2 she asks "What else assesses Module 4?" The answer: Quiz 4 items 1 to 4 assess objective 4.1, items 5 and 6 assess 4.2, and only item 7 asks for a renal adjustment, with the alignment map and the quiz item cited. She accepts the fix.
She marked the drafts that morning. Record my read-through lists all 13 with her mark, each changeable: 11 of 14 fixes accepted (pin 2.4 with her own edit), 2 rejected with a reason code, "Author's design choice" for 3.5 and "Draft is inaccurate" for 8.7, and 1 sent to the author. The standards line moves to 92 of 101, all 31 essential met, past the certification mark at 86.
8.7: "The rebuilt PDF drops the renal dosing table on page 9."
Dr. Valcourt sees the 11 changes the peer accepted, each as now → change, such as a 24-hour weekday response policy and the NURS 6100 prerequisite, with Accept or Keep mine. She accepts all 11 into the Spring 2027 shell; the live fall course is untouched. She answers the peer's question herself: Module 11 keeps the 2014 guideline with a note on the 2023 update. The Walker re-walks the changed modules: 0 broken links, every video captioned.
All 7 pre-certification checks pass, among them every pin decided, the author's acceptance, accessibility closed, a clean re-walk and 31 of 31 essential standards. Dr. Achterberg recommended certification at 2:38 p.m. and Dr. Kessler signs at 2:40 p.m.; the designer cannot sign. The Certification agent writes "Quality reviewed · Spring 2027" to the course catalog and the course review tracking system, 12 business days after the request.
92 of 101 standards, 31 of 31 essential, valid to October 2031.
The same online course quality review, seen by the five people who carry it: what their term looked like, and what it looks like now.
Six agents walk, map and draft each course; a faculty peer decides and the Director signs.
Reads each review request, the course shell and the catalog record; proposes a designer and a faculty peer; checks that the peer is outside the author's department and has not taught the course; sets the SLA dates from the launch.
Walks the course as a test student: opens every page in order, follows every link, starts every quiz in preview, plays and times every video, and adds up each week's workload against the credit hours.
Maps course and module objectives to activities and assessments, and flags any objective nothing assesses, any activity no objective needs, and verbs that cannot be measured.
Checks captions, alt text, headings, PDF tags and contrast against WCAG 2.1 AA, sends items to the Accessibility Services remediation queue at first pass, and checks each return again.
Drafts one fix per failing standard, with the rubric language quoted and the course page cited, such as a measurable objective aligned to a named quiz item; answers questions about its drafts.
Checks the pre-certification list, builds the certificate and the audit pack, writes the certification to the course catalog and the review tracking system, and drafts the annual quality report.
Signs after the peer recommends. The agents propose; a named person decides.
Ask about any course, pin, objective or review in your own words; the answer cites the course page and the rubric, and opens the right screen. These are the questions suggested in the working solution.
Which objectives in NURS 6200 are never assessed?
Two: Module 4's "Understand pharmacokinetics" and Module 9's "Appreciate the role of the prescriber in opioid stewardship". The Fixer drafted measurable rewrites aligned to Quiz 4, item 7 and Case study 4.
What did the Walker find in Module 4?
A 41-minute 12-second video with no captions, already captioned by Accessibility Services at 99.4% accuracy, and a 13.5-hour week against a 9-hour target.
Which reviews could miss their launch?
Four would certify after the 15-business-day build window: EDU 6120 (author 3 days late), PH 6100 (peer 2 days late, escalated), SCM 6300 (peer late, 23 fixes) and IT 4200 (author on leave until Nov 9).
Build the export pack for the accreditor
Building it from the trail: the certificate and score, the walk log, the alignment map, all 14 decisions with reasons and evidence, the accessibility hand-offs and the agent versions. No student records are in scope. The Director approves the release.
13 screens from the working solution, on its sample data. Pick one to see it large.
The rubric, the certification mark and the review clock are settings. Agents and their prompts are versioned and evaluated before a change goes live.
| Setting | Default | Choose from |
|---|---|---|
| Active rubric | 2025 edition | Halden Online Course Standards: 101 standards in 8 areas, 31 essential; the 2022 edition is kept for reviews started under it |
| Certification threshold | 86 of 101 | 88 or 90 of 101; essential standards always block certification |
| Certification valid for | 5 years | 3 or 4 years, or until a major redesign |
| Peer decisions | 10 business days | 7 or 14; first pass 1 day, author acceptance 5, certification 2 |
| Build window before launch | 15 business days | 10 or 20; certifying later puts the course at risk |
| Escalation | Director after 1 day, Dean after 3 | Or Director after 2 days, Dean after 5 |
| Fixer confidence threshold | 0.80 to draft | Below it, the Fixer asks instead of drafting |
| Retention | 7 years after the course is retired | Or 10 years; any student name masked on export |
Every figure is labelled: a target the solution is built to, an estimate, a typical published result, or a proven one.
Sources: a published state price list for official outside course reviews, effective September 2025 (full review of a one-semester course, $2,800, 20 weeks) · ADA Title II rule, 28 CFR Part 35 Subpart H (April 24, 2024), with the April 26, 2027 compliance date for large public entities · 34 CFR 600.2, distance education and regular and substantive interaction · "demo" = seen in the working solution, on its sample data · "typical" = published figures and rules · "estimated" = our arithmetic. Halden State University, its courses and the people named on this page are fictional: characters and sample data in the working solution.
Online course quality review is the check an online-learning office runs before a new or redesigned online course opens: the course shell is reviewed against a course design rubric for its overview, measurable objectives, aligned assessments, materials, interaction, technology, student support and accessibility. Online Course Quality Review puts agents on the first pass: they walk the course as a student would, map objectives to assessments, send accessibility items to remediation and draft each fix with the rubric quoted. A faculty peer decides each fix, the faculty author accepts every change, and the director signs the certification.
The rubric in the working solution, Halden Online Course Standards 2025 edition, has 101 standards in 8 areas: course overview, objectives, assessment, materials, interaction, technology, student support and accessibility. 31 standards are essential, and a course is certified at 86 of 101 with every essential standard met. The rubric is your own: a new edition is imported as a draft, and reviews started under an older edition finish under it.
An official outside review of a one-semester course is listed at 20 weeks on one published state price list. In the working solution, the agents' first pass of NURS 6200, 296 items, took 47 minutes, and the course went from request to a signed certification in 12 business days. The review clock is a setting: first pass 1 business day, peer decisions 10, author acceptance 5 and certification 2.
The Alignment agent builds the course alignment map itself, from each course objective to module objectives, activities and assessments. It flags objectives nothing assesses, activities no objective needs, and verbs such as "understand" and "appreciate" that name nothing a student can show. The Fixer then drafts a measurable objective aligned to a named assessment, such as "Calculate a renal dose adjustment for a given creatinine clearance" for Quiz 4, item 7.
The rubric's interaction standards are reviewed like any other. In NURS 6200, the Fixer found that Discussion 5 said when students post but not how the instructor takes part, and drafted the plan: the instructor posts a follow-up case on day 3 and replies in every thread by day 5. The finding cites the federal rule: regular and substantive interaction is what keeps an online course eligible for federal aid. The peer and the author decide.
The Access agent checks captions, alt text, headings, PDF tags and contrast against WCAG 2.1 AA, the standard the ADA Title II rule sets for public colleges' web and course content, with April 26, 2027 as the compliance date for large public entities. It sends items to the Accessibility Services remediation queue at first pass, so they come back before the peer session, and checks each return again before marking it fixed.
Yes. The agents walk, map, draft, cite and hand off; they never edit a course or certify one. Only the faculty peer accepts, edits or rejects a fix, and a rejection needs a reason code. Only the faculty author accepts a change into their course, and only into next term's shell. The peer recommends and the director signs, and the same person can never do both.
The Agentic Solution Engine builds and deploys it from your requirements and documents, such as your rubric, your school teaching guidelines and a sample of course shells, and it goes live once every quality gate has passed. It connects to your learning management system, course catalog, video platform and review tracking system. We will walk you through it on your own courses first.
Every course file fixed before April 2027, and heard right by a screen-reader test.
1-min demoAcademic Integrity Case ManagementReferrals screened on how the work was written, with both sides in one packet.
1-min demoLearning Outcomes AssessmentAssessment reports built from scored student work, where every number opens its papers.
1-min demoWe'll run Online Course Quality Review on a sample of your own course shells, against your rubric.