DCHS Insights CX Human-Centered Design @ DCHS PROTOTYPE no real data Quality Service Review (QSR)
What it is
Randomly select clients using multiple services, compile a case profile from client systems, then interview the client and everyone serving them using a structured, scored protocol — two domains rated on a 6-point scale by trained, certified reviewers.
"For clients touching several programs at once, how good is their actual status and our actual practice — the cross-program view no single program sees?"
What it tells you and what it cannot
| Tells you | Cannot tell you |
|---|---|
| Defensible, scored judgments of client status and system practice | Statistically representative rates — samples are small spot-checks |
| Where practice breaks between programs (teaming, long-term view, tracking) | Anything quickly — it is slow, skilled work |
| Story-based case learning plus aggregate patterns, feeding a written improvement plan | Unverified truth — interview statements are taken as given |
How it runs
| Who does the work | Participants | Elapsed time | Cost |
|---|---|---|---|
| Trained, certified reviewer pairs + a review lead + data staff for case profiles | Dozens of cases per round; ~6 interviews per case; 1–3 days on-site per case | Weeks to months per round | $$$ — certified skilled labor |
Strengths, watch-outs and quality signals
the most rigorous and defensible of the eight — litigation-tested, used in 24+ states; scores both status and practice with Maintain (5–6) / Refine (3–4) / Improve (1–2) zones, acceptable = 4+.
expensive and slow; requires certification (two-day initial training plus refreshers); becomes an audit "gotcha" if framed as enforcement instead of learning.
paired reviewers with debriefs for inter-rater reliability; scores triangulated across records and interviews; findings that land in a written Practice Improvement Plan with owners.
Equity & consent
Strong when reviewers are independent of the client's own caseworker and say so; face-to-face interviews with interpreters where needed. Record access raises real PII/HIPAA — and, where substance-use records are involved, 42 CFR Part 2 — obligations; consent is foundational, and clients must hear credibly that candor cannot affect their case.
When to choose it
when you need the cross-program view with oversight-grade rigor — for funders, boards, or a persistent problem the faster methods can flag but not adjudicate.
the Human Systems and Outcomes protocol family (Virginia, Michigan, DC, Pennsylvania variants); Pennsylvania's Round IV reviewed 181 cases across 14 counties with per-indicator "% acceptable" reporting.
Quality Service Review — focus case: Janice Brown
Review snapshot
This round reviewed 12 randomly selected cases drawn from clients using multiple services at once. Cases were reviewed by paired reviewers (one local, one external) over roughly two days each: a case profile compiled from client systems, then structured interviews — ~6 per case. This is a spot-check sample, NOT statistically representative; each case is a unique test of how the service system performs for one person.
This report presents the round's aggregate skeleton and one focus case. Focus-case interviews: the client, the safe-house advocate, the housing intake worker, the benefits worker, the behavioral-health clinician, and the CPS worker. Focus periods: status indicators rated on the past ~30 days; practice indicators on the past ~90 days. The review lands on day 47 of the focus case's journey.
Case-profile tile for the focus case: one client across seven touchpoints with no shared plan of record.
Janice Brown
Compiled case profile: one client, seven service touchpoints, no shared plan of record.
Goal: Stability that unblocks reunification
Scoring key
Each indicator is rated on the 6-point scale: 6 Optimal · 5 Good · 4 Fair · 3 Marginal · 2 Poor · 1 Adverse. Zones: Maintain (5–6) · Refine (3–4) · Improve (1–2); the acceptable threshold is 4 or above, and results are commonly read as "% of indicators acceptable." Indicator families below are modeled on HSO-licensed state protocols (real background: Virginia 2011 and Michigan 2018 field versions), with labels localized for an adult-and-family, multi-program context; a real review requires trained, certified reviewers. All scores in this mock are.
Child & Family Status
Status in the past ~30 days. Acceptable on 3 of 9 indicators (33%).
Status table: safety and caregiver functioning score in the maintain zone; stability and permanency score poor; most well-being indicators sit marginal.
Child & Family Status
| Indicator | Score | Rationale |
|---|---|---|
| Safety from harm | 5 Good | Left the violent home; current setting safe; safety plan current |
| Stability of living arrangement | 2 Poor | Safe-house placement is time-limited with no successor housing identified |
| Permanency prospects | 2 Poor | Reunification pathway exists on paper but is blocked by housing, with no timeline |
| Physical health | 4 Fair | Immediate needs met; no unaddressed concerns noted in records or interviews |
| Emotional well-being | 3 Marginal | Exhaustion and repeated retelling of the precipitating events; supports started but disrupted by scheduling |
| Caregiver functioning | 5 Good | Acted protectively under pressure; keeps every appointment she can; realistic about capacity |
| Family connections | 3 Marginal | Contact maintained as scheduled, sustained chiefly by her persistence against transport and scheduling barriers |
| Financial / material well-being | 3 Marginal | Food and benefits partially in place; 3 of 8 identified needs met at day 47 |
| Voice and choice | 3 Marginal | She is asked to comply more often than she is asked what she can manage; her stated capacity limits appear in no record |
Scale 1–6: 1 = Adverse · 2 = Poor · 3 = Marginal · 4 = Fair · 5 = Good · 6 = Optimal. Acceptable threshold: 4.
Practice Performance
Practice in the past ~90 days, across all programs serving the case. Acceptable on 1 of 8 indicators (13%).
Practice table: only cultural responsiveness reaches acceptable; teaming, long-term view, resources, and tracking all score poor.
Practice Performance
| Indicator | Score | Rationale |
|---|---|---|
| Engagement | 3 Marginal | Each program engages her competently on its own; the cumulative burden of six separate engagements falls on her |
| Teaming | 2 Poor | No record in any system that any two programs communicated about this case in the review period; the team exists only in the client's head |
| Assessment and understanding | 3 Marginal | Each assessment is locally competent; none captures the housing-reunification dependency that governs the case |
| Long-term view | 2 Poor | No plan of record extends past each program's next step; the dependency chain is undocumented |
| Case planning | 3 Marginal | Program plans exist and are current; they are not reconciled with one another, and appointments collide |
| Intervention adequacy and resources | 2 Poor | Services are appropriate individually; the resource everything depends on has the longest queue and no priority linkage |
| Tracking and adjustment | 2 Poor | A missed appointment triggers a closure step rather than an inquiry; nothing detects cross-program collisions |
| Cultural awareness and responsiveness | 4 Fair | Individual interactions respectful; system-level trauma awareness lags, as the retelling burden shows |
Scale 1–6: 1 = Adverse · 2 = Poor · 3 = Marginal · 4 = Fair · 5 = Good · 6 = Optimal. Acceptable threshold: 4.
Overall pattern analysis
Sum-up tiles: overall status marginal, overall practice poor, six-month forecast is decline risk absent housing movement.
What to maintain (appreciative findings first, across the round of 12): the crisis response at entry is fast and safe; individual workers are respectful and competent; and in most cases — this one clearly — client persistence and protective capacity are the strongest assets in the case. What to refine: assessment depth, engagement burden, and voice-and-choice — clients' stated capacity limits rarely enter the record. What to improve: teaming, long-term view, and tracking. The cross-case pattern is stark: 9 of 12 cases scored 3 or below on teaming. The system's weakest indicators are precisely the ones no single program owns.
Case vignette
De-identified, ~150 words,. The focus client entered through the DV hotline on the night she left a violent home. Within two weeks she had done everything the system asked: intake at the safe house, applications for housing and benefits, a behavioral-health appointment, and engagement with the CPS matter — telling the precipitating story nine times across seven doors to do it. Each program found her cooperative and credible. Each program also started its own clock. By week five, a benefits appointment and a behavioral-health session collided; the miss was coded a no-show. At day 47, her safety is real and her effort is visible everywhere in the record. What is visible nowhere is the one fact that governs the case: reunification waits on housing, and housing is a queue no plan can see.
Client quote: I can do the appointments. I cannot do them all at once.
I can do the appointments. I cannot do them all at once.
Staff quote: she has done everything we asked; the parts that have not moved are the parts none of us own.
She has done everything we asked. The parts that have not moved are the parts none of us own.
Staff quote: I can see my program's tasks for her, I cannot see anyone else's.
I can see my program's tasks for her. I cannot see anyone else's.
Practice Improvement Plan
Prioritized from the round's Improve-zone indicators. Owners are roles, not individuals.
Practice improvement plan with five prioritized actions, owners, and metrics, led by teaming and dependency documentation.
| Finding | Recommendation | Owner | Evidence · metric |
|---|---|---|---|
| Teaming scored 2: no cross-program communication of record | Standing multi-program case conference within 14 days of any multi-service crisis entry | Deputy director, program operations | Focus case; 9 of 12 round cases at 3 or below on teaming Percent of multi-program cases with a documented shared plan within 30 days |
| Long-term view scored 2: governing dependencies undocumented | Require documented dependency chains in every program plan, reviewed jointly | Housing and CPS program leads | Housing-reunification dependency absent from both relevant plans Multi-program cases with dependencies documented in all affected plans |
| Tracking scored 2: misses read as refusal | Add a collision-aware miss code and require review before any closure action | Quality assurance lead | Collision-driven no-show preceded a closure step in the focus case Share of misses carrying a documented reason before closure steps |
| Engagement burden sits on the client (nine retellings) | Pilot a consented shared intake summary, starting with a legal review of what can travel with consent | Intake redesign workgroup with counsel | Focus case record compilation; interview synthesis Retellings per new multi-program case in the pilot |
| Client strengths absent from records that drive decisions | Add client-stated capacity and strengths to the shared summary template | Intake redesign workgroup | Caregiver functioning scored 5 while capacity limits appear in no record Cases whose plan documents client-stated capacity |
Limitations & quality self-check
Limitations. Interview statements are not verified by the reviewer. This is a case-based review protocol for examining frontline practice, not a traditional measurement instrument designed with psychometric properties (real background: the HSO protocols state this limit). The sample is a small spot-check; percentages describe this round's 12 cases, not the caseload. A real QSR requires trained, certified reviewers, record access with consent, and interpreter support where needed.
Questions this review surfaced but deliberately did not resolve (carried as open items for the improvement plan's legal and process work):
- "Which retellings are legally required and which are habit"
- "What information can travel with consent today"
- "Which missed appointments could be prevented by sequencing"
Self-check. 6-point scale with Maintain/Refine/Improve zones and acceptable = 4+: yes. Both domains scored with one-line rationales: yes. Sum-up with 6-month forecast: yes. Strengths named before deficits in the pattern analysis: yes. All scores, rosters, and figures: yes. Banner present: yes.