Case study ·

CS-03

·

Minerva

Retiring 400+ hours of manual reporting a year with one dashboard

Forum’s first in-app data dashboard, for instructors and partners. I found the problem, then led it as both designer and PM.

fig. 1

The shipped class overview. What to notice: color carries engagement health, and no single score speaks for a student.

Shipped · video still

fig. 1

The shipped class overview. What to notice: color carries engagement health, and no single score speaks for a student.

Org

Minerva

Years

2023

Type

Data dashboard

Status

Shipped · in use by 20+ partners

Org

Minerva

Years

2023

Type

Data dashboard

Status

Shipped · in use by 20+ partners

Org

Minerva

Years

2023

Type

Data dashboard

Status

Shipped · in use by 20+ partners

My role

Design lead & de facto PM (self-initiated)

Scope

The pitch, the metric definitions, and the dashboard itself

Team

1 engineer · 1 academic SME

Leadership

Found the problem, pitched the product, and ran it as designer and de facto PM

Shared or outside my scope

One engineer built it; the academic SME co-defined what engagement could honestly mean

My role

Design lead & de facto PM (self-initiated)

Scope

The pitch, the metric definitions, and the dashboard itself

Team

1 engineer · 1 academic SME

Leadership

Found the problem, pitched the product, and ran it as designer and de facto PM

Shared or outside my scope

One engineer built it; the academic SME co-defined what engagement could honestly mean

My role

Design lead & de facto PM (self-initiated)

Scope

The pitch, the metric definitions, and the dashboard itself

Team

1 engineer · 1 academic SME

Leadership

Found the problem, pitched the product, and ran it as designer and de facto PM

Shared or outside my scope

One engineer built it; the academic SME co-defined what engagement could honestly mean

CS-03

TL;DR — the case in one card

Problem

Forum captured rich engagement data in every live session, then it vanished: locked in databases while Partner Success hand-built reports nobody read in time.

What I did

Pitched a live, self-serve dashboard, tested two concepts head-to-head with 22 instructors, refused the single score users asked for, and shipped signals ranked by trust.

400+ hrs/yr

Forum’s first in-app data dashboard, replacing hand-built reports

20+

Partners live

Forum’s first in-app dashboard

91%

Preferred Concept A

N=22 instructors · head-to-head

Timeline

2 months

Status

Shipped · in use by 20+ partners

Org

Minerva · Forum · 2023

CS-03

TL;DR — the case in one card

Problem

Forum captured rich engagement data in every live session, then it vanished: locked in databases while Partner Success hand-built reports nobody read in time.

What I did

Pitched a live, self-serve dashboard, tested two concepts head-to-head with 22 instructors, refused the single score users asked for, and shipped signals ranked by trust.

400+ hrs/yr

Forum’s first in-app data dashboard, replacing hand-built reports

20+

Partners live

Forum’s first in-app dashboard

91%

Preferred Concept A

N=22 instructors · head-to-head

Timeline

2 months

Status

Shipped · in use by 20+ partners

Org

Minerva · Forum · 2023

01

Rich classroom data, and almost nobody could reach it

Forum is a science-based online learning platform used by universities around the world to create, deliver, and assess pedagogically sound curriculum. Every class session generates engagement data: student and instructor talk time, chat and reaction activity, attendance, breakout participation. Then it all disappeared after class, locked in backend databases and third-party analytics tools, unintelligible without an engineer.

So Partner Success bridged the gap by hand: data-heavy engagement reports, per partner, every term. Slow to build, delivered too late to act on, and often unread. As the partner base grew, the math only got worse. Nobody handed me this project; I saw both a scalability issue and a strategic opportunity, and pitched replacing the reports with a live, self-serve dashboard, in the app, where class happens.

Field note

A report nobody reads, rebuilt by hand every semester, is a product asking to exist.

fig. 1.1

The seed: Forum’s in-class Talk Time view, one of its most loved features. Proof that instructors wanted engagement data. The dashboard grew from here.

Forum · live class

fig. 1.1

The seed: Forum’s in-class Talk Time view, one of its most loved features. Proof that instructors wanted engagement data. The dashboard grew from here.

02

The questions pointed at a product, not better reports

I started by meeting the customer-facing stakeholders and instructors: how were the reports built, and what did partners actually value in them? The production process wasn’t scalable, but the reports encoded the key user goals. Everyone was trying to answer three questions: How is this program or course doing overall? Are any sections struggling? Which students might be at risk, and how soon can we know?

Those questions don’t want a prettier PDF. They want insights over time, at the program, course, section, and class level. That reframe turned a reporting cleanup into a product.

The tell

“How soon can we know?” is a monitoring question. Nobody asks a static report how soon.

How might we make engagement data more useful and accessible to partners, while still aligning with our pedagogical standards?

03

Users wanted one simple score. We couldn’t honestly give one.

Three calls shaped the dashboard, and the middle one, the refusal, is the one this case study exists for.

Honest ledger

The score would have demoed beautifully. It also would have been wrong often, with authority.

DL-01

Test two opposing concepts head-to-head

Alternative considered

Go straight to high fidelity on the layout the old reports implied. Two months is a tight window for a detour.

Why it won

91% preferred Concept A. To the 22 instructors in the counterbalanced test, A read as a “reflection of engagement”; B felt like “borderline surveillance.”

What it cost

Half the concept work was disposable by design. Neither direction shipped intact.

DL-01

Test two opposing concepts head-to-head

Alternative considered

Go straight to high fidelity on the layout the old reports implied. Two months is a tight window for a detour.

Why it won

91% preferred Concept A. To the 22 instructors in the counterbalanced test, A read as a “reflection of engagement”; B felt like “borderline surveillance.”

What it cost

Half the concept work was disposable by design. Neither direction shipped intact.

DL-02

Refuse the single “engagement score”

Alternative considered

One composite indicator per student. Instructors consistently asked for exactly this, and the winning concept carried a version of it.

Why it won

Talk time means opposite things in a seminar and a lecture; a blended score would look authoritative and quietly mislead.

What it cost

The sexy headline feature. Honest metrics are a quieter pitch than one big score.

DL-02

Refuse the single “engagement score”

Alternative considered

One composite indicator per student. Instructors consistently asked for exactly this, and the winning concept carried a version of it.

Why it won

Talk time means opposite things in a seminar and a lecture; a blended score would look authoritative and quietly mislead.

What it cost

The sexy headline feature. Honest metrics are a quieter pitch than one big score.

DL-03

Ship the scoped MVP, put the ambition on a roadmap

Alternative considered

Chase the full vision in one release: AI-deepened insights, every report replaced, a richer definition of engagement.

Why it won

One engineer, 2 months: scope was the design tool. Three key metrics, the supporting signals, talk-time history. Everything else went on a real roadmap.

What it cost

Some manual reports survived the launch. “Most” is the honest word, and the roadmap owns the rest.

DL-03

Ship the scoped MVP, put the ambition on a roadmap

Alternative considered

Chase the full vision in one release: AI-deepened insights, every report replaced, a richer definition of engagement.

Why it won

One engineer, 2 months: scope was the design tool. Three key metrics, the supporting signals, talk-time history. Everything else went on a real roadmap.

What it cost

Some manual reports survived the launch. “Most” is the honest word, and the roadmap owns the rest.

fig. 3.1

Sketches from the workshops: per-student rows, reactions over class time, breakout and poll tables. Paper first, because sketching is the cheapest place to be wrong.

Exploration · sketch

fig. 3.1

Sketches from the workshops: per-student rows, reactions over class time, breakout and poll tables. Paper first, because sketching is the cheapest place to be wrong.

fig. 3.2

Concept A, the broad multi-signal overview. It carried a computed verdict per student (None, Low, Good, High) on purpose, as a probe: I wanted instructors’ reaction to a score on the record.

Concept test

fig. 3.2

Concept A, the broad multi-signal overview. It carried a computed verdict per student (None, Low, Good, High) on purpose, as a probe: I wanted instructors’ reaction to a score on the record.

fig. 3.3

Concept B spotlighted individuals: top talkers, quietest students, target ranges. The same data as A, and instructors read it as monitoring. Restraint here wasn’t taste; it was trust.

Concept test

fig. 3.3

Concept B spotlighted individuals: top talkers, quietest students, target ranges. The same data as A, and instructors read it as monitoring. Restraint here wasn’t taste; it was trust.

One number would have been simpler. It also would have been wrong.

What shipped instead — signals, ranked by trust: 01 talk time (primary, format-dependent) · 02 reactions & hands (secondary) · 03 chat (context) · 04 attendance (context) · 05 window focus (weakest signal). Shown in that order. The instructor interprets; the design never issues a verdict.

04

Built to answer “who do I focus on next class?” in two seconds

The final dashboard gives instructors three key metrics up front: student talk time, instructor talk time, and attendance, each with a colored health bar so engagement reads at a glance. Talk time sorts lowest-first, so the students who need attention rise to the top, and “good” is a deliberately wide band, so the dashboard doesn’t raise false alarms. Below sit the supporting signals (polls, chat, breakouts, reactions) and talk-time history for the last four classes, so one quiet session reads as a data point, not a verdict.

In miniature

Color communicates health; the number underneath carries the nuance. That split is DL-02, shipped.

05

400+ Partner Success hours back, every year

Those hours are Partner Success report-production time: the dashboard removed the need for most manual reports, with the remainder scheduled on the roadmap. It shipped to all 20+ partners as Forum’s first in-app dashboard (and earned a Minerva blog feature), and the team’s freed hours moved to demos, support, and upsell conversations.

“The engagement chart is everything I’ve ever wanted.” — Instructor, Forum partner

“These are super helpful for personal reflection and faculty reviews!” — Instructor, Forum partner

Most, not all · by design

Measured results · annual

400+ hrs/yr

measured, derived — the math below

20+

Partners live in production

The math: 5 hrs per report × 2 reports per partner per term × 2 terms × 20+ partners = 400+ hrs a year. Those hours are Partner Success report-production time; the dashboard removed the need for most manual reports, with the remainder scheduled on the roadmap.

Most, not all · by design

Measured results · annual

400+ hrs/yr

measured, derived — the math below

20+

Partners live in production

The math: 5 hrs per report × 2 reports per partner per term × 2 terms × 20+ partners = 400+ hrs a year. Those hours are Partner Success report-production time; the dashboard removed the need for most manual reports, with the remainder scheduled on the roadmap.

06

What changed beyond the interface

The quietest outcome mattered most to me: full alignment with Minerva’s internal academic team, whose approval was critical given their high pedagogical standards. Instructors began using the data to inform their in-class decisions, which is exactly the reflective use the SME and I designed for.

Product direction, self-initiated

Nobody handed me this project. I saw both a scalability issue and a strategic opportunity, and pitched replacing the hand-built reports with a live, self-serve dashboard — then led it as both designer and de facto PM.

07

The best feature is the score we refused to ship

Instructors wanted a single score, and the concept test proved how much: the direction carrying one won 91% of the room. We refused to ship it anyway, because we couldn’t compute it honestly, and traded that simplicity for signals ranked by trust. I’d make the trade again. The pattern travels anywhere data meets people: decide what you can responsibly say before deciding how to say it.

There’s an epilogue, too: the dashboard now generates exactly the data an honest score would need. The refusal was a deferral, not a forever.

Closing note

Two months, two collaborators, four hundred hours a year. Small teams can retire big drudgery.

Create a free website with Framer, the website builder loved by startups, designers and agencies.