OVERVIEW

Designed an AI-generated summary module for Rokt's experiment readout experience, addressing a fundamental breakdown in how internal teams — Account Managers, Operations, and RPD — interpreted experiment data. Users landed on readout pages facing a wall of raw statistical output: parsing metrics, segment breakdowns, and significance thresholds independently, with no shared interpretive layer. Two people could read the same experiment and reach different conclusions. I owned this end to end, from problem framing through shipped experience.

WHAT MADE IT MORE THAN A SUMMARY

What looked like a content feature was actually a design philosophy decision. The instinct would have been to improve the data visualization — better charts, cleaner tables. Instead, I reframed the problem: the readout page wasn't failing at presenting data, it was failing at generating understanding. The AI summary wasn't a shortcut around the data; it was a deliberate interpretive layer designed to meet three distinct user types where they actually were — Account Managers needing a quick client brief, Ops teams needing a clear status signal, RPD needing a fast strategic read. One format, three jobs. That tension shaped every decision about what the summary said and how it was structured.

IMPACT

Reclaimed an estimated 5–10 analyst-hours per week by eliminating routine check-ins where AMs previously pulled in an analyst just to interpret a readout. Adoption happened without training session — the clearest signal the interpretive layer matched how people actually think about experiment results. Decision latency dropped from a days-long wait on a human to same-session, self-serve reads. Beyond the AM/Ops workflow, this became the foundational trust layer toward extending self-serve experiment reads to clients directly — establishing that non-experts could act on the data without an analyst as intermediary. That distinction — from a place to look at results to a place to understand them — became a reference point for how the team talked about the product going forward.