Email copied to clipboard!

Executive Snapshot

Everything you need to know about Terron's background in 60 seconds.

I am a Senior Quantitative UX Researcher with 8 years of experience leading research and architecture across Meta, Microsoft, JPMorgan Chase, and startups. Backed by a Master’s in Statistics from the University of Pennsylvania, I specialize in translating complex behavioral telemetry into executive product strategy.

My work spans building ecosystem-scale behavioral pipelines (800M+ MAU), massive global monitoring platforms (100K+ responses/month), establishing pyschometric launch gates for first of its kind tech (Agentic AI/cryptographic identity) and engineering full-funnel A/B testing frameworks that delivered a +$20M monthly revenue lift.

Whether you are navigating 0–1 product ambiguity, scaling tracking infrastructure, or eliminating funnel friction to drive growth, I partner with cross-functional teams to solve high-stakes behavioral and quantitative challenges.

EXPERIENCE & EDUCATION
8 Yrs β€’ UPenn MS Stats
ENTERPRISE FOOTPRINT
Meta β€’ MSFT β€’ Chase
MAX SCALE & IMPACT
+$20M/mo β€’ 800M+ MAU
CORE TECH STACK
Python β€’ SQL β€’ A/B

Case Studies & Projects

Founding Research to Resolve Privacy and Safety Concern in Digital Identity Verification

Founding Researcher 0-1 Innovation Usability Testing and Interviews
Project Overview

As Founding Researcher in a blank-slate environment on a 3-person core team, I architected the research strategy and validity frameworks for a 0-1 civic advocacy platform utilizing blockchain digital IDs. My mandate was to translate user behavioral insights directly into technical protocols, UI specifications, and launch validation frameworks alongside engineering and product design.

Diagnosing Trust Hurdles

User research uncovered critical psychological barriers: users were hesitant to connect cryptographic identities to real-world advocacy without clarity on anonymity guarantees. I diagnosed onboarding drop-off points and collaborated with engineering to design transparent, user-facing cryptographic explanations, demystifying zero-knowledge concepts into intuitive trust cues.

Impact

By systematically aligning protocol security with user mental models, we significantly improved onboarding funnel conversion and unlocked successful multi-market pilot deployments across California and New York.

0-1 Agentic AI Launch Gating & Global Vendor Operations

Meta Agentic AI Creation 0-1 Project Research Global Operations (12 Vendors)
Project Overview

The main objective of this project was to research the value of AI-powered agentic business messaging as it transitioned from concept to execution, focusing on identifying areas of value for businesses on Messenger and Instagram. Understanding how AI could perform as a substitute for what had traditionally been human customer support interactions, like giving information about products, was critical particularly for small businesses that had very few employees.

Key Responsibilities

As the Quantitative UX Researcher, I led multinational alpha, beta and general availability studies combining survey data with platform interaction data. I managed the research process, including survey design, data analysis, and communicating findings to stakeholders. My approach involved close collaboration with qualitative researchers, providing them with user profiles and targeted outreach lists to ensure we spoke with the right participants.

Technical Approach

For data analysis, I utilized internal survey tools, SQL for data retrieval, and Python for manipulation, allowing efficient extraction of relevant information. When we encountered broken eligibility criteria for survey participants, I was able to recover the data by finding other criteria by which to check whether the user had interacted with an AI or a human. I determined whether the data was random or systemic, to help determine whether the data was still representative as well as to understand what the likely failure point was.

Working with the Data Engineering team, we identified and resolved these issues to maintain data integrity on future projects. To address data eligibility challenges that delayed our research timeline, I implemented survey weighting techniques ensuring our results represented target populations accurately. This critical step validated our findings across different user segments and allowed us to confidently present recommendations to stakeholders.

Impact & Findings

Through analysis of platform interaction data and survey responses, I uncovered key insights:

  • Users don't have a worsened experience when interacting with the AI but do get much more timely responses
  • Small businesses were able to increase the amount of work they can perform when they don't have to worry about customer support

These insights directly influenced the deployment strategy, ultimately enhancing customer engagement and satisfaction.

Professional Growth

The project marked my first experience with a non-iterative research approach, teaching me valuable lessons about quickly bringing products to market to achieve relevance. I learned that prioritizing speed and responsiveness is essential for success in a rapidly evolving landscape. These insights will guide my future work as I apply these lessons to drive innovation and enhance user experiences in upcoming projects.

Eliminating Liquidity Barriers Across SMB Automated Campaigns

Meta Mixed-Methods Ad-Spend Retention
Challenge & Context

Within Meta's Small and Medium Business (SMB) advertising ecosystem, self-serve merchants face significant operational friction when launching and scaling campaigns. High interface complexity, confusing audience targeting options, and overwhelming budgeting controls led to frequent onboarding drop-offs, sub-optimal campaign setups, and premature ad spend abandonment.

To unlock advertiser growth and improve platform liquidity, Meta needed deep, actionable insights into where and why self-serve merchants were stalling during the campaign setup journey.

Mixed-Methods Research Strategy

I designed and executed an end-to-end mixed-methods research initiative to map the complete advertiser lifecycle and identify key UX and functional friction points:

  • Quantitative Log Analysis: Analyzed behavioral telemetry and telemetry logs from thousands of advertiser sessions to pinpoint exact drop-off steps, configuration errors, and feature drop-out rates in the creation funnel.
  • Qualitative Merchant Interviews: Conducted in-depth interviews with diverse SMB owners to evaluate mental models, risk perceptions around budget allocation, and pain points regarding audience targeting.
  • Attitudinal Surveys: Deployed targeted in-product surveys to measure confidence levels, ease-of-use perception, and feature satisfaction during active campaign builds.
Key Research Findings & Strategic Recommendations

Our research revealed that SMB advertisers didn't lack marketing intent, they lacked confidence. Over-choice in targeting parameters created decision paralysis, while a lack of real-time feedback made merchants hesitant to commit advertising budgets.

I partnered directly with Product Managers, UX Designers, and Engineering squads to translate these findings into concrete product interventions:

  • Smart Targeting Presets: Replaced granular manual targeting fields with AI-assisted preset audiences tailored to business verticals and localized demographics.
  • Guided Setup Workflows: Streamlined the creation flow into progressive disclosure steps, reducing cognitive load and preventing user fatigue.
  • Contextual Guidance & Tooltips: Designed dynamic tooltips and performance preview estimators that gave merchants real-time feedback on expected reach and ROI before launching.
Impact & Business Outcomes

By addressing core setup friction and simplifying targeting workflows, the team drove measurable gains across key platform metrics:

  • Increased Adoption: Boosted adoption of self-serve targeting tools among newly onboarded SMB merchants.
  • Accelerated Setup Velocity: Significantly reduced the average time required for merchants to build and publish an ad campaign.
  • Sustained Liquidity & Retention: Lowered early campaign abandonment, driving higher long-term advertiser retention and sustained monthly ad-spend liquidity across Meta's ad ecosystem.

Creating and Administering the Business Messaging Platform Survey for Facebook & Instagram

Meta Continuous Monitoring n=100k+/month
Project Overview & Scale

As the Quantitative UX Researcher for customer Business Messaging tracking, I led the implementation of a global research initiative designed to continuously monitor consumer sentiment across messaging platforms. The project tracked key metrics including value perception, relevance, and negative experiences associated with business messaging, serving as a critical guardrail against messaging overload. With hundreds of thousands of monthly responses spanning both Instagram and Messenger across priority markets, this project represented one of our largest-scale research efforts, providing visibility into global messaging trends and user sentiment.

Key Responsibilities & Technical Approach

My responsibilities included survey design, determining optimal invitation volumes, establishing data pipelines, and building comprehensive dashboards to visualize insights for stakeholders.

To effectively analyze the massive dataset, I utilized:

  • Internal survey tools for data collection across multiple markets
  • SQL for efficient data retrieval from our databases
  • Python for sophisticated data manipulation and statistical analysis
  • Interactive dashboards allowing stakeholders to filter by region, platform, and demographics

Working across diverse global markets presented unique challenges that required thoughtful solutions and cultural adaptations, including translation. By implementing weighted sampling techniques, I ensured our findings accurately represented user populations across all markets despite varying response rates.

Impact & Future Direction

These insights directly informed critical product decisions, including the implementation of message frequency capping in high-volume markets and the optimization of delivery timing based on regional usage patterns. In the future, our hope is to use this abundance of data to understand what levers are able to be pulled to improve business messaging with a much longer understanding of effects.

Overhauling Microsoft's Hybrid Workstream Survey: Automated NLP Pipeline & Methodological Redesign

Microsoft Methodology Innovation Qualitative Analysis Automation
1. The Bottleneck: Manual Analysis of Unstructured Data

Microsoft's Hybrid workstream collected over 2,000 employee survey responses monthly to inform internal policies and product direction. Initially, analyzing open-ended text responses and compiling stakeholder updates was done completely by hand. This manual analysis was prohibitively slow and consumed significant time that could otherwise be spent on high-value research.

2. The Technical Solution: Automated NLP Pipeline

To resolve the speed barrier, I developed an automated data processing pipeline and fine-tuned a BART-large-MNLI zero-shot topic modeling solution to classify unstructured feedback automatically. Fine-tuning increased classification accuracy from 61% to 83%, drastically speeding up analysis and establishing consistent, objective weekly sentiment tracking.

3. The Deeper Realization: Structural Survey Flaws

While the NLP model successfully accelerated text processing, a fundamental issue persisted: open-ended responses were rarely utilized downstream by operational teams. The sheer ambiguity of open-ended text made it difficult for stakeholders to extract concrete, decisive actions, proving that automating an inefficient data source was only a partial fix.

4. The Systemic Redesign: Modular & Structured Data

Recognizing that the data collection method itself needed an overhaul, I redesigned the survey methodology. We transitioned from monolithic surveys with heavy open-ended text to a modular framework that served dynamic, targeted question subsets, reducing length from dozens of items to fewer than 12.

We shifted primary data collection to structured, closed-ended questions for quantifiable insights, while retaining an "Other" field to capture emergent qualitative nuances.

Key Achievements & Impact
  • Automated NLP Classification: Boosted topic modeling accuracy to 83% and eliminated manual text sorting.
  • Methodological Overhaul: Cut survey lengths to <12 items, significantly increasing completion and response rates.
  • Actionable Intelligence: Replaced vague text responses with structured, decision-ready data for Microsoft leadership.

Upskilling Qualitative UX Researchers in Data & Scripting

Microsoft Technical Mentorship Data Upskilling Python & SQL

Recognizing that qualitative researchers frequently waited on central engineering queues for basic data queries, I initiated and led a technical training curriculum teaching team members Python scripting, SQL data extraction, and statistical fundamentals. This endeavor aimed not only to empower team members with new technical skills but also to leverage these skills to boost productivity and the overall performance of our team.

Through hands-on workshops and 1-on-1 coaching, qualitative researchers learned to query and visualize their own respondent datasets independently, accelerating research turnaround times and fostering deeper cross-pollination between qualitative empathy and quantitative rigor.

A/B Testing & Data Engineering Chase's Acquisition Pipelines to Increase Monthly Revenue by $20M

JP Morgan Chase 800M+ MAU Data Lake Causal Experimentation C-Suite Advisory
Role & Responsibility

During my tenure at JPMorgan Chase, I spearheaded and supported a series of technical and analytical initiatives aimed at constructing robust data infrastructure, enhancing digital user experiences, and driving digital account acquisition across public and private portals.

Engineering the Acquisition Data Lake

To facilitate a unified tracking system, I led the technical initiative to construct a high-performance data lake utilizing behavioral clickstream data. Supporting Chase.com, one of the top 50 most visited U.S. websites with 800 million monthly visits and 6 billion page views, required optimizing an expansive database with prohibitively long query times and overly complex table joins.

I engineered an automated Teradata transformation script that streamlined the architecture, reducing the tables required to view an application journey from four to just one. This automation guaranteed data integrity and scalability while allowing multi-dimensional filtering across demographics, product types, and traffic sources. Analysts experienced a >90% reduction in query times, retrieving insights almost instantly rather than waiting hours.

Research Approach & A/B Testing

With scalable infrastructure in place, we conducted full-funnel A/B testing across owned advertisements and acquisition pathways. Unlike traditional siloed analyses that evaluated media clicks or application starts independently, our end-to-end approach tracked users from initial link exposure through final account opening. This prevented low-intent clicks and ensured tailored product placements aligned with user eligibility.

Key Initiatives & Achievements
  • Engineered a unified digital acquisition data lake, cutting query times by over 90% and simplifying 4-table joins into a single structured view.
  • Implemented personalized product recommendations driven by existing holdings and customer financial profiles.
  • Revamped and streamlined product enrollment flows to minimize drop-off points.
  • Executed continuous, rigorously tested incremental optimizations to ensure sustained performance improvements.
Business Impact

These infrastructure and UX enhancements delivered a 7% year-over-year increase in total account volume, driven primarily by deposit account growth, generating approximately $20 million in incremental monthly revenue.

Fixing Platform-Wide Sign-In Interstitials & Announcements Architecture

JP Morgan Chase Unstructured Problem Framing Platform Governance

In my role at JP Morgan Chase, I played a pivotal part in identifying and addressing a critical issue related to the effectiveness of the "Announcements" feature which is intended to provide information on changes after a customer signs in. It began when I performed fundamental research to assess the feature's performance. What caught my attention was that the Announcements were consistently underperforming, falling far below the expected metrics. It became evident that a significantly lower number of users were actually seeing these Announcements, even though the feature was designed to reach everyone eventually. In some instances, the visibility rate for an Announcement was as low as 30%.

Upon digging deeper, I uncovered several key insights that shed light on the problem. First, I realized that all "Sign in interstitials," including "Announcements," were competing for priority in terms of display. Second, I discovered that the platform responsible for showcasing these interstitials wasn't under the jurisdiction of any internal team, resulting in a lack of controls and design guidelines. Third, a closer examination of other "Sign in interstitials" revealed a stark lack of design cohesion across the board. Lastly, I found that some of these interstitials were broken, repeatedly disrupting users instead of being dismissed after the initial display. User feedback in our Voice of Customer (VOC) channels confirmed that this issue was causing significant frustration.

To tackle this issue head-on, my team within the organization took charge of the "Sign in interstitials" platform. We implemented comprehensive design guidelines, ensuring consistency and effectiveness across all interstitials. Additionally, we fixed the broken ones, ensuring that they would function correctly and no longer disrupt users excessively. This initiative not only improved the user experience but also enhanced our ability to effectively communicate important announcements to our customers.

Recruiting & Onboarding Analytics Squad During the Great Resignation

JP Morgan Chase Technical Interviewing Capacity Scaling

During early 2022, our core analytics team experienced sudden attrition. I took on a role in re-expanding our team's capacity. Over the course of just three months, I successfully recruited and onboarded five new team members, effectively growing our team from three to eight members. This endeavor was not just about increasing headcount; it was about strategically identifying and bringing on board individuals who would not only fit seamlessly into our team culture but also excel in their roles.

To achieve this, I developed an objective criteria to evaluate potential candidates. This criteria encompassed both a behavioral portion of the interview process and a coding assessment. It was essential for us to assess not only technical skills but also interpersonal qualities that would contribute to a positive and productive team dynamic. Notably, each of these new hires not only successfully integrated into the organization but also demonstrated outstanding performance in their respective roles, consistently delivering valuable contributions to our team's success. All five of the team members that were hired were still in the organization adding value one year later, proving that the decisions made were the correct ones.

Capabilities & Strategic Playbooks

Practical problem-solving blueprints: How I diagnose friction, navigate constraints, and drive executive decisions.

PLAYBOOK 01

Addressing Non-Deterministic AI Integration & Evaluation

The Problem

Integrating non-deterministic AI, ranging from generative content models to autonomous agentic workflows, introduces unpredictable, non-repeatable system behavior into product experiences. Unlike deterministic software, user friction doesn't stem from traditional usability bugs, but from the ambiguity of delegation versus control: users struggle to understand system boundaries, monitor autonomous task execution, evaluate non-standard outputs, and know when or how to intervene when a model or agent strays.

How I Would Approach This Problem and Why
  • Establish Intent Completion & Autonomy Baselines: I would evaluate end-to-end goal resolution, error rates, and total task effort across varying degrees of system autonomy by comparing fully automated agent execution, human-in-the-loop checkpoint workflows, and existing manual baselines. In agentic and generative workflows, users trade fine-grained manual control for delegation speed; benchmarking where task failure occurs across levels of autonomy reveals whether a feature is ready for unassisted delegation or requires structured human verification gates.
  • Instrument Passive Intervention & Control Proxies: I would track real-time behavioral telemetry on user control signals, such as mid-execution task aborts, manual parameter overrides, intervention frequencies, repeated goal re-framing, and post-execution correction rates. Because self-reported surveys fail to capture real-time trust degradation, passive behavioral telemetry pinpoints the exact operational moments where users lose confidence in the system's execution or feel compelled to micromanage it.
  • Isolate System Capability Gaps from UX Observability & Steering: I would run controlled evaluations to decouple backend system failures (tool-execution errors, model drift, context gaps) from frontend visibility failures (opaque agent state, missing rollback mechanisms, ambiguous execution feedback). Product teams frequently waste engineering cycles retraining models or tweaking system prompts when the actual root cause is that users panic and abort tasks simply because they cannot observe what the system is executing behind the scenes.
The Decision Output

An executive diagnostic framework that identifies whether user friction or drop-off is driven by core model capability, insufficient system state observability, or an improper balance between automated delegation and human control, delivering clear operational directives for engineering architecture versus interaction design.

PLAYBOOK 02

Building Product Measurement Programs For Novel Products

The Problem

When faced with high ambiguity, the need to ship fast causes significant pressure to make any decision instead of spending time to make a good decision. Because waiting for data feels like an unnecessary tax on release momentum, leadership can decide to go without. Research in any practical setting isn't an academic exercise, it exists to drive decisions, reduce uncertainty, and influence outcomes, which means working within the time and resources available. Without a mechanism to deliver fast, high-conviction signal within those constraints, teams risk mistaking velocity for progress and shipping the wrong solution faster.

How I Would Approach This Problem and Why
  • Define the Decision Context and Do Desk Research: Before committing resources to novel field studies, I map the specific executive decisions, risk thresholds, and default paths that hinge on the research outcome. I then conduct targeted desk research using existing literature, competitor benchmarks, and adjacent domain studies to eliminate redundant effort and focus data collection strictly on high-leverage knowledge gaps.
  • Map Decision Timelines Against the Data-Generation Cost Curve: I evaluate upcoming product deadlines against the time, financial, and technical resources required to generate valid data across candidate methodologies. This trade-off analysis prevents launching complex quantitative instrumentation for time-sensitive choices while ensuring high-stakes bets receive appropriate empirical backing.
  • Instrument MVP Research ASAP and Scale Iteratively: I deploy lightweight research mechanisms like micro-surveys, basic telemetry hooks, or targeted usability walkthroughs immediately to capture directional signal within days. Using these early qualitative and quantitative insights to refine assumptions in real time, I progressively scale successful probes into permanent tracking frameworks and deeper studies.
The Decision Output

A phased decision framework that pairs immediate, high-conviction directional guidance with a clear roadmap for scaling data fidelity over time. It provides leadership with synthesized desk research and early MVP findings to make near-term product choices safely, while establishing explicit metrics and timeline triggers for expanding lightweight probes into long-term tracking infrastructure.

PLAYBOOK 03

Resolving the Say-Do Gap to Drive Actionable Product Directives

The Problem

Relying on self-reported user sentiment or behavioral telemetry in isolation creates major strategic risk because individuals are frequently unreliable narrators of their own habits. When survey responses directly contradict live interaction metrics, product teams struggle to diagnose whether low feature adoption stems from severe usability friction, an automated background habit, or purely aspirational intent. Without a structured framework to reconcile this disconnect within project constraints, leadership risks mistaking release velocity for true progress and wasting engineering capital on features users claim to want but never actually use.

How I Would Approach This Problem and Why
  • Establish Telemetry as Behavioral Ground Truth: I would track interaction metrics such as hesitation delays, workflow abandonment points, and manual workarounds to map what users physically do under live conditions. Establishing an objective baseline of interaction eliminates reliance on memory recall and isolates real-world user behavior from aspirational self-reporting.
  • Investigate Signal Divergence via Retrospective Playback Sessions: When self-reported feedback conflicts with observed telemetry, I would walk users back through recordings or event logs of their own recent sessions. Grounding discussions in specific drop-off moments allows me to probe what the user was trying to accomplish at that exact instant, uncovering hidden UX friction without triggering defensive rationalizations.
  • Apply Conflict Diagnostic Logic to Categorize User Signal: Instead of averaging conflicting survey scores and usage metrics, I would process divergent data through explicit diagnostic rules. This logic would separate usability bottlenecks (high intent blocked by poor interface design) from aspirational noise (high survey interest with zero interaction friction), ensuring engineering sprints target genuine value drivers.
The Decision Output

A synthesized conflict resolution matrix that translates divergent attitudinal and behavioral data into explicit execution directives: Kill, Fix UX, or Automate Defaults. It provides product and engineering leadership with clear, risk-adjusted directives on whether to overhaul workflow UI, deprecate aspirational feature requests, or reallocate development cycles toward high-utility daily habits.

PLAYBOOK 04

Building Products That Work For A Global Audience While Ensuring They Work Locally

The Problem

Expanding software globally creates a costly dilemma between central efficiency and local market survival. Pushing an identical product worldwide preserves lean engineering costs, but causes low adoption and high churn in regions where local expectations around payments, trust, and workflows differ. Conversely, customizing the product for every country delivers local market fit, but fractures the codebase, inflates development overhead, and erodes margins. Executive leadership lacks a systematic method to determine where the platform must remain globally uniform and where it must adapt to capture regional growth.

How I Would Approach This Problem and Why
  • Delineate the Universal Core from Local Dealbreakers: I would separate the foundational user goal that applies anywhere in the world from the specific regional mechanics needed to complete it. Focusing on universal intent keeps the main engine consistent, while isolating regional friction points, like local payment methods, trust badges, or network constraints, ensures teams solve the exact roadblocks preventing local adoption without rebuilding the app.
  • Establish Architecture Boundaries with Product and Engineering: I would define an explicit platform blueprint that locks down roughly eighty percent of core workflows globally while creating modular slots for the remaining twenty percent of regional customization. Setting structural boundaries upfront prevents regional teams from writing isolated code, while giving engineering clear parameters for building reusable, plug-and-play UI components.
  • Run Localized Validation Within Central Guardrails: I would direct regional evaluation toward testing localized mechanics and competitive alternatives rather than re-testing global baseline usability. Empowering local teams to validate region-specific mechanics catches critical market-entry failures early, while keeping overall strategy aligned with company-wide metrics and resource allocation.
The Decision Output

An Executive Localization & Architectural Blueprint that maps universal product functionality against approved regional extensions, equipping Product and Engineering leads with clear operational criteria to decide when to enforce global standardization and when to build modular regional features.

About & Resume

Senior Quantitative UX Researcher

Senior researcher with 8 years designing and executing research strategies at global organizations including Meta, Microsoft, and JPMorgan Chase. Expert in translating complex behavioral data into actionable executive insights, designing scalable infrastructure, and measuring impact through data-driven frameworks across Fortune 50 enterprises and 0-1 startups.

  • Graduate: University of Pennsylvania β€” MS in Statistics & Measurement
  • Undergraduate: Pennsylvania State University β€” BS in Business
  • Portfolio: TerronGraham.com