Skip to content

docs(research): add synthetic user testing study (LUI-109, LUI-142) - #96

Merged
luidgi-dev merged 10 commits into
devfrom
docs/lui-109-142-synthetic-user-testing
Sep 13, 2026
Merged

luidgi-dev merged 10 commits into
devfrom
docs/lui-109-142-synthetic-user-testing

Conversation

@luidgi-dev

Copy link
Copy Markdown
Owner

Summary

Adds Strive's first user research study to the repo: a synthetic user test (UXia, 3 AI-simulated personas) of the demo onboarding and conversational logging flow, run on 30 July 2026 against production (9bedeea).

The study is packaged in three layers so any claim can be traced back to its evidence:

design/research/
  README.md                        # study index, Nielsen severity scale, finding-to-issue rules
  2026-07-synthetic-beta/
    protocol.md                    # the plan: objectives, participants, task, measures, success bars, limitations
    findings.md                    # the report: scorecard, findings with decisions, disagreements with the platform
    raw/
      metrics.md                   # post-test question results
      p1-morgan.md                 # transcript + extraction, per participant
      p2-arjun.md
      p3-avery.md
      uxia-report.md               # the platform's own insights, verbatim

design/README.md now references the new research/ folder.

Key results

  • Positioning lands: 3 of 3 described Strive as "momentum over streaks" unprompted.
  • Core bet holds: 3 of 3 logged in natural language on the first attempt, none looked for a manual log button.
  • Weak spot is acknowledgment, not clarity: demo tap, ritual save and chat send all worked, but each left a short silent gap before its result appeared, which is where every doubt in the study came from.
  • Both "High" platform insights were overstated: checked against the code and a live repro, the chat confirmation card already exists (reply in under 5 s) and the new ritual does appear on Rhythm. The remaining gap is the missing save acknowledgment.

Decisions

Finding Severity Decision
F1 No confirmation when a ritual is saved 2 LUI-143
F2 Rhythm read as a dashboard, day picker skipped 2 LUI-145
F3 Demo entry feedback and CTA weight 2 Deprioritized
F4 to F8 Labels, sample data, sparkle label, date on log card, category pills 1 Won't fix or backlog, rationale in findings.md

Notes for review

  • Docs only, no code change.
  • Participants are synthetic, and this is stated throughout. Counts are used instead of percentages (n = 3).
  • Transcript quotes are reproduced as exported; […] marks gaps in the platform export, nothing was reconstructed.
  • The study folder was renamed from 2026-09 to 2026-07 to match the actual run date.

- Introduced a new protocol document detailing the objectives, methods, and participant profiles for the synthetic user testing study scheduled for September 2026.
- Outlined research questions and design choices to evaluate user interactions with the Strive app, focusing on demo mode and conversational logging.
- Documented participant personas to ensure diverse representation in testing scenarios.
- Created a new metrics.md file to document post-test question results from the synthetic user testing study.
- Included participant responses and thematic analysis for key questions regarding Strive's core philosophy, user experience, and areas for improvement.
- Provided aggregate data and insights on user interactions, highlighting friction points and overall clarity of the app's functionality.
- Created a new markdown file documenting the session transcript and think-aloud from user testing.
- Included detailed step-by-step interactions and participant feedback on the Strive app's demo mode and ritual creation process.
- Provided insights into user experience, highlighting areas of confusion and suggestions for improvement.
- Created a new markdown file documenting the session transcript and think-aloud from user testing.
- Included detailed step-by-step interactions and participant feedback on the Strive app's demo mode and ritual creation process.
- Highlighted user experience insights, particularly areas needing immediate feedback and clarity in the app's functionality.
- Created a new markdown file documenting the session transcript and think-aloud from user testing.
- Included detailed step-by-step interactions and participant feedback on the Strive app's demo mode and ritual creation process.
- Highlighted user experience insights, particularly areas needing clearer acknowledgment and feedback in the app's functionality.
…yment information

- Revised the run date to 30 July 2026 for all sessions.
- Clarified the build under test as production at `striveapp.cc`, commit `9bedeea`.
- Marked open items as completed regarding deployment URL and session dates.
- Created a new markdown file documenting insights from three user testing sessions.
- Summarized key findings, relevance ratings, and suggested fixes for identified issues in the Strive app's functionality.
- Highlighted user feedback on trust and clarity in ritual creation and logging processes, emphasizing areas for improvement in user experience.
- Changed the study date from September 2026 to July 2026 for the synthetic beta testing session.
- Maintained other details regarding participants, method, and status.
- Created new markdown files for findings and protocol related to the synthetic beta testing conducted on 30 July 2026.
- Documented key insights from user testing sessions, highlighting user experiences, areas of confusion, and suggestions for improvement in the Strive app's functionality.
- Included detailed protocol outlining study objectives, methods, and participant profiles to provide context for the findings.
@vercel

vercel Bot commented Sep 13, 2026

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
strive Ready Ready Preview Sep 13, 2026 12:11pm UTC

@luidgi-dev
luidgi-dev merged commit f7a04f4 into dev Sep 13, 2026
7 checks passed
@luidgi-dev
luidgi-dev deleted the docs/lui-109-142-synthetic-user-testing branch September 13, 2026 12:20
@luidgi-dev luidgi-dev mentioned this pull request Sep 20, 2026
5 tasks done

This branch was successfully deployed

1 active deployment
Preview — 7e5ee6a6 Deployed Sep 13, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant