AI-Moderated in-depth interviews · 29 Disneyland park visitors · The Disneyland App
The lookup that assumes you already know.
Twenty-nine people opened the Disneyland app, then sat down with us right after their visit. They love it for the wait times. They love it for the map. What none of them could find in it was how to actually run the day.
Scroll ↓
Part one
The question
What we set out to learn, in plain words.
A theme-park day is a hard thing to run. It is crowded, timed, expensive, and shared with the people you love and the people you are responsible for. The app is supposed to help.
So we asked a simple thing. Does the app help you have the day, or does it just help you look things up while you try to have it yourself? We talked to people who had been once and people who go fifty times a year. We anchored every conversation on one real moment they opened the app, and we followed what happened next.
The fork underneath it all: is the gap a feature problem (add more), or a guidance problem (teach and compose)? Hold that question. The data answers it.
The discussion guide, in full
"Tell me about your visit: who you went with, which parks, what kind of day it was."
"Think of one time you opened the app. What was happening, and what were you trying to do?"
"What did you open first, and why that?"
"What did you expect to see? Did it work? What did you do next?"
"How often did you use the app during the day? Were there moments you could have but chose not to?"
"What made it worth opening, versus not?"
"Which tabs did you actually use? Where would you go first, and what would you hope to see there?"
"What felt hardest to find, easiest to miss, or had to be checked over and over?"
"Was it buried, or just not there? What did you do instead?"
"Which parts of this would help in the moment? Which feel promotional? What would you move or remove?"
"What would someone newer to the parks miss? (First-timers: what caught you off guard? Repeat visitors: what do you know now that the app never taught you?)"
Moderation principle: neutral probes only, do not lead the participant toward a guided-mode answer.
"If Disney could improve one thing about the app for in-park use, what would it be, and why?"
Part two
Can you trust 29 people?
Before any finding, the receipts. How carefully the data was gathered, scored, and anonymized.
Every interview got scored, one by one, on three things: how much real signal the participant gave, how well the AI moderator did its job, and how usable the transcript was. Signal is gated by authenticity, so a transcript that looks rich but smells off cannot inflate the score. Each cell below is one person. Hover any of them.
Interview Quality Scoren = 29 · mean IQS 3.84
P06
35-44 F CA
P16
18-24 F CA
P18
35-44 F CA
P23
25-34 F CA
P26
25-34 F CA
P27
25-34 F CA
P15
18-24 M CA
P04
18-24 M CA
P07
45-54 M CA
P10
18-24 M CA
P08
18-24 F IL
P09
18-24 F CA
P12
18-24 M CA
P14
45-54 M NV
P20
18-24 F CA
P25
18-24 F OH
P28
35-44 F NV
P21
25-34 M CA
P01
35-44 F CA
P19
25-34 F CA
P13
25-34 F GA
P17
25-34 F CA
P22
35-44 F CA
P11
45-54 M CA
P24
35-44 M NJ
P29
18-24 M CA
P02
25-34 F CA
P03
45-54 F WV
P05
18-24 M TX
High signal (8)Good (11)Thin but real (8)Low signal (2)Authenticity flag (3)
Moderator strongfunctionalweak
Mean IQS 3.84. Moderator 3.76, Signal 3.86, Usability 3.90. The moderator number is the one most studies have never seen. Ours was solid, not perfect. And notice where the three dashed cells sit: all in the small first-time group. The thinnest cell is also the least clean. We are telling you that, not hiding it.
One person turned out to be describing a different resort entirely. We caught it, capped their score, and pulled them out of the first-time evidence. Another transcript cut off early. Both are flagged, not deleted. And no real name appears anywhere in the data: every participant is a hashed token plus a few demographics, even inside the quotes, where a pet's nickname inside a quote became "Hey [name]."
Part three
What came back
The same shape, from almost every direction.
People do not learn the park from the app. They learn it from strangers on the internet.
"I learned it through Reddit before I went on the trip, people were talking about the best strategies for getting on rides."
P06 · 35-44 F CA
"the app doesn't actually really teach you that virtual queues exist [...] there's no tutorial like, 'Oh, it's your first time at Disneyland, you should know this.'"
P12 · 18-24 M CA
"the app was like for someone that already knew how to like figure out the app [...] a guided mode would have made everything better for me."
P04 · 18-24 M CA, first-time visitor
Here is the strange part. The first-timers often said the day was easy. The people who described first-timers struggling were the veterans standing next to them.
"I've personally seen my friends [...] literally wait for five minutes in front of the entrance trying to scramble to scan their phone because they don't know where it is."
P16 · 18-24 F CA, Magic Key holder
"I don't know the things that I don't know [...] there's a lot of different tabs and clickable things on the app that I've never clicked."
P26 · 25-34 F CA, 10+ visits
The deficit is real, and it is invisible to the person who has it. We keep the case that cuts the other way, too: not everyone struggles, and ease tracks how comfortable you already are with apps.
"No, we're all pretty app savvy."
P24 · 35-44 M NJ, on his three first-time companions
It shows up in the small stuff too. A churro order that spun forever with no error. Bathrooms with no filter. A cookie croissant nobody could find. The app holds the data. It just never composes it into a day.
"we tried the cookie croissant item that is in Disneyland at like Maurice's stall, and it was amazing [...] who's gonna know that there's that item at that stall."
P27 · 25-34 F CA
And the cost of all that checking, in the words of the person who optimized hardest:
"It felt exhausting and necessary. I hated how much I had to be on my phone to make things work."
P06 · 35-44 F CA
What this lets us do: stop treating newcomer difficulty as a survey question (the newcomer under-reports it) and start designing the first day from what the veterans beside them actually watch happen. And stop adding data fields to an app whose real gap is that it composes nothing.
Part four
The 29, placed by hand
Every interview on one grid: how often they visit, against how fluently they actually use the app. Tap any dot to hear them.
Visit frequency →
Tap any dot to read that person’s exemplar quote. All 29 are here, one each.
How to read this. Left to right is how often someone visits, a coded field from the study. Up is app fluency, an analyst reading of each transcript, not a package metric (low = leaned on others or wanted a guide; medium = core features with gaps; high = confident with advanced features). Dot color is the interview’s signal tier; a dashed ring marks an authenticity or completeness flag. The pattern is the point: visiting often does not make someone fluent, and the only low-fluency dots sit in the thin, flagged first-time column. Quotes are exact and located to the transcript.
Part five
Where this could go
Five honest directions. Possibilities the data could support, not findings or promises.
AcademicpossibilityThe competence assumption, and a way to trust AI interviews
Two papers sit in here. One on the latent-deficit mechanism (the gap a user cannot feel, witnessed by the expert beside them). One on the method itself: a per-interview quality score that gates on authenticity, with a verified-verbatim chain. The HCI venues are asking exactly these questions right now.
ProductpossibilityBuild the layer that composes the day
A guided, sequencing layer plus a plain-language explainer for the queue system, then the concrete wins the transcripts keep naming: a restroom filter, a food-first search, the gate scan up front. The roadmap is in the friction, not in a feature wishlist.
GrowthpossibilityOnboard the first session, retain the lapsed returner
The biggest untapped moments are the first visit and the return after years (an out-of-date mental model). A first-run flow built from veteran observation could move activation without adding a single feature.
MarketingpossibilityOwn "your day," not "more options"
People defend their day against the brand's own promotion. The unclaimed positioning, in every orientation's own words, is a personalized guide that composes the day rather than a billboard that lists it. (To be validated with a sized wave before any segmentation is claimed.)
JournalismpossibilityThe phone you cannot put down at the happiest place on earth
"Exhausting and necessary" is a story bigger than one app: the way the tools that make a day legible also pull us out of it. The heaviest users were the most troubled by it. That tension is the piece.
Part six
Who we talked to
Twenty-nine real, varied people. Anonymized, never named.
29 recent visitors
Gender
Female (18)Male (11)
More cuts
The same study, for other rooms
This showcase is the public front door. Each finding was also rendered for the people who act on it. Open any cut.