Innovative Crowdtest in Usability Lab

by | UX

In Braunschweig, we carried out an innovative lab test with our crowdtesting service msg.passbrains, in which we were able to observe users' interactions on a smartphone in real time.

The users were exclusively students, mixed from secondary schools and high schools. This posed a number of challenges:
- Reliability: Do the users really come to the appointment?
- Concentration span: How can we maintain attention?
- Communication: How can we get even reluctant users to talk?
- Influence of adults: How do we get users to express their actual opinion instead of what they think adults want them to say?

To meet these challenges, it is important to choose suitable methods that meet the needs and abilities of the young users. These include the use of playful elements, short and varied activities and, in particular, empathetic facilitators.

Our setup was well thought out: the entrance area offered drinks and entertainment, such as foosball, for our young participants. In a moderation room, furnished with comfortable armchairs and sofa tables, the moderator and test person sat opposite each other. A small action camera, placed next to the armchair, filmed over the shoulder how the smartphone was operated - an angle that captured the smallest movement.

The recordings from the action camera and the smartphone screen were synchronized using special software and streamed side by side into the observation room. This stream could also be followed online, which made it possible to follow the test live and remotely without disturbing the test subject.

In the observation room, four observers followed the events closely, took notes and were thus able to gain valuable feedback and deep insights into user behavior.

The result? A successful smartphone lab test with young test subjects that provided us with exciting insights and valuable feedback.

Dank unseres flexiblen Setups sind wir in der Lage, diese Art von Tests an jedem Standort durchzuführen. Wir freuen uns darauf, dieses Angebot in Zukunft für weitere spannende Projekte zu nutzen.

Read more here:

EuroSTAR Conference 2026: Why It’s Worth Visiting msg.passbrains in Oslo

Die EuroSTAR Conference 2026 findet vom 15.–18. Juni in Oslo statt und bringt erneut die internationale Testing-Community zusammen. Unter dem Motto „Testing at its Best“ dreht sich alles um die Frage, wie moderne Qualitätssicherung in einer zunehmend komplexen,...

Crowdtesting for AI Interfaces: When Traditional UX Testing Falls Short

The integration of generative AI is fundamentally changing the way users interact with digital applications. While traditional software responds in a deterministic manner, AI interfaces behave dynamically, contextually, and, in some cases, unpredictably. This...

Shift-Left vs. Shift-Right Testing: Where Crowdtesting Really Makes a Difference

Shift-left testing reduces technical risks early in the development process. Shift-right testing reduces user risks shortly before release. Most problems with digital applications do not arise in the code—but in the real-world usage context. That is why it is sufficient...

Faster to a Better UX: Why a Quick Check Makes All the Difference

Why good usability determines success or failure today Good usability is not a “nice-to-have,” but critical to success. In a digital world where alternatives are just a click away, it is no longer just the product range that determines...

Crowdtesting in Gaming Practice: How to Improve Quality and Reach

QA challenges in game development Developing modern games is a complex undertaking. Whether it's AAA titles for PC/console or mobile games for the mass market, quality assurance (QA) faces major challenges. Diverse hardware platforms,...

Crowdtesting: A Strategic Success Factor for the Gaming Industry

Gaming is a mass phenomenon and a billion-dollar market. The gaming industry is growing rapidly and becoming mainstream, with a spectrum ranging from complex PC and console games to fast-paced mobile games and virtual and augmented reality games....

All articles:

Was ist Crowdtesting?

What is Crowdtesting?

Crowdtesting has established itself as one of the most innovative methods in the quality assurance of digital products. Real users test software, websites and apps under real conditions. This happens before...

read more