Innovative Crowdtest in Usability Lab

by | UX

In Braunschweig, we carried out an innovative lab test with our crowdtesting service msg.passbrains, in which we were able to observe users' interactions on a smartphone in real time.

The users were exclusively students, mixed from secondary schools and high schools. This posed a number of challenges:
- Reliability: Do the users really come to the appointment?
- Concentration span: How can we maintain attention?
- Communication: How can we get even reluctant users to talk?
- Influence of adults: How do we get users to express their actual opinion instead of what they think adults want them to say?

To meet these challenges, it is important to choose suitable methods that meet the needs and abilities of the young users. These include the use of playful elements, short and varied activities and, in particular, empathetic facilitators.

Our setup was well thought out: the entrance area offered drinks and entertainment, such as foosball, for our young participants. In a moderation room, furnished with comfortable armchairs and sofa tables, the moderator and test person sat opposite each other. A small action camera, placed next to the armchair, filmed over the shoulder how the smartphone was operated - an angle that captured the smallest movement.

The recordings from the action camera and the smartphone screen were synchronized using special software and streamed side by side into the observation room. This stream could also be followed online, which made it possible to follow the test live and remotely without disturbing the test subject.

In the observation room, four observers followed the events closely, took notes and were thus able to gain valuable feedback and deep insights into user behavior.

The result? A successful smartphone lab test with young test subjects that provided us with exciting insights and valuable feedback.

Dank unseres flexiblen Setups sind wir in der Lage, diese Art von Tests an jedem Standort durchzuführen. Wir freuen uns darauf, dieses Angebot in Zukunft für weitere spannende Projekte zu nutzen.

Read more here:

Quality Throughout the Entire Software Lifecycle: Crowdtesting Meets the msg Group’s Testing Expertise

Digitale Produkte werden komplexer. Release-Zyklen werden kürzer, neue Technologien und KI verändern Entwicklungsprozesse und gleichzeitig steigen die Erwartungen der Nutzer an Qualität, Performance, Sicherheit und eine intuitive User Experience. Für Unternehmen...

AI vs. Humans in Software Testing: Why Real People Are Becoming More Important Now

Artificial intelligence is increasingly being used in quality assurance. It generates test cases, prioritizes defects, analyzes logs, and helps teams automate repetitive tests. This promises shorter development cycles, greater...

EuroSTAR Conference 2026: Why It’s Worth Visiting msg.passbrains in Oslo

The EuroSTAR Conference 2026 will take place in Oslo from June 15–18 and will once again bring together the international testing community. Under the theme “Testing at its Best,” the conference will focus on the question of how modern quality assurance can be carried out in an increasingly complex,...

Crowdtesting for AI Interfaces: When Traditional UX Testing Falls Short

The integration of generative AI is fundamentally changing the way users interact with digital applications. While traditional software responds in a deterministic manner, AI interfaces behave dynamically, contextually, and, in some cases, unpredictably. This...

Shift-Left vs. Shift-Right Testing: Where Crowdtesting Really Makes a Difference

Shift-left testing reduces technical risks early in the development process. Shift-right testing reduces user risks shortly before release. Most problems with digital applications do not arise in the code—but in the real-world usage context. That is why it is sufficient...

Faster to a Better UX: Why a Quick Check Makes All the Difference

Why good usability determines success or failure today Good usability is not a “nice-to-have,” but critical to success. In a digital world where alternatives are just a click away, it is no longer just the product range that determines...

All articles: