- Looking for #homeworker sid #income? #App #testers invited to join @passbrains and start #earning by #testing today! t.co/gyF791gQPq Time ago 34 Minutes
- UK and US based #testers earn $$$: Sign up today for our #website #testbash next Monday and Tuesday: t.co/gyF791gQPq Time ago 3 Hours
- What do you do if you run into #apps #malfunctions like this one? #twitter #bug #facebook #connector t.co/YFHcaWb7wY Time ago 3 Hours
- how many times did you get stuck today due to an application failure? @passbrains on-demand #apps #testing t.co/69ELry2udi Time ago 15 Hours
- Interesting facts on major #Mobile #Apps #Testing Types and #Quality Ratings: t.co/vBSv04jEoS Time ago 2 Days
Follow @passbrains on twitter.
Weblog on May 2, 2013in
The article below is a sampling from recent findings from massolution for a project on “crowdtesting” produced in conjunction with passbrains.
The case for Crowdsourced Software Testing or “crowdtesting” is pretty simple. The world of information technology is shifting from being driven by corporations to one that is driven by consumers, and consumers tend to demand more flexibility as they carry their devices through myriad environments and ecosystems, interacting with an even larger universe of software and hardware.
This lays out a clear challenge for software designers and their quality assurance teams. Here’s how massolution and passbrains describe it in the white paper: “Testing Applications for the Real World:”
Enter crowdtesting as a possible solution. Using the crowd to test software raises the bar over other common options like outsourcing or automation when it comes to levels of quality, flexibility, speed, and cost. Much of the early hype around crowdsourcing may conjure images of loosely organized chaos and erratic results, but crowdtesting for large enterprises actually involves a professional relationship with a testing company, as illustrated in the figure below:
Crowdtesting is becoming a recognized force in the quality assurance world, with a recent study finding that nearly half of QA professionals know what it is and how it works. Further, more than a third see it as a trend that will change the landscape of enterprise application testing.
“I think as an industry, we need to make crowdtesting part of the normal testing process,” says Bodo Vahldieck, Senior Manager for Quality Management Localization Services at Autodesk. “At the same time, you need to be clear on your objectives, and use the crowd in a such a way that it is both simple and detailed in terms of bug tracking, so that companies can integrate it into their overall testing process. Some people have the impression that quality is an issue with crowdtesting, but I think they have not spent enough time looking at the crowd. In my opinion, if you have the right provider, it makes sense to invest in crowdtesting.”
Already, players in a number of industries are taking advantage of crowdtesting, from large European, multi-national banks to familiar names like Amazon, eBay, Google, Groupon, and Microsoft.
Much more detail can be found in the full report: “Testing Applications for the Real World,” which is a free download. It covers how crowdtesting works and the passbrains process for applications testing; benefits like cost savings, speed to market and “glocalization;” and also identifies potential challenges in using the crowd.
For an even deeper dive into the rapidly growing crowdtesting sector, watch or download this recent webinar from massolution and passbrains.
Massolution is a unique research and advisory firm specializing in the crowdsourcing and crowdfunding industries. Massolution works with governments, institutions and enterprises in the design and implementation of crowdsourcing and crowdfunding business models that drive improved business performance, product and service innovation, enhanced levels of customer engagement and in the formation of new sources of capital.
Latest News on March 23, 2013in
Testing Applications for the Real World:
Can the Crowd Deliver “Better, Faster, Cheaper” Testing for a Software-Driven World?
Presenters: Crowdsourcing.org, PASS Group
We live in a digital world where everything from content to commerce has moved online and applications are the lifeblood of many businesses wishing to reach the mass market through the latest media. The need for secure, user friendly multi-channel environments is driving next generation Information Technology (IT) solutions. Crowdtesting is the new way of testing and releasing applications offering quality, speed and price advantages over traditional software testing methods that fail to deliver business and customer demands for multiple and frequent releases of applications.
- Why Crowdtesting is Increasingly Becoming a Necessity, with the Evolving Trends in IT Industry
- The Solutions that Focus on Big Data, Pattern and Analytics; More Open-Source; Cloud-Based Infrastructure; and Platform Independent Applications
- How Enterprise Crowdtesting Model allows Global Organizations to Leverage Crowdsourced Software Testing
- How Using a Geographically and Culturally Disparate Cloud is a Better Way to Test
An increasing number of today’s consumers are often described as «digital natives,» a highly tech-savvy bunch armed with gadgets who are not only connected to the cloud at all times – many of them live much of their lives there. This generation wants to decide which channel to use for doing any kind of business interaction and expect the provider to adapt accordingly in terms of service quality, security and ease of use. They expect quick adaptability to their changing needs, and have little sense of brand loyalty due to the plethora of available options at hand. Continue reading…
Dieter Speidel and Mithun Sridharan of PASS Technologies explain why crowdsourcing can offer a rapid and cost-effective approach to software testing and provide a remedy for the apps quality crisis. Read the full article…
Latest News on March 15, 2013in
With more than 800 visitors Swiss Testing Day has become the largest european conference for software testing.
Numerous customers, service partners and testers visited our booth to learn more about the possibilities and benefits of passbrains crowdtesting and of our new enterprise testforce management solution.
Weblog on March 4, 2013in
Hören sie den Begriff Crowdsourcing, rümpfen viele Fachleute die Nase. Der Crowd haftet etwas Unprofessionelles an, nicht immer zu Recht. Denn Fakt ist: Die Crowd hat schon heute einiges drauf – auch in der Schweiz.
Global On-Demand Crowdsource Software Testing Service Provider, PASS Group Expands to U.S. Market Due to Increasing Demand for Crowdsourced Application Testing
Latest News on February 10, 2013in
WOBURN, MA–(Marketwire – Jan 30, 2013) - See also on Yahoo Finance
PASS Group (www.pass.ch), a leading crowdsource software testing services provider, has launched its comprehensive crowdtesting solution passbrains to the U.S. market to meet the increasing demand for consumer-centric, professional & high-quality, software testing services delivered at low-cost. PASS’ announcement comes on the heels of a successful launch in Europe in 2011 against a backdrop of the projected growth of the $50 billion quality assurance and software testing market. The revenue growth of crowdsourcing service providers has been staggering, jumping 75 percent in 2011, according to a report by massolution, a leading crowdsourcing and crowdfunding advisory firm.
Crowdtesting is a new disruptive technology being deployed by the world’s leading companies as traditional IT and business models shift to embrace the “crowd.” Enterprise level companies like eBay are curating their own crowds by utilizing an existing customer base and passbrains multinational army of currently 20,000 users and 2,000 highly skilled software testers in over 60 countries. Enterprise customers can use the passbrains.com platform not just in the form of a managed on-demand service, but also in self-service mode with their hybrid or private crowd.
“Our unique service model ensures best product quality while reducing testing costs and time to market for our clients,” said Dieter Speidel, President and CEO of the PASS Group. “We achieve this through massive scaling of the number of external testers assigned during product development to test applications under real-world conditions.”
Carl Esposti, CEO and Founder of massolution and Crowdsourcing.org confirmed that their research shows that “large and small companies alike are doing everything they can to maximize the end-customer experience, which today is as likely to occur at the end of an application versus a phone call or in-person. Crowdtesting provides the answer for those enterprises looking to lead or that are struggling to keep up.”
While passbrains is best known for providing enterprise level crowdtesting solutions and a highly qualified “crowd” of professional application testers, it is now further expanded to offer an entire suite of real-time Testing Workforce Management solutions to large enterprises including recruiting, crowd consulting and knowledge networking through global experts. Uniquely, passbrains also allows customers direct access to its technology and methodologies as more enterprises are seeking solutions to integrate public and private crowdtesting approaches.
(Link: http://advertisers.crowdsourcing.org/passbrains) A November white paper, “Testing Applications for the Real World,” by massolution, which was sponsored by PASS Group, outlines the impact of crowdtesting and how companies are realizing savings of up to 50 percent over previous software development processes.
“The wide availability of software testing professionals offering their services through a virtual Internet-based infrastructure and the rise of cloud computing make crowdtesting a natural extension of the crowdsourcing phenomenon,” said Speidel. ”Developers desperately need to test software under real-world conditions in order to work out bugs and defects in a matter days or weeks, not months, especially where different languages, browsers and platforms are all variables in software and app localization. Our successes in Europe and the projected growth of the U.S. software testing market enable us to hit the ground running.”
“Managed crowdtesting is an excellent tool to further extend our quality assurance strategy by adding test resources with the most heterogeneous skill profiles, professional backgrounds, and cultural user behavior,” said Michael Palotas, head of Quality Engineering Europe at eBay. “Crowd testers think and work in different ways than internal testers; this is why crowdtesting can still find bugs which haven’t been detected through traditional software testing methods.”
Passbrains crowd testers are thoroughly vetted, and clients work with a team of PASS’ professional in-house project managers to streamline the entire process. “The data in our white paper confirms that as more testers are added to a project, the number of uncovered defects increases substantially. Identifying more problems in the testing phase with crowdtesting can have a hugely positive impact on a company’s reputation and provide significant cost savings and damage avoidance by early detection of critical issues,” added Speidel.
To learn more about crowdsourcing and crowdtesting, read our new whitepaper.
About PASS Group
Building on long-term success in quality engineering and process excellence, PASS Group is a Swiss headquartered global IT and professional services provider with over two decades of experience in providing applications development and professional testing services. We help our customers, from small, high-growth start-up’s to Global 1000 companies, embrace “the crowd” through our passbrains platform and crowdsourced testing services as a way to close the speed versus quality gap in in a digital world where applications require more support, and testing, than ever before.
Massolution is a unique research and advisory firm specializing in the crowdsourcing and crowdfunding industry. Massolution works with leading organizations to deliver crowdsourcing and crowdfunding business models that access an on-demand, scalable workforce to deliver improved business performance and to drive product and service innovation and enhanced levels of customer engagement. Our team has experience working in large enterprise environments designing, implementing, and managing crowdsourcing initiatives. Massolution also operates the industry website Crowdsourcing.org.
Passbrains Projects on December 6, 2012in
Passbrains Projects on December 2, 2012in
Crowd & Cloud in the Clouds – our afternoon event on Nov 28 was filled with interesting presentations and discussions around enterprise crowdsourcing, crowdsourced and cloud based testing. Industry representatives, journalists and software testing experts enjoyed our highly informational program, the breathtaking view from our conference room on prime tower’s floor 35 and the rich attendee’s apéro and conversations. Find more on our Facebook Page.
Weblog on October 10, 2012in
In today's rapidly growing and truly global software industry, success is now more than ever dependent on the quality of the software. A good quality product or service leads to satisfied and loyal customers – the main ambition of every company. A business that compromises on quality loses loyal customers in the long run. The challenge that most IT managers and executives have is common: how to effectively test software applications on time and within budget while balancing resources?
Under the right circumstances, “crowdsourcing” offers a rapid and cost-effective approach to software testing. Traditionally, software testing was a neglected afterthought. It was a tedious chore for developers once their real work was done and was based on a set of formal verification mechanisms that were costly to apply. Rigorous testing is particularly significant for mission critical applications because a formal approach, though a proven method for reducing defects in software, requires highly specialized talent that is limited or often even unavailable in most organizations. Furthermore, formalized testing cannot be scaled to cover the scope of the complex software deployed most in the modern IT landscape.
Several trends are changing the perception in favor or crowd sourced testing. The emergence and massive adoption of the Agile software development methodology that advocates shorter “sprints” (iterations) of development brings software testers closer to the creative development process. The advent of web applications, whereby software is deployed on the Internet and bugs become apparent very quickly. Set with a budgetary limit (testers are paid a certain rate per valid bugs found), ‘crowd sourced’ testing is a highly compelling innovation that can be used to complement existing test cycles, used in pre-release deployments, and even post-deployment testing.
Many hands make software work
The stakes for Microsoft, which was outlining its Office 2010 product strategy, were extremely high. According to Microsoft's earnings statements, Microsoft Office productivity suite generates more revenue than any other business division, says Gregg Keizer, who covers Microsoft and general technology news for Computerworld.
Months before Microsoft released Office 2010 productivity suite, 9 million people downloaded the beta version to test the software and to provide feedback. Through this program, Microsoft collected 2 million valuable comments and insights from those testers.
Denise Carlevato, a Microsoft usability engineer for 10 years, and her colleagues from Microsoft's Virtual Research Lab observed how people used new features. Their objective was to make Microsoft Office fit the way millions of people used their product and to help them work better. It was a massive, controlled crowdsourcing project.
According to Carlevato, “That's just what you have to do to cater to as broad an audience as possible”. This is not especially easy; to retain the loyalty of millions is a herculean task. “While the team was building it and giving insights and information, it was still all like a big jigsaw puzzle. Toward the end when this all came together I had the opportunity to go out and see how the web apps were actually going to live with real people.”
Developing a new software product is always exciting, especially to watch ideas take form and truly become a reality. Sometimes a fresh perspective or an innovative use case is all it takes to turn a product from good to great. However, when it comes to testing, we often find ourselves in unchartered waters wondering if the product will actually work in the diverse customer landscapes. It is virtually impossible to test the vast number of devices and configurations of software that web-based software can run on today. Truly robust testing is time consuming, and ensuring that every possible permutation and combination of features, localizations, and platforms works, as intended is nearly impossible.
Often times, comprehensive testing is a challenge and buggy code is delivered to the customer. For example, if a Software-as-a-Service (SaaS) application does not render in a particular browser or a critical software tool fails to deliver its intended functionality, a bug fix or a patch is promised and the vicious cycle starts all over again. Either way, the customer withstands the worst of inadequate testing, especially when faced with the escalating costs of software maintenance, performance, etc. For the software development company, ramifications include distress around brand image, perceived quality, relationship and potential future projects, trust, etc.
Welcome to the new world of crowd sourced testing, an emerging trend in software engineering that exploits the benefits, effectiveness, and efficiency of crowdsourcing and the cloud platform towards software quality assurance and control. With this new form of software testing, the product is put to test under diverse platforms, which makes it more representative, reliable, cost-effective, fast, and above all, bug-free.
Crowd sourced testing, conceived around a Testing-as-a-Service (TaaS) framework, helps companies reach out to a community to solve problems and remain innovative. When it comes to testing software applications, crowdsourcing helps companies reduce expenses, reduce time to market and increase resources for testing, manage a wide range of testing projects, test competence needs, exigency to resolve higher defects rates, and use 3rd party’s test environment to subside the project requirements.
It differs from traditional testing methods in that the testing is carried out by a large number of different testers from across the globe. In other words, crowd sourced testing is a form of outsourced software testing, generally a resource-limited and therefore time-consuming activity, to testers around the world, thus enabling small startups to use ad-hoc quality-assurance teams, even though they themselves could not afford traditional quality assurance testing teams.
Why Does Crowd Sourced Testing Work?
To understand why crowd sourced testing works, it is important to understand the set of biases that infest most testers and test managers around the world. This phenomenon is called, “The Curse of Knowledge,” a phrase used in a 1989 paper in The Journal of Political Economy. It means that for a particular subject expert, it is nearly impossible to imagine and look beyond the knowledge the tester has acquired i.e. the set of concepts, beliefs and scenarios that the tester knows or predicts. As a result, it is particularly challenging to think outside the box and conceive the various ways a typical end user would use particular software.
This phenomenon has been empirically proven through an infamous experiment conducted by a Stanford University graduate student of psychology, Elizabeth Newton. She illustrated the phenomenon through a simple game, people were assigned to one of two roles, namely tappers and listeners. Each tapper was to select a well-known song, such as “Happy Birthday,” and tap the rhythm on a table. The listeners were to guess the song from the taps. However, before the listeners guessed the song, tappers were asked to predict the probability that listeners would guess correctly. They predicted 50%. Over the course of the experiment, 120 songs were tapped out, but listeners guessed only three of the songs correctly – a success rate of merely 2.5%
The explanation is as follows: when tappers tap, it is impossible for them to avoid hearing the tune playing along to their taps. Meanwhile, all the listeners could hear is a kind of bizarre Morse code. The problem is that once we know something, we find it impossible to imagine the other party not knowing it.
Extrapolating this experiment to software testing, most testers conduct a battery of tests that they feel is representative and that captures the set of end-user scenarios for how the software would be used. The reality is far from this. Any expert tester would asset that it is impossible to capture the complete set of scenarios that an end user may throw at a software system. As a result, critical paths of the code under certain scenarios go untested, which leads to software malfunctioning, production system crashes, customer escalations, long hours of meetings, debugging, etc.
Crowd sourced testing circumvents all these headaches by bringing a comprehensive set of code coverage mechanisms and end user scenarios during the design and development stages of software engineering, during which the cost of modification is meager. This results in identifying critical use cases early on and providing for those contingencies, which reduces software maintenance costs later on during and after productive deployment. Besides progressive code coverage, the quality and depth of software testing among various vital software modules is achieved, which ultimately results in a higher code quality, among other benefits.
Crowd sourced testing – the framework
At the heart of crowd sourced testing is the community that tests a given software product. The community encompasses people from diverse backgrounds, cultures, geographies, languages, all with a diverse approach to software usage. The community, represented by a diverse and extended user space, tests any given software by putting it to use under realistic scenarios, which a tester in the core test team may not be able to envision, given a tester’s constraints, such as limited bounds of operation, knowledge, scenarios. Thus, it is easy to observe the broad set of usage patterns that put the software under intense scrutiny. Crowd sourced software testing draws its benefits from delegating the task of testing a mobile, web or software project, while in development, on to a large number of Internet users, working in parallel for comparably short test cycle durations, to ensure that the software contains no defects.
The method of crowd sourced testing is particularly useful when the software is user-centric, when software’s success and adoption is determined by its user feedback. It is frequently implemented with gaming or mobile applications, when experts who may be difficult to find in one place are required for specific testing, or when the company lacks the resources or time to carry out internal testing.
The spectrum of issues that such test efforts could uncover within a short lead-time is particularly noteworthy. Such testing efforts yield productive results with reasonable costs. Testers usually get paid for deliverables, such as test cases and for valid reported bugs. Additional small contribution rewards often help to achieve higher project participation rates. Crowd sourced testing providers offer their services either based on flat rates for certain test capacities and durations, or they charge fixed rates per reported bug, or a combination of both. In general, crowd sourced testing provides a much higher Return on Investment (ROI) compared to the traditional means of software testing.
How does it work?
Most vendors of crowd sourced testing (also called “crowd testing”) services provide the platform for managing their crowd testers and the testing projects. Clients specify the type of tests that they wish to have performed and the types of devices and configurations that the software product must be tested on.
Testers complete a profile, indicating the skills and domain knowledge they have, the devices to which they have access to, and the countries where they reside. Once a tester has completed his profile, he/she can check the project dashboard for a listing of projects and releases that are available for testing. The dashboard may also include sample test scenarios, additional tools and scripts, instructions for testers about what is expected from them, etc. Usually, the testers are provided with or required to submit their inputs for a test plan, which outlines both high level test cases and detailed test scenarios. The plan may also include whether or not the test can be automated and expected results.
A qualified Project Manager, who is typically a proven community leader or a person from the client/the platform company, designs or reviews such plans, and approves or amends such plans to cater to the client’s specific testing requirements.
Each project includes an explanation and access to a forum where bugs and issues are discussed and additional questions can be asked. Testers submit documented bug reports and are rated based on the quality of their reports. The amount the testers earn increases as their rating increases.
The community combines aspects of collaboration and competition, as members work to finding solutions to the stated problem. Forums facilitate networking and discussion of bugs or relevant issues; rating systems allow for recognition of a job well done, which helps participants gain credibility and improved career.
The crowd sourced testing team ideally works in addition to the organization's testing team, and not as a replacement.
Checks & Balances
Security is a crucial element to crowd sourced testing. More often than not, confidential customer information is exposed to testers during application testing. Any breach of this data can lead to serious damage, both to the brand and the business. Test data management ensures the availability and security of test data by obfuscating sensitive information for large-scale testing engagements. Masking such information or creating ‘test-only’ data helps maintain privacy and security while using crowd sourced testing services.
In almost all cases, the testers are required to sign a Non-Disclosure Agreement (NDA) when they join the community. The NDA forbids them from talking about customers, their products or specific defects, both offline and online on LinkedIn, Facebook, Twitter, personal blogs or anywhere outside the confines of the private testing platform. Beyond that, the customers can upload a customized NDA, which testers must sign before viewing the customer’s project. For projects that require a high level of security, a pre-screened list of white hat engineers, that have a long professional relationship with the platform company are selected.
By combining an internal, permanent team of testers with a crowd of experienced software testers working from around the globe, superior quality in testing is delivered. By constantly filtering the network of testers to accept only experienced software testing professionals, applicants without formal training and significant professional experience are eliminated. This ensures the quality and the validity of the bugs reported. Last but not the least, tests are dispatched to individual testers based on their experience, available material, and languages mastered. The testers and test project exposure are continually monitored to ensure both quality and integrity, not only of the test results, but also of the associated environment.
What to look out for?
Crowd sourced testing is best when the product under development is consumer-centric rather than enterprise-centric, such as gaming, mobile or web driven consumer applications. A global user base to test the product should exist and the product should be relevant to the community at large. This is also a test for the application’s potential success in the marketplace.
Paul Herzlich, a software-testing analyst, who oversees crowdsourcing services at Ovum, an institution that provides its clients with independent and objective analyses stated, “If you are testing software that all kinds of strangers are going to use, then why not use a bunch of strangers to test it. Also, it depends on what kind of testing you need to do. For testing user interfaces, sure – it makes sense.”
There should also be an earnest interest from the community to proffer critical feedback for the product under consideration such as a monetary reward. This also brings forth another interesting challenge. The product company is not obliged to follow through on community’s recommendations and may dispense with the feedback for various internal reasons. In this case, the community may feel unheard and this mandates a fine balancing act of the entire ecosystem.
The product company should be committed to working with a large group of people and understand that it involves some degree of overhead in such a decentralized test effort. It also requires certain subject matter experts to mentor and monitor various testing efforts as well as offer support and relevant guidance to the testing teams. If the product team does not have the resources to take on full-fledged testing in-house, but has a good understanding of the testing requirements, it can realize its overall strategy from a globally sourced team.
With normal employment contracts, employees receive a salary for their contribution and the firm owns any intellectual property developed by the employee during their tenure with the organization. In a crowd-sourcing constellation, people are participating voluntarily. Therefore it is an essential necessity to explicitly state the position on Intellectual Property (IP), i.e. a condition of the right to participate is the acceptance of Intellectual Property transfers to the client, to avoid potential risks of IP infringement by the contributors.
A crowd-sourced project requires skills and mastery in designing the compensation structure, both in monetary and non-monetary terms. The testers are usually paid a certain amount of money for the deliverables provided and for approved bug/issue reports. In some cases, the testers would prefer non-monetary aspects like recognition and personal satisfaction rather than monetary compensation. Thus, it is vital to understand the motivators prior to mission critical deployments.
In cases where participants are compensated on a per task basis, an incentive for participants to choose speed over accuracy exists. This is especially the case with especially micro tasks, which are susceptible to mistakes and could result in erroneous overall outcomes. Therefore, robust governance mechanisms need to be instilled, continually monitored and policies regularly updated to reflect the changing trends.
Advantages of crowd sourced testing:
1. Representative scenarios from the real user base, not hypothetical test cases
2. Tight feed-back loop with rapid feedback processing and agility
3. Comprehensiveness in use cases, platforms, tools, browsers, testers, etc. that is typically impossible to replicate by any single product company
4. Cost efficiency, given by the service models offered by the vendors
5. Diversity among the pool of testers lends to comprehensive testing, especially with regard to applications, which are localization based
6. Reduced time to test, time to market and total cost of ownership as most defects can be identified prior to deployment, which leads to significant reductions in maintenance costs
7. Better productivity and improved product development focus
Disadvantages of crowd sourced testing:
1. Governance efforts around security, exposure and confidentiality when offering a community project to wide user base for testing
2. Project management challenges that stem from the testers’ diverse backgrounds, languages and experience levels
3. Quality assurance efforts to verify and improve bug reports, identify and eliminate bug duplicates and false alarms
4. Equity and equality constraints in the reward mechanism with remuneration as a function of the quality of contributions that meets a prescribed minimum standard
What does the future hold?
Crowd sourced testing, clearly, has its advantages and limitations. It cannot be considered as a panacea for all testing requirements and the power of the crowd should be diligently employed. The key to avoid failure in crowdsourcing would be to use it prudently depending on the tactical and strategic needs of the organization that seeks crowd sourced testing services. It is important for the organization to embrace the correct model, identify the target audience, offer the right incentives and have a suitable workforce to manage the task results.
Crowd sourced testing is a relatively new methodology in software quality engineering. Thoroughly planned, organized and applied, it is a great tool for software producers to ensure compatibility of their applications on most major platforms and configurations and it helps to discover and eliminate harmful defects which survived traditional software QA and testing efforts. The further evolution of crowd sourced testing will lead to new collaboration forms between service buyers and vendors, between organizations and crowd testers, and maybe even between crowd testers themselves. The emerging global crowd testing community will continuously specialize into different industry domains, software product categories and customer relationships, most probably materializing in the form of various quasi-vertical categories of on-demand, self-service software testing workbenches.
Original Author: Mithun Sridharan, adopted by Dieter Speidel for passbrains.com
Developing a new software product is always exciting, especially to watch ideas take form and truly become a reality. Sometimes a fresh perspective or an innovative use case is all it takes to turn a product from good to great. Before software ever reaches the hands of the users it's intended for, it needs to get tested for hours and hours in all sorts of environments and scenarios.
However, when it comes to testing, we often find ourselves in uncharted waters wondering if the product will actually work in diverse customer landscapes. In the modern and increasingly decentralized enterprise, there's an almost infinite number of variables to test for that are often beyond the capabilities of an in-house testing team.
It is virtually impossible to test the vast number of devices and configurations of software that web-based software can run on today. Truly robust testing is time consuming, and ensuring that every possible permutation and combination of features, localizations, and platforms works, as intended is nearly impossible. Not surprisingly, this is where the crowd can play a critical role.
Learn how businesses use crowdsourcing to get ahead of the competition.
Who Should Attend: Company Innovators and Decision Makers, Enterprise Data Managers, Marketing Directors, Entrepreneurs, Investors and VCs
What You’ll Learn:
- How to take a business idea from launch to profit with the power of the crowd
- Microtasking solutions to moderate content, optimize search results, measure social media sentiment, and handle big data
- Self-service crowdsourcing solutions you can start using today, and more
PASS & Greenliff Afternoon talks
28.11.2012, 14:00-17:00, Clouds Conference Center, Prime Tower Zürich
If you would like to register, scroll down to the Bookings section on the following page. Thank you!
Congratulations to all August Award Winners of our KnowledgeCenter contest!
Here's a list of the awarded questions:
1st price ($50): Does crowd sourced testing fit in Agile S/W development methodology?
2nd price ($30): How to create a test that can move between multiple windows with Selenium IDE?
3rd price ($15): Which are the top 5 static analyzer used in the Delphi 7 and .NET?
Check in at passbrains.com KnowledgeCenter to read the solutions provided by other members or to post your questions and solutions for the September contest!
passbrains.com KnowledgeCenter is powered by starmind.com
Passbrains Projects on August 15, 2012in
Congratulations to all July Award Winners of our KnowledgeCenter contest!
Here's a list of the awarded questions:
1st price ($50): We need to run our tests for 30 days continuously for load, stress and longevity testing. How can we simulate the same?
2nd price ($30): Which are the most important Performance Indicators (KPI) in performance testing?
3rd price ($15): We have a huge set of test cases. Most of them we want to have as automated tests within a regression test set. To execute all test sequentially would take to much time. What are the best tools for running tests parallel in case of:
- Web App
- Mobile App
- .NET App ?
Check in at passbrains.com KnowledgeCenter to read the solutions provided by other members or to post your questions and solutions for the September contest!
passbrains.com KnowledgeCenter is powered by starmind.com
passbrains.com launches its innovative Starmind-based On-Demand Knowledge Network, providing customers and software testers with on-demand access to IT and testing expertise.
Starmind Launch Announcement
Another passbrains crowd testing project completed with great success: comparis.ch used passbrains to run a large campaign of functional and usability tests prior to their launch of a new Android mobile app. "Our first crowd testing project with passbrains.com delivered great results – especially the wide coverage of different devices and OS versions helped us a lot to ensure the quality of our new Android based software. Furthermore we collected many valuable usability feedbacks from passbrains' crowd testers, leading to further improvements of our software to meet the high expectations of our large user base. passbrains managed crowd testing services have now become an integral part of our software quality assurance strategy" says Elisa Chiarelli, Product Manager at comparis.ch.
Many visitors on Swiss Testing Day, March 14 2012, dropped by on our booth to learn about the benefits of our new passbrains managed crowdtesting services and to discuss the use of passbrains in their upcoming testing projects. Software vendors and institutions from many different domains welcomed the opportunity of getting on-demand access to our large test experts base.
A very busy and successful day for our passbrains project team:
Here's some examples of our latest media coverage in german language publications:
Info on February 9, 2012in
The current version of this platform provides the following functions:
- request an offer
- register as customer
- register as tester
- contact us
The projects catalog will be provided soon, allowing registered testers to apply for project participation.
About on February 7, 2012in
Crowdsourcing has become a serious and powerful instrument for large scale software testing at comparably lowest costs. With its new managed Crowd Testing service, PASS offers a unique and extremely competitive service model for on-demand, crowdsourced testing of mobile, web and desktop applications. The basis for this new Crowd Testing service is PASSbrains, a web based platform for an exclusive, global community of senior software professionals and testing experts, built and managed by PASS. PASSbrains community members around the world contribute in software testing projects for PASS customers, managed by PASS in Switzerland.
Through PASSbrains, customers gain instant access to the skills of the most qualified testing professionals worldwide. PASSbrains allows for quick recruitment of the best matching crowdsourced test resources on a large scale, and for project execution in shortest possible timeframes. Zurich-based PASS test project managers take care of analysis, test planning and test case design, as well as review and consolidation of deliverables received from the assigned software testers. Customers benefit from fast results and highest software quality assurance at significantly reduced costs.
PASS sponsors and exhibits at Swiss Testing Day on March 14, 2012 in Zurich, Switzerland. The main topic for this event is PASS’ new passbrains crowdtesting service. Customers and software testers are invited to visit our booth to learn about most typical use-cases, advantages and benefits of crowdsourcing in software test projects.