Home > Test procedure

Procedure to assess web conferencing solutions

Scope and depth of testing

This Website provides a quick overview of the advantages and disadvantages of leading web conferencing solutions for smaller and medium-sized companies and the self-employed. As a result, we limited our comparison, and the corresponding web conferencing tests, to answering key questions based on real-life use.

Selection of web conferencing solutions for testing

We selected online meeting tools on the basis of the criteria as follows:

• Their popularity in the marketplace
• The ability to use them without an own IT infrastructure and/or IT experts
• The ability to register online for a free trial account, to run on their PC or Mac and to conduct web conferences
• The availability of an English user interface (further languages are rated accordingly positive)
• The availability of pricing/licensing information

We do not claim that this selection is complete or comprehensive.

How web conferencing tests were carried out

The tests were carried out by us. Our testing procedure was neither influenced by a third party, nor did we receive advice from a third party.

Testing procedure for tools

1. Test accounts were created for all solutions. To ensure the same testing environment for all solutions, they were tested on the same computer.
2. The initial implementation was documented step by step.
3. The first round of tests was based on a standard checklist, to ensure the same/comparable user actions.
4. The second round of tests was, from our perspective, the most important: We tested the solutions under real-life office conditions, in other words, we used them in our day-to-day business. This highlighted which functions are essential in today's office environment.
5. In the third round of tests, we compared costs. This comparison was based on real figures and publicly announced license fees. To ensure a fair comparison of costs, we selected each vendor's lowest-cost license model for the scenario.

Weighting of results

We believe that "user friendliness" and "speed of setting up a meeting" are the most important criteria when testing solutions in terms of real-world use. In August 2007 we changed the weighting of individual test categories to reflect this. The same weighting has been applied during our reassessment of all web conferencing tools in May/June 2008.

The weighting:

• Number and scope of features = 15%
• User-friendliness = 25%
• Speed of setting up a meeting = 20%
• Ease of installing software = 5%
• Cost transparency = 10%
• Security = 15%
• System requirements = 10%

Testing and evaluation were carried out to the best of our knowledge and belief.

Do you have any questions on the testing procedure? Send us your feedback. We look forward to hearing from you.