Contribution of the co.LAB Framework to the Collaborative Design of Serious Games: Mixed-Methods Validation Study (Preprint)
BACKGROUND Multidisciplinary collaboration is essential to the successful development of serious games, albeit difficult to achieve. The co.LAB serious game design framework was created to support collaboration within serious game multidisciplinary design teams. Its use has not yet been validated in a naturalistic context. OBJECTIVE The objective of this study was to perform a first assessment of the impact of the co.LAB framework on collaboration within multidisciplinary teams during serious game design and development. METHODS This was a mixed-methods study based on two serious game design projects in which the co.LAB framework was used. The first phase was qualitative and carried out using a general inductive approach. To this end, all members of the first serious game project team who used the co.LAB framework were invited to take part in a focus group session (N=6). Results inferred from qualitative data were then used to define a quantitative instrument (questionnaire) which was designed according to the Checklist for Reporting Results of Internet E-Surveys. Members of both project teams (N=11) were then asked to answer the questionnaire. Quantitative results were reported as median [Q1;Q3] and appropriate non-parametric tests used to assess for between group differences. Finally, results gathered through the qualitative and quantitative phases were integrated. RESULTS In both phases, the participation rate was 100%. Verbatim transcripts were classified into 4 high level themes: influence on collaborative dimensions; impact on project course, monitoring and efficiency; qualitative perceptions of the framework; and influence of team composition on the use of the framework. Accordingly, the web-based questionnaire was then developed according to Burhardt's seven dimensions of collaboration. In both projects, the co.LAB framework had a positive impact on most dimensions of collaboration during the multidisciplinary design and development of serious games. When all collaborative dimensions were aggregated, the overall impact of the framework was rated on a scale from "-42" to "+42" (very negative to very positive). The overall score was 23 [20;27], with no significant difference between groups (P=.58). Most respondents also believed that all serious game design teams should include a member possessing a significant expertise in serious game design frameworks to guide the development process. CONCLUSIONS The co.LAB framework has a positive impact on collaboration within serious game development teams. However, expert guidance seems necessary to maximize development efficiency. Whether such guidance can be provided by means of a collaborative web platform remains to be determined.