Meta-analysis in information systems research: method choices and recommendations for future research

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Markus Blut

PurposeThe use of meta-analysis in information systems (IS) research has increased. Because this research domain has matured and an increasing number of empirical studies have become available, meta-analysis is now perceived as a useful approach to synthesize an increasing body of empirical research. The present paper gives an overview of meta-analytical techniques, the evolution of meta-analysis in IS, the focus of these studies and method choices made by authors.Design/methodology/approachThis overview is based on 100 meta-analysis studies published in IS journals. These meta-analytical studies synthesize data from 6,262 empirical studies, and the meta-analyses were published between 1989 and 2020. The studies were coded with regard to 16 major method choices that IS researchers made when conducting meta-analyses.FindingsThis overview describes the key areas of meta-analysis (e.g. strategy and firm performance) and the journals that publish the meta-analysis. This overview also identifies method issues where meta-analyses have improved in recent years as well as issues that require some attention. Scholars receive guidance about good practices in terms of 16 major method choices related to (1) problem formulation, (2) literature search, (3) coding information, (4) analyzing and integrating effect sizes and (5) interpreting results and reporting findings.Originality/valueAddressing the identified method issues helps authors of future meta-analyses to increase the transparency of reporting and the likelihood of getting published. The substantive findings of a meta-analysis also often depend on researchers' method choices. Similar overviews exist for other disciplines, such as marketing and management.

Author(s):  
Susan Turner ◽  
Phil Turner

Researchers in Information Systems have produced a rich collection of meta-analyses and models of factors influencing the uptake of information technologies. In the domain of CSCW, however, these models have largely been neglected, and while there are many case studies, no systematic account of uptake has been produced. We use findings from Information Systems research to structure a meta-analysis of uptake issues as reported in Computer Supported Cooperative Work (CSCW) case studies, supplemented by a detailed re-examination of one of our own case studies from this perspective. This shows that while there are some factors that seem to be largely specific to CSCW introductions, many of the case study results are very similar to standard IS findings. We conclude by suggesting how the two communities of researchers might build on each other’s work.


2017 ◽  
Vol 13 (2) ◽  
pp. 106-132 ◽  
Author(s):  
Satish Kumar ◽  
Sisira Colombage ◽  
Purnima Rao

Purpose The purpose of this paper is to study the status of studies on capital structure determinants in the past 40 years. This paper highlights the major gaps in the literature on determinants of capital structure and also aims to raise specific questions for future research. Design/methodology/approach The prominence of research is assessed by studying the year of publication and region, level of economic development, firm size, data collection methods, data analysis techniques and theoretical models of capital structure from the selected papers. The review is based on 167 papers published from 1972 to 2013 in various peer-reviewed journals. The relationship of determinants of capital structure is analyzed with the help of meta-analysis. Findings Major findings show an increase of interest in research on determinants of capital structure of the firms located in emerging markets. However, it is observed that these regions are still under-examined which provides more scope for research both empirical and survey-based studies. Majority of research studies are conducted on large-sized firms by using secondary data and regression-based models for the analysis, whereas studies on small-sized firms are very meager. As majority of the research papers are written only at the organizational level, the impact of leverage on various industries is yet to be examined. The review highlights the major determinants of capital structure and their relationship with leverage. It also reveals the dominance of pecking order theory in explaining capital structure of firms theoretically as well as statistically. Originality/value The paper covers a considerable period of time (1972-2013). Among very few review papers on capital structure research, to the best of authors’ knowledge; this is the first review to identify what is missing in the literature on the determinants of capital structure while offering recommendations for future studies. It also synthesize the findings of empirical studies on determinants of capital structure statistically.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ned Kock

Purpose J-curve relationship analyses can provide valuable insights to information systems (IS) researchers. This paper aims to discuss moderated mediation in IS research and the related emergence of J-curve relationships. Design/methodology/approach Building on an illustrative study in the field of IS, the author Lays out three steps to combine moderation and J-curve analyses, with the goal of more fully understanding the underlying moderated mediation relationships. The paper proposes a new segmentation delta method to test for J-curve emergence, as part of this framework. Findings The paper shows, in the context of this study, the complementarity of moderation and J-curve analyses. Research limitations/implications Currently, IS researchers rarely conduct moderation and J-curve analyses in a complementary way, even though there are software tools, and related methods, which allow them to do so in a relatively straightforward way. Originality/value The analyses were conducted with the software WarpPLS, a widely used tool that allows for moderated mediation and J-curve analyses, in a way that is fully compatible with the set of steps presented in this paper.


2017 ◽  
Vol 19 (3/4) ◽  
pp. 228-256 ◽  
Author(s):  
Dominik Jung ◽  
Marc Adam ◽  
Verena Dorner ◽  
Anuja Hariharan

Purpose Human lab experiments have become an established method in information systems research for investigating user behavior, perception and even neurophysiology. The purpose of this paper is to facilitate experimental research by providing a practical guide on how to implement and conduct lab experiments in the freely available experimental platform Brownie. Design/methodology/approach Laying the groundwork of the tutorial, the paper first provides a brief overview of common design considerations for lab experiments and a generic session framework. Building on the use case of the widely used trust game, the paper then covers the different stages involved in running an experimental session and maps the conceptual elements of the study design to the implementation of the experimental software. Findings The paper generates findings on how computerized lab experiments can be designed and implemented. Furthermore, it maps out the design considerations an experimenter may take into account when implementing an experiment and organizing it along a session structure (e.g. participant instructions, individual and group interaction, state and trait questionnaires). Originality/value The paper reduces barriers for researchers to engage in experiment implementation and replication by providing a step-by-step tutorial for the design and implementation of human lab experiments.


2004 ◽  
Vol 19 (1) ◽  
pp. 81-92 ◽  
Author(s):  
Melanie Wilson

This paper aims to attend the under-theorisation of gender within the Information Systems (IS) literature by adopting a critical and feminist approach to the organisational context of IS development and use. The IS are conceived of as innovations with theoretical concepts and observations for comprehending the innovation process advanced within Social Studies of Technology being described and applied to IS. Consequently, a conceptual framework for studying gender and IS is constructed by combining insights derived from: (1) gender and computing, concerning the differences and inequalities of development and use of IS; (2) gender and society concerning the existence of gendered spheres; (3) studies of gender and organisations concerning the social division of labour; and (4) gender and technology, concerning the masculinity of technology culture. The developed framework is tabulated, areas for future research suggested and potential research questions outlined. The latter employ examples from the field of nursing to illustrate their tangible application. The framework constitutes a contribution to IS research by providing access to additional explanations for organisational phenomena (such as user rejection); by deepening our understanding of the innovation process; by improving IS practice through increased awareness of social issues (especially gender); and by promoting further potential topics for IS researchers.


2018 ◽  
Vol 25 (4) ◽  
pp. 430-446
Author(s):  
Aline de Vargas Pinto ◽  
Antônio Carlos Gastaud Maçada ◽  
Gabriela Labres Mallmann

Purpose The purpose of this paper is to provide an analysis of the studies about workaround behavior in the Information Systems (IS) area, addressing its positive and negative aspects and raising the key related issues. Design/methodology/approach A systematic literature review was conducted to verify how workaround behavior has been approached in IS studies. A qualitative method was adopted and implemented in two stages: selection of articles from the time period 2007-2017 in the databases Web of Science, ScienceDirect and Scopus and analysis of the selected articles. Findings The results showed that many studies have been concerned with identifying the principal reasons for the manifestation of workaround behavior and the measures taken to reduce its impacts. Many studies from international journals examined the implementation of an ERP along with the workaround behavior. The need to expand the national studies on workaround behavior is emphasized, because the majority of the identified studies are international. Research limitations/implications The key limitation is related to the period of analysis, because only articles published since 2007 were selected. Practical implications This paper contributes to both theory and practice, bringing relevant concepts about workaround behavior, and corroborating the importance of the studies on workaround in the IS area. The literature review of the 20 articles analyzed reveals the main features in each article, such as theoretical and methodological aspects that support the research. Based on this analysis, a conceptual map was developed presenting the most relevant points about workaround behavior, where the causes, the negative and positive consequences, the types of solutions and the organizational and individual impacts are presented. Originality/value Research into workaround behavior has increased in recent years, however very few studies have been conducted in Brazil. To the best of the authors' knowledge, no articles regarding Brazil and this subject were published between 2007 and 2017. Thus, this paper seeks to redress this imbalance.


2015 ◽  
Vol 22 (2) ◽  
pp. 225-248 ◽  
Author(s):  
Sascha G. Walter ◽  
Simon Heinrichs

Purpose – The purpose of this paper is to cumulate published empirical studies (1980-2009) on the relationship between individual variables and entrepreneurial status. The authors categorize repeatedly analyzed determinants into six perspectives (trait, cognitive, affective, intentions, learning, and economic), review empirical findings for each determinant and each perspective, investigate trends in the field, and propose avenues for future research. Design/methodology/approach – The authors categorize determinants into one of the six paradigms and review findings for 46 repeatedly studied variables from 131 studies. Support for each variable, publication outlets chosen, and temporal trends in exploring entrepreneurial intentions, entrepreneurial status or differences between entrepreneurs and other individuals are analyzed. Findings – Prior studies have focused on trait and economic perspectives with strong support, followed by the learning and intentions perspectives. The affective perspective is a still under-researched, yet growing field. Most articles were published in the 1990s. The emphasis on theoretical perspectives varies over decades. Directions for future research include integrating the perspectives (e.g. across the cognitive and affective domain), testing the temporal stability of influences, and developing and testing cross-level models that incorporate contextual influences. Originality/value – The paper complements prior reviews and meta-analyses by picturing the breadth of the field and adding important points to the research agenda.


Author(s):  
Brent Furneaux ◽  
Michael Wade

Constructs and the relationships between them are widely considered to be central to theory development and testing. Over time, information systems (IS) researchers have identified and explored an extensive set of relationships amongst a broad range of constructs. The result of these initiatives is a body of literature that can be considered to represent the cumulative learning of the discipline. Based on the premise that this cumulative learning is capable of providing valuable guidance to future theory development, the authors present a review and analysis of a large sample of empirical research published in two leading IS journals. The objective of this endeavor is to offer a broad perspective on the nature of the constructs and relationships explored in IS research and to develop a nomological network of the most salient relationships that can then serve to guide future research and to lend support to new and existing theory.


Author(s):  
Shaobo Ji ◽  
Qingfei Min ◽  
Weihe Han

The purpose of this study is to review current research activities concerning information systems (IS) in mainland China. We thus examined Chinese IS research with reference to discipline, research topic, research method, and units of analysis, identifying and reviewing a total of 604 research papers, published in 18 leading Chinese academic journals from 1999 to 2003. The results show that: (1) IS itself represents the major theoretical reference of the studies; (2) the IS research in China has clearly focused on organizational and system/software issues; (3) non-empirical studies were dominant in the field of IS research in China; and (4) the majority of studies were conducted at an organizational or systemic level.


Author(s):  
Prashant Palvia ◽  
Mohammad Daneshvar Kakhki ◽  
Torupallab Ghoshal ◽  
Vishal Uppala ◽  
Weian Wang

Sign in / Sign up

Export Citation Format

Share Document