Designing Research for Meaningful Results in Educational Leadership
Making appropriate methodological and analytic decisions in educational research requires a thorough grounding in the literature and a thorough understanding of the chosen methodology. Detailed preplanning is important for all method types and includes an understanding of the assumptions, limitations, and delimitations of the study. For quantitative research, researchers should be cautious with data analysis decisions that give preference to statistically significant results, noting that quantitative research can proceed with intents other than confirmatory hypothesis testing. Decisions and procedures that are used to search for low p values, rather than answer the driving research question, are especially problematic. Presentation of quantitative results should include components that clarify and account for analytic choices, that report all relevant statistical results, and that provide sufficient information to replicate the study. Consideration should also be given to joining recent initiatives for more transparency in research with the use of preregistered studies and open data repositories. For qualitative research, researchers should be thoughtful about choosing a specific method for their project that appropriately matches the method’s framework and analytic procedures with the research aim and anticipated sample. Qualitative researchers should also strive for transparency in their method description by allowing for a view of the analytic process that drove the data collection and iterative dives into the data. Presentation of qualitative results requires a balance between providing a compelling narrative that establishes the trustworthiness of results with the judicious use of participant voices. Mixed methods research also requires appropriate integration of different data types.