Clearly Communicating Conceptions of Validity and Reliability

Author(s):  
Debra J. Dean

When embarking on this journey, the author had little expectation of finding the topics of validity and reliability to be so complex and convoluted or so interesting. This chapter helps to clear the air and communicate the concepts of validity and reliability more clearly. The challenges seem to include the wording used to introduce and describe the concepts along with the transformation of statistical equations over time and technology. What remains the same is the importance of knowing whether an instrument is valid and reliable. One of the most basic places to start with conducting a robust quantitative research project is to have valid and reliable instruments. This may involve creating your own instrument, using an established instrument, or modifying an existing instrument. This chapter takes a deep dive into the concepts of validity and reliability uncovering some of the cynicism and myths of these topics along the way. The ultimate goal is to communicate clearly so that future research can use the proper technique(s) and describe the output in a more uniform fashion.

2009 ◽  
Vol 22 (1) ◽  
Author(s):  
Laurens A. ten Horn

Elton Mayo, mules and the discovery of 'social space' Elton Mayo, mules and the discovery of 'social space' L.A. ten Horn, Gedrag & Organisatie, volume 22, March 2009, nr. 1, pp. 41-49 The Human Relations movement has fundamentally altered the way we look at the relationship between work and the individual. This shift is traced using publications by Elton Mayo. Over a period of more than twenty years he reported several times on the same research project done in the spinning department of a textile mill in 1923/1924. Both his description and his interpretation changed dramatically between publications from 1924 to 1945. The changes were caused by and ran parallel to the Hawthorne studies in which he was deeply involved. The comparison of publications illustrates how fundamental and incisive this change in thinking was and how difficult it was to make the mental shift necessary. In addition, it questions the extent to which the development of knowledge over time is the result of strict rationality.


2021 ◽  
Vol 11 (3) ◽  
pp. 61-65
Author(s):  
Safaa Shaaban ◽  
Mohamed A. Khalek Hassan

The purpose of the paper is to present a scale to measure EFQM model application in any organization as an instrument. This paper will present a set of original information and tool for the Model users. A quantitative research strategy with SPSS uses to test the validity and reliability of the presented questioners. The EFQM model scale will guide and support future research lines in this field of management. A literature review from previous publications wasconducted. Many papers were selected and aspects related to the purpose. The suggested scale was tested with around 100 NGOs in the Middle East testing the EFQM criteria validity and reliability.The study result presents a clear scale and instrument help to measure the nine criteria presented as a main component for this model, and more furthermore a dozen lines of future research.


Author(s):  
Dylan Stan ◽  
Kalina Christoff

Although mind-wandering has received increased attention in the field of cognitive neuroscience, definitions have not always aligned. Most have emphasized the contents of thought, treating it as synonymous with either task-unrelated thought or stimulus-independent thought. Such definitions miss an important aspect of what it means to let one’s mind wander: the easeful way that thoughts move about. A more recent definition looks, instead, at the dynamics of thought—the way that thoughts unfold over time—positioning mind-wandering as a type of spontaneous thought. By doing so, it is therefore more readily equipped to incorporate this quality of ease. While the term mind-wandering can sometimes refer either to a momentary event or to an ongoing activity, both usages, this chapter argues, will be unsatisfactory if they do not address this gentle mode of movement. Some benefits that ease can provide for future research are proposed.


2021 ◽  
Vol 3 (4) ◽  
pp. 49-60
Author(s):  
David Van Vliet ◽  
Marcos Mortensen Steagall

This article presents a practice-led research project that asks how experienced time can be perceived through manipulated photographic images. The investigation is carried out by a series of digital images whose content is renegotiated over time, while the subject of the photograph remains within the frame. The artwork evidences an unstable space between a photographic composition and a moving image employed to question the power conventions in visualization and to expand the way we can conceive of time as duration in digital photographic images. It contributes to the discourse about practice-led oriented methodologies in the field of practice as a form of research through a comment on the design practice.


2018 ◽  
Vol 15 (Number 2) ◽  
pp. 227-256 ◽  
Author(s):  
Donnie Adams ◽  
Bambang Sumintono ◽  
Ahmed Mohamed ◽  
Nur Syafika Mohamad Noor

Purpose - Blended learning is rapidly emerging as a domain for practice and research. Across disciplines and contexts, at individual instructor and institution levels, educators are experimenting with the blended learning model of instruction. The current generation of learners have been referred to as ‘digital natives’ in reflection of their apparent ease and familiarity with digital technology. However, questions remain about how ready students are for a blended learning model of instruction. The purpose of the study was to investigate students’ readiness for a blended learning model of instruction in a leading Malaysian higher education institution. Methodology - The study employed a non-experimental quantitative research design. Data were gathered from a sample of 235 undergraduate and 131 postgraduate students using the Blended Learning Readiness Engagement Questionnaire (BLREQ). The data was analysed using the WINSTEPS Rasch model measurement software to determine the validity and reliability of the instrument. Differential Item Functioning (DIF) analysis was also used to identify responses based on students’ demographic profiles. Findings - Findings identified that students were ready for blended learning. Further analysis indicated that there were differences in students’ readiness for blended learning based on gender, age, ethnicity, field of study, and level of education. Significance - This study provides insights on students’ readiness towards blended learning, particularly in the Malaysian context, discusses implications for blended learning practices in higher education institutions, and offers recommendations for future research.


Author(s):  
Wallace Lockhart ◽  
Brad Wuetherick ◽  
Nola Joorisity

This paper illustrates the chronology of a research project which began in 2010 and continues today.  The research has evolved over time from a focus on the phenomenon (developing an understanding of student diversity and its impacts on student success), to experimental research (to learn the impact or benefits derived from the introduction of high impact practices), to a more complex understanding of the foundations for student success.  The fourth stage of the research, which is just underway, divides our efforts into two distinct directions.  The first is quantitative research utilizing institutional and learning management system data which was previously untracked and untapped.  The second is a shift to employing more qualitative research tools aimed at advocacy and institutional change.  Through each phase of the research the paper presents two distinct perspectives: First is the perspective of instructors-turned-SoTL-researchers as we muddle our way through understanding our challenges and learning how to use SoTL research methods to help guide the way.  The second perspective is that of an established SoTL researcher, who provides commentary and guidance to our journey.  Our hope is that the reader finds these two perspectives of a research journey both informative and valuable in providing insights into how a long-term research project might unfold.


10.28945/4152 ◽  
2018 ◽  
Vol 17 ◽  
pp. 527-547
Author(s):  
Fariza Khalid

Aim/Purpose: The study aims to explore the dimensions of identities in relation to an online community of practice (CoP) and how the dimensions of identities influence the way teachers behave on their online CoP. Background: One of the emerging approaches for teachers’ professional development is through a form of community of practice, through which teachers learn through collaboration and active learning. In line with the progression in technology, online communities of practice have been widely accepted as one of the possible approaches for teacher professional development that can enhance the opportunity for collaboration. Even though online CoPs provide a better platform for collaboration and sharing best practices among teachers, some issues lead to a failure of any online CoPs. Day, Sammons, Stobart, Kington, & Gu (2007) stress the importance of understanding the aspects of identities and their impact on how teachers perform and commit to any activities and that an understanding of teachers’ identities is central to any analysis of teachers’ effectiveness, work, and lives. Previous research, however, studied the aspects of identities in the perspectives of the development of their identities as teachers in the context of their daily interaction with significant others in face-to-face mode. However, there has been very little research that has focused on teachers’ identities in relation to their participation in online communities. The extent to which their identities influenced the way they interact, engage, and contribute to their online CoP is still debatable, although it was profoundly stated that identities play a great role in shaping teachers’ behavior in their offline CoPs. Taking this into account, this study aims to identify the dimensions of identities in an online CoP setting and how these identities influence their capacity to involve themselves in online sharing through communities of practice (CoPs). Methodology: This research employed a case study approach which involved 16 teachers from six high performing secondary schools. The selection of the participants was made through purposive sampling. Data was generated through in-depth one-to-one interviews. Data analysis was conducted using thematic analysis through which the emerging themes were carefully identified. Contribution: The study has successfully identified the dimensions of identities in relation to teachers’ participation in an online CoP, which adds to the current body of literature. The result of the study also illustrates how these dimensions of identities interrelated to each other that led to the teachers’ level of participation in an online CoP. Having an in-depth understanding about identities also would provide a better understanding of why the members reacted the way they did and, and how the dimension of identities plays a role in this. Findings: The result of the analysis indicates four main dimensions of identities, i.e., personal identities, professional identities, learner identities and member of the community’s identities. These dimensions were found to influence each other. Overall, there are seven factors seen as ‘immediate’ causes leading to the final outcome (participation in online CoPs), i.e., beliefs in the benefits of informal sharing activities, perceived importance of online sharing activities, perceived role in community, willingness to initiate discussions, willingness to respond, acceptance towards others’ comments, and beliefs in the benefits of online communities. Personal identities affected not only their jobs as teachers but also influenced their commitment towards their participation in the online CoPs in this project. Their prior knowledge and experience influenced teachers’ perceived competency in using online sharing applications. Their prior experience also impacted the way they perceived the benefits of online activities (teachers’ identities as learners) and their attitudes towards them. The findings indicate that different individuals had different sharing preferences, and the differences were partly driven by how they conceived of professional development as well as how they perceived themselves professionally. Recommendations for Practitioners: This study also indicates that to ensure the success of any online professional development for teachers, it is essential to take into consideration the aspect of endorsement by senior management, e.g., principals or coordinators from a district or state level. It is also critical for stakeholders to understand the working culture of teachers and their conception of professional development to ensure any new policies is in line with teachers’ identities. Recommendation for Researchers: The analysis in this study was developed by exploring the reasons behind the teacher’s behaviors. In the future, it will be more meaningful for new researchers to consider the dimensions of identities when they develop any online CoP. Future Research: This study was conducted using a qualitative approach. The emerging dimensions of identities can be used by future researchers as a basis to do quantitative research that covers a larger sample size, through which a generalization can be made. A causal network that was developed in this study can be tested using inferential statistics.


2020 ◽  
Vol 8 (3) ◽  
pp. 2694-2726
Author(s):  
Lütfi SÜRÜCÜ ◽  
Ahmet MASLAKÇI

The Validity and Reliability of the scales used in research are essential factors that enable the research to yield beneficial results. For this reason, it is useful to understand how the Reliability and Validity of the scales are measured correctly by researchers. The primary purpose of this study is to provide information on how the researchers test the Validity and Reliability of the scales used in their empirical studies and to provide resources for future research. For this purpose, the concepts of Validity and Reliability are introduced, and detailed explanations have been provided regarding the main methods used in the evaluation of Validity and Reliability with examples taken from the literature. It is considered that this study, which is a review, will attract the attention of researchers.


Author(s):  
Felipe Kupka Feliciano ◽  
Melissa Ribeiro do Amaral ◽  
Juliano Keller Alvez ◽  
Inara Vieira Antunes Willerding ◽  
Édis Mafra Lapolli

Technological advances have allowed for new work concepts, modifying the way communication takes place, through tools, platforms and devices, enabling models such as home office. The difficulties of maintaining productivity and engaging teams in a home office regime is a relevant reality for many organizations today. In this scenario, this research aims to identify the challenges of maintaining productivity and engaging teams in a home office regime. To achieve the proposed objective, an exploratory, descriptive, and quantitative research was carried out, with 37 process managers. With this research, it was concluded that the evolution of home office management is intense, but aspects such as managing the journey, adapting the environment, training the team through the online mode, methods of maintaining commitment, generating networking alternatives and exchange of experiences, can be improved by organizations over time.


Author(s):  
Muhammad Yousaf ◽  
Petr Bris

A systematic literature review (SLR) from 1991 to 2019 is carried out about EFQM (European Foundation for Quality Management) excellence model in this paper. The aim of the paper is to present state of the art in quantitative research on the EFQM excellence model that will guide future research lines in this field. The articles were searched with the help of six strings and these six strings were executed in three popular databases i.e. Scopus, Web of Science, and Science Direct. Around 584 peer-reviewed articles examined, which are directly linked with the subject of quantitative research on the EFQM excellence model. About 108 papers were chosen finally, then the purpose, data collection, conclusion, contributions, and type of quantitative of the selected papers are discussed and analyzed briefly in this study. Thus, this study identifies the focus areas of the researchers and knowledge gaps in empirical quantitative literature on the EFQM excellence model. This article also presents the lines of future research.


Sign in / Sign up

Export Citation Format

Share Document