scholarly journals Construct Validity in Software Engineering

2021 ◽  
Author(s):  
Dag Sjøberg ◽  
Gunnar Bergersen
Keyword(s):  
Quantitative Analysis ◽  
Software Engineering ◽  
Construct Validity ◽  
Common Ground ◽  
Conceptual Level ◽  
High Quality ◽  
Operational Level ◽  
Minimalist Approach ◽  
Unbiased Manner ◽  
Statistical Conclusion

Empirical research aims to establish generalizable claims from data. Such claims involve concepts that often must be measured indirectly by using indicators. Construct validity is concerned with whether one can justifiably make claims at the conceptual level that are supported by results at the operational level. We report a quantitative analysis of the awareness of construct validity in the software engineering literature between 2000 and 2019 and a qualitative review of 83 articles about human-centric experiments published in five high-quality journals between 2015 and 2019. Over the two decades, the appearance in the literature of the term construct validity increased sevenfold. Some of the reviewed articles we reviewed employed various ways to ensure that the indicators span the concept in an unbiased manner. We also found articles that reuse formerly validated constructs. However, the articles disagree about how to define construct validity. Several interpret construct validity excessively by including threats to internal, external, or statistical conclusion validity. A few articles also include fundamental challenges of a study, such as cheating and misunderstandings of experiment material. The diversity of topics discussed makes us recommend a minimalist approach to construct validity. We propose seven guidelines to establish a common ground for addressing construct validity in software engineering.

scholarly journals Construct Validity in Software Engineering

2021 ◽  
Author(s):  
Dag Sjøberg ◽  
Gunnar Bergersen
Keyword(s):  
Quantitative Analysis ◽  
Software Engineering ◽  
Construct Validity ◽  
Common Ground ◽  
Conceptual Level ◽  
High Quality ◽  
Operational Level ◽  
Minimalist Approach ◽  
Unbiased Manner ◽  
Statistical Conclusion

Empirical research aims to establish generalizable claims from data. Such claims involve concepts that often must be measured indirectly by using indicators. Construct validity is concerned with whether one can justifiably make claims at the conceptual level that are supported by results at the operational level. We report a quantitative analysis of the awareness of construct validity in the software engineering literature between 2000 and 2019 and a qualitative review of 83 articles about human-centric experiments published in five high-quality journals between 2015 and 2019. Over the two decades, the appearance in the literature of the term construct validity increased sevenfold. Some of the reviewed articles we reviewed employed various ways to ensure that the indicators span the concept in an unbiased manner. We also found articles that reuse formerly validated constructs. However, the articles disagree about how to define construct validity. Several interpret construct validity excessively by including threats to internal, external, or statistical conclusion validity. A few articles also include fundamental challenges of a study, such as cheating and misunderstandings of experiment material. The diversity of topics discussed makes us recommend a minimalist approach to construct validity. We propose seven guidelines to establish a common ground for addressing construct validity in software engineering.

scholarly journals Determining the psychometric properties of a novel questionnaire to measure “preparedness for the future” (Prep FQ)

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Daren K. Heyland ◽  
J. Paige Pope ◽  
Xuran Jiang ◽  
Andrew G. Day
Keyword(s):  
Quality Of Life ◽  
Construct Validity ◽  
Health Behaviors ◽  
Psychometric Properties ◽  
Well Being ◽  
High Quality ◽  
The Future ◽  
Quality Of Death ◽  
Test Retest Reliability

Abstract Background People are living longer than ever before. However, with living longer comes increased problems that negatively impact on quality of life and the quality of death. Tools are needed to help individuals assess whether they are practicing the best attitudes and behaviors that are associated with a future long life, high quality of life, high quality of death and a satisfying post-death legacy. The purpose of paper is to describe the process we used to develop a novel questionnaire (“Preparedness for the Future Questionnaire™ or Prep FQ”) and to define its psychometric properties. Methods Using a multi-step development procedure, items were generated, for the new questionnaire after which the psychometric properties were tested with a heterogeneous sample of 502 Canadians. Using an online polling panel, respondents were asked to complete demographic questions as well as the Prep-FQ, Global Rating of Life Satisfaction, the Keyes Psychological Well-Being scale and the Short-Form 12. Results The final version of the questionnaire contains 34 items in 8 distinct domains (“Medico-legal”, “Social”, “Psychological Well-being”, “Planning”, “Enrichment”, “Positive Health Behaviors”, “Negative Health Behaviors”, and “Late-life Planning”). We observed minimum missing data and good usage of all response options. The average overall Prep FQ score is 51.2 (SD = 13.3). The Cronbach alphas assessing internal reliability for the Prep FQ domains ranged from 0.33 to 0.88. The intra-class correlation coefficient (ICC) used to assess the test–retest reliability had an overall score of 0.87. For the purposes of establishing construct validity, all the pre-specified relationships between Prep FQ and the other questionnaires were met. Conclusion Analyses of this novel measure offered support for its face validity, construct validity, test–retest reliability, and internal consistency. With the development of this useful and valid scale, future research can utilize this measure to engage people in the process of comprehensively assessing and improving their state of preparedness for the future, tracking their progress along the way. Ultimately, this program of research aims to improve the quality and quantity of peoples live by helping them ‘think ahead’ and ‘plan ahead’ on the aspects of their daily life that matter to their future.

scholarly journals Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them

2019 ◽  
Author(s):  
Jessica Kay Flake ◽  
Eiko I Fried
Keyword(s):  
Construct Validity ◽  
Degrees Of Freedom ◽  
Scientific Research ◽  
Replication Studies ◽  
Psychological Science ◽  
Rigorous Research ◽  
Statistical Conclusion ◽  
Measurement Practices

In this paper, we define questionable measurement practices (QMPs) as decisions researchers make that raise doubts about the validity of the measures, and ultimately the validity of study conclusions. Doubts arise for a host of reasons including a lack of transparency, ignorance, negligence, or misrepresentation of the evidence. We describe the scope of the problem and focus on how transparency is a part of the solution. A lack of measurement transparency makes it impossible to evaluate potential threats to internal, external, statistical conclusion, and construct validity. We demonstrate that psychology is plagued by a measurement schmeasurement attitude: QMPs are common, hide a stunning source of researcher degrees of freedom, pose a serious threat to cumulative psychological science, but are largely ignored. We address these challenges by providing a set of questions that researchers and consumers of scientific research can consider to identify and avoid QMPs. Transparent answers to these measurement questions promote rigorous research, allow for thorough evaluations of a study’s inferences, and are necessary for meaningful replication studies.

scholarly journals Extragalactic Supergiants

2016 ◽  
Vol 12 (S329) ◽  
pp. 297-304
Author(s):  
Miguel A. Urbaneja ◽  
Rolf P. Kudritzki
Keyword(s):  
Quantitative Analysis ◽  
Chemical Composition ◽  
Optical Spectra ◽  
Host Galaxies ◽  
High Quality ◽  
Distant Galaxies ◽  
Wide Range

AbstractBlue supergiant stars of B and A spectral types are amongst the visually brightest non-transient astronomical objects. Their intrinsic brightness makes it possible to obtain high quality optical spectra of these objects in distant galaxies, enabling the study not only of these stars in different environments, but also to use them as tools to probe their host galaxies. Quantitative analysis of their optical spectra provide tight constraints on their evolution in a wide range of metallicities, as well as on the present-day chemical composition, extinction laws and distances to their host galaxies. We review in this contribution recent results in this field.

Integrating Multi-View Model and Agent Paradigm in the Supply Chain Design

2016 ◽  
pp. 155-177
Author(s):  
Souheila Boudouda ◽  
Mahmoud Boufaida
Keyword(s):  
Supply Chain ◽  
Supply Chains ◽  
Conceptual Model ◽  
Methodological Approach ◽  
Supply Chain Design ◽  
Conceptual Level ◽  
Meta Model ◽  
Negotiation Protocol ◽  
Operational Level ◽  
Different Characteristics

The aim of the presented work is to contribute to the field of the supply chain design that spans multiple organizations. It is based on a methodological approach that outlines two main results: a conceptual model and an operational one. These two models take into account the different characteristics and mechanisms of the supply chain. The conceptual level is based on four views: product, organizational, functional and informational. At this level, a meta-model that contains the basic generic concepts of the supply chain is proposed. The operational level uses the agent paradigm to model the different actors of the supply chain and the relationships between them. According to the characteristics of supply chains, a negotiation protocol between the different agents is presented. Simulations prove that the presented negotiation protocol can increase the efficiency and successful cooperation ratio for supply chain negotiation.

Integrating Multi-View Model and Agent Paradigm in the Supply Chain Design

2015 ◽  
Vol 7 (1) ◽  
pp. 32-54
Author(s):  
Souheila Boudouda ◽  
Mahmoud Boufaida
Keyword(s):  
Supply Chain ◽  
Supply Chains ◽  
Conceptual Model ◽  
Methodological Approach ◽  
Supply Chain Design ◽  
Conceptual Level ◽  
Meta Model ◽  
Negotiation Protocol ◽  
Operational Level ◽  
Different Characteristics

The aim of the presented work is to contribute to the field of the supply chain design that spans multiple organizations. It is based on a methodological approach that outlines two main results: a conceptual model and an operational one. These two models take into account the different characteristics and mechanisms of the supply chain. The conceptual level is based on four views: product, organizational, functional and informational. At this level, a meta-model that contains the basic generic concepts of the supply chain is proposed. The operational level uses the agent paradigm to model the different actors of the supply chain and the relationships between them. According to the characteristics of supply chains, a negotiation protocol between the different agents is presented. Simulations prove that the presented negotiation protocol can increase the efficiency and successful cooperation ratio for supply chain negotiation.

scholarly journals Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them

2020 ◽  
Vol 3 (4) ◽  
pp. 456-465
Author(s):  
Jessica Kay Flake ◽  
Eiko I. Fried
Keyword(s):  
Construct Validity ◽  
Degrees Of Freedom ◽  
Scientific Research ◽  
Replication Studies ◽  
Psychological Science ◽  
Rigorous Research ◽  
Statistical Conclusion ◽  
Measurement Practices

In this article, we define questionable measurement practices (QMPs) as decisions researchers make that raise doubts about the validity of the measures, and ultimately the validity of study conclusions. Doubts arise for a host of reasons, including a lack of transparency, ignorance, negligence, or misrepresentation of the evidence. We describe the scope of the problem and focus on how transparency is a part of the solution. A lack of measurement transparency makes it impossible to evaluate potential threats to internal, external, statistical-conclusion, and construct validity. We demonstrate that psychology is plagued by a measurement schmeasurement attitude: QMPs are common, hide a stunning source of researcher degrees of freedom, and pose a serious threat to cumulative psychological science, but are largely ignored. We address these challenges by providing a set of questions that researchers and consumers of scientific research can consider to identify and avoid QMPs. Transparent answers to these measurement questions promote rigorous research, allow for thorough evaluations of a study’s inferences, and are necessary for meaningful replication studies.

Research on Task Allocation Model of Materiel Readiness Rate and the Talented Person Growing Law

2013 ◽  
Vol 401-403 ◽  
pp. 2213-2216
Author(s):  
Bing Chen ◽  
Xiao Dong Zhu ◽  
Yi Gang Wang ◽  
Fei Ye
Keyword(s):  
Quantitative Analysis ◽  
Task Allocation ◽  
Armed Forces ◽  
Allocation Problem ◽  
Equipment Maintenance ◽  
Analysis Method ◽  
High Quality ◽  
Allocation Model ◽  
Quantitative Analysis Method ◽  
System Maintenance

The army's existing preparation system, maintenance task allocation problem is missing quantitative analysis method, Research on Materiel readiness rate and the talented person growing law of task allocation model, This method has guiding significance for the Army equipment maintenance tasks assigned, At the same time which has important effect on improving the combat effectiveness of our armed forces and cultivate high-quality constructive. finally, test the feasibility of the method with examples.

Sign in / Sign up

Export Citation Format

Share Document