scholarly journals Towards a Network Psychometrics Approach to Assessment: Simulations for Redundancy, Dimensionality, and Loadings

Author(s):  
Alexander P. Christensen

Research using network models in psychology has proliferated over the last decade. The popularity of network models has largely been driven by their alternative explanation for the emergence of psychological attributes—observed variables co-occur because they are causally coupled and dynamically reinforce each other, forming cohesive systems. Despite their rise in popularity, the growth of network models as a psychometric tool has remained relatively stagnant, mainly being used as a novel measurement perspective. In this dissertation, the goal is to expand the role of network models in modern psychometrics and to move towards using these models as a tool for the validation of assessment instruments. This paper presents three simulation studies and an empirical example that are designed to evaluate different aspects of the psychometric network approach to assessment: reducing redundancy, detecting dimensions, and estimating loadings. The first simulation evaluated two novel approaches for determining whether items are redundant, which is a key component for the accuracy and interpretation of network measures. The second simulation evaluated several different community detection algorithms, which are designed to detect dimensions in networks. The third simulation evaluated an adapted formulation of the network measure, node strength, and how it compares to factor loadings estimated by exploratory and confirmatory factor analysis. The results of the simulations demonstrate that network models can be used as an effective psychometric tool and one that is on par with more traditional methods. Finally, in the empirical example, the methods from the simulations are applied to a real-world dataset measuring personality. This example demonstrated that these methods are not only effective, but they can validate whether an assessment instrument is consistent with theoretical and empirical expectations. With these methods in hand, network models are poised to take the next step towards becoming a robust psychometric tool.

2020 ◽  
Author(s):  
Alexander P. Christensen

Research using network models in psychology has proliferated over the last decade. The popularity of network models has largely been driven by their alternative explanation for the emergence of psychological attributes—observed variables co-occur because they are causally coupled and dynamically reinforce each other, forming cohesive systems. Despite their rise in popularity, the growth of network models as a psychometric tool has remained relatively stagnant, mainly being used as a novel measurement perspective. In this dissertation, the goal is to expand the role of network models in modern psychometrics and to move towards using these models as a tool for the validation of assessment instruments. This paper presents three simulation studies and an empirical example that are designed to evaluate different aspects of the psychometric network approach to assessment: reducing redundancy, detecting dimensions, and estimating loadings. The first simulation evaluated two novel approaches for determining whether items are redundant, which is a key component for the accuracy and interpretation of network measures. The second simulation evaluated several different community detection algorithms, which are designed to detect dimensions in networks. The third simulation evaluated an adapted formulation of the network measure, node strength, and how it compares to factor loadings estimated by exploratory and confirmatory factor analysis. The results of the simulations demonstrate that network models can be used as an effective psychometric tool and one that is on par with more traditional methods. Finally, in the empirical example, the methods from the simulations are applied to a real-world dataset measuring personality. This example demonstrated that these methods are not only effective, but they can validate whether an assessment instrument is consistent with theoretical and empirical expectations. With these methods in hand, network models are poised to take the next step towards becoming a robust psychometric tool.


2015 ◽  
Vol 31 (3) ◽  
pp. 1030 ◽  
Author(s):  
Carmen Moret-Tatay ◽  
Juan J. Fernández-Muñoz ◽  
Cristina Civera-Mollá ◽  
Esperanza Navarro-Pardo ◽  
Carlos Alcover-de-la-Hera

Successful resilience is a variable often related toan optimal aging process. However, literature is rather limited when dealingwith assessment instruments for the elderly in the Spanish language. Theobjective of this work is to validate the Brief Resilient Coping Scale(Sinclair & Wallston, 2004), a four item likert scale, in the Spanishelderly.  For this propose, the scale wasadministrated to a sample of 991 elderly Spanish participants, and the data setanalysed in terms of exploratory and confirmatory factor analysis, internalconsistency and criterion validity. The scale demonstrated good psychometricproperties.  Furthermore, the homogeneityindices were higher than the recently literature, reinforcing the dimensionalstructure of the scale.  These resultshave shown higher reliability from previous Spanish versions. Therefore, theBrief Resilient Coping Scale is a valuable assessment instrument that could bevery useful in the assessing of resilience in the Spanish-speaking elderly.


Methodology ◽  
2016 ◽  
Vol 12 (3) ◽  
pp. 97-106 ◽  
Author(s):  
Davide Massidda ◽  
Mauro Giovanni Carta ◽  
Gianmarco Altoè

Abstract. Evaluating the factorial structure of a psychometric test is crucial to capture the complexity of a psychological phenomenon. Indeed, for the same test, several studies may find different factorial solutions which, in turn, may be explained by within and/or between sample variability. In this paper we introduce a novel quantitative approach to combine different factorial solutions of the same test. We propose to use a method based on Social Network Analysis to create and statistically evaluate an integrated factorial structure based on the information provided by previous researches. We present an application to the Mood Disorder Questionnaire by considering different factorial structures reported in the literature. The integrated factorial solution indicates the presence of three factors supporting the multidimensionality of the test. The role of single items in the composition of factors is also evaluated and discussed in terms of differences and similarities between the five original studies and the new integrated model. From an applied perspective, our approach may be useful to assist researchers in summarizing different factorial solutions for the same test efficiently. Furthermore, the resulting integrated factor solution could serve as baseline model to validate the structure of the test by applying confirmatory factor techniques to new data.


2005 ◽  
Vol 86 (2) ◽  
pp. 287-296 ◽  
Author(s):  
David R. Hodge

Increasing recognition exists for the vital role of spirituality in the lives of many clients, yet relatively few assessment instruments have been developed. This article presents a new assessment instrument—the spiritual ecogram—that taps information in space and across time. In addition to combining the assessment strengths of spiritual ecomaps and genograms in a single diagrammatic instrument, ecograms depict the connections between past and present functioning. Historical influences on current systems can be seen as well as current relationships to historical influences. This article also includes a case example, information on conducting a spiritually competent assessment, and a discussion of some spiritual interventions that flow from ecograms.


1977 ◽  
Vol 43 (8) ◽  
pp. 490-499 ◽  
Author(s):  
Charles R. Greenwood ◽  
Hill M. Walker ◽  
Hyman Hops

The purpose of this article is to review severel practical and methodological issues related to the development of assessment instruments for child social interaction and social withdrawal. Specifically, the roles of (a) sociometric peer ratings, (b) behavioral observation measures, and (c) teacher ratings are discussed in relationship to their validity, reliability, and normative data characteristics. These measures are further discussed from the perspective of their usage in screening/identification and treatment evaluation. The role of normative data in facilitating screening/identification and treatment evaluation processes is also reviewed. Finally, the development of a social interaction assessment instrument for identifying socially withdrawn children is described.


2019 ◽  
Vol 118 (1) ◽  
pp. 57-64
Author(s):  
G. Aiswarya ◽  
Dr. Jayasree Krishnan

Traditionally the products were pushed into the hands of customers by production and selling strategies; then the marketing strategy evolved which gained momentum by understanding the customer needs and developing products satisfying those needs. This strategy is most prevalent and what should be done to stand up in this most competitive scenario? The answer to this key question is to create an experience. The customers now also seek good experiences than other benefits. Brand experience has gained more attention, especially fashion brands. Previous studies demonstrate the role of the brand experience in brand equity and other consumer behavior constructs. But very little is known about the impact of brand experiences on fashion brands. The aim of this study is to develop a model which makes our understanding better about the role of Brand preference and Brand experience and its influence on purchase intention of the brand. An initial exploratory study is conducted using a focus group to generate items for the study. The items, thus generated are prepared in the form of a questionnaire and samples were collected.  Exploratory factor analysis is conducted and the reliability of the constructs is determined. These constructs are loaded onto AMOS to perform Confirmatory factor analysis. The results confirmed the scales used. We also noticed that Brand preference has a great influence on the Brand experience. Thereby the finding supports the role of the brand experience which tends to have a mediating role in influencing the purchase intention.


Author(s):  
Dewi Febrianty ◽  
Risnita Risnita ◽  
Afreni Hamidah

Practical performance assessment is an important part of the learning process, but several obstacles are found in its implementation. The objectives of this study are (1) to develop constructivism-based performance assessment instruments for class VII Yunior High School in  Life Organization subject,  (2) to describe aspects that need to be made in constructivism-based practical performance assessment instruments, and (3) to describe teacher responses in using constructivism-based practical performance assessment instruments. This research is a development research using a 4D model, the stages are defining, design, development and distribution. The trial subjects in this study consisted of 10 students for small group trials and 40 students for large group trials. The indicators used in the study include aspects related to the development of constructivist life-based practicum assessment instruments. Instrument used was a questionnaire to reveal the response of teachers and students to practical performance assessment instruments. The results of the data analysis showed that the content feasibility value is 86.31% at the intervals of 48.33 which means it is feasible to use. Most students gave a positive response to the assessment sheet given (96.67%), a small portion gave a negative response (33.3%). Because the average positive response of students is more than 75%, the performance assessment instrument is considered feasible to be applied.


2021 ◽  
Vol 1 ◽  
pp. 1755-1764
Author(s):  
Rongyan Zhou ◽  
Julie Stal-Le Cardinal

Abstract Industry 4.0 is a great opportunity and a tremendous challenge for every role of society. Our study combines complex network and qualitative methods to analyze the Industry 4.0 macroeconomic issues and global supply chain, which enriches the qualitative analysis and machine learning in macroscopic and strategic research. Unsupervised complex graph network models are used to explore how industry 4.0 reshapes the world. Based on the in-degree and out-degree of the weighted and unweighted edges of each node, combined with the grouping results based on unsupervised learning, our study shows that the cooperation groups of Industry 4.0 are different from the previous traditional alliances. Macroeconomics issues also are studied. Finally, strong cohesive groups and recommendations for businessmen and policymakers are proposed.


2021 ◽  
Vol 54 (3) ◽  
pp. 1-35
Author(s):  
Matteo Magnani ◽  
Obaida Hanteer ◽  
Roberto Interdonato ◽  
Luca Rossi ◽  
Andrea Tagarelli

A multiplex network models different modes of interaction among same-type entities. In this article, we provide a taxonomy of community detection algorithms in multiplex networks. We characterize the different algorithms based on various properties and we discuss the type of communities detected by each method. We then provide an extensive experimental evaluation of the reviewed methods to answer three main questions: to what extent the evaluated methods are able to detect ground-truth communities, to what extent different methods produce similar community structures, and to what extent the evaluated methods are scalable. One goal of this survey is to help scholars and practitioners to choose the right methods for the data and the task at hand, while also emphasizing when such choice is problematic.


2020 ◽  
Vol 30 (Supplement_5) ◽  
Author(s):  
T Krieger

Abstract From the literature and experience, we know that the quality of patient information material (PIM) has a direct impact on its utilization and therefore also on the acceptance and success of an intervention. In this brief introduction session (10 minutes), the innovative “integrated, cross-sectional psycho-oncology” (isPO) programme and the context of its implementation will be sketched. In the programmés development phase, isPO specific-PIM was developed and utilized in its early implementation phase. This will be presented to the audience. Next, an overview regarding the general PIM quality criteria: correctness of content, legibility, comprehensibility and usability in detail will be given. Finally, common guidelines, checklists and quality assessment instruments will be presented, and the role of the target group (participation degree) in the development or examination process will be critically worked out.


Sign in / Sign up

Export Citation Format

Share Document