scholarly journals Testing ActiveYou II: Applying Cognitive Interviews in Improving Item Quality and Applicability of a Web-Based, Self-Report Instrument on Participation in Children with Disabilities

2021 ◽  
Vol 18 (9) ◽  
pp. 4768
Author(s):  
Friedolin Steinhardt ◽  
Reidun Jahnsen ◽  
Anne-Stine Dolva ◽  
Anna Ullenhag
Keyword(s):  
Development Process ◽  
Children With Disabilities ◽  
Leisure Activities ◽  
Psychometric Testing ◽  
Self Report ◽  
Cognitive Interviews ◽  
Web Based ◽  
Item Quality ◽  
Response Alternatives

Background: Children and youth with disabilities participate less in leisure activities than their nondisabled peers. Increasing participation is a primary goal of rehabilitation interventions. However, valid measures that include the individual’s perspectives and facilitating and hindering factors for participation are lacking in the Norwegian setting. In this study, ActiveYou II, a self-report, web-based instrument under development, was tested to obtain item quality and applicability. Methods: Nine children with disabilities participated in cognitive interviews, testing a first set of ActiveYou II items. The verbal probe method for cognitive interviews was applied. Results: The children’s comprehension and responses through cognitive interviews improved the applicability and item quality of ActiveYou II. Item adjustments were made to the wording of the questions and response alternatives, and the number of response alternatives were decreased where appropriate. Conclusions: The use of cognitive interviews with children before performing further psychometric testing has been very useful in the development process of ActiveYou II. Adjustments of the questions and response alternatives were made accordingly.

scholarly journals La influencia de la memoria operativa y de la inteligencia emocional en la expresión de la emoción en español como segunda lengua

2019 ◽  
Vol 14 (1) ◽  
pp. 117 ◽  
Author(s):  
Irini Mavrou ◽  
Fernando Bustos-López
Keyword(s):  
Working Memory ◽  
Emotional Intelligence ◽  
Working Memory Capacity ◽  
Self Report ◽  
Written Expression ◽  
Web Based ◽  
Emotional Words ◽  
Global Quality ◽  
Report Measure

<p>The current study intended to examine the influence of working memory capacity and emotional intelligence on emotional expression in Spanish as a second language (SSL). Forty-one learners of SSL (A2 and B1 levels) carried out a writing task about an emotional topic. The global quality of their texts was assessed by means of an analytical scale, and the web-based search engine emoFinder was used in order to measure the number and valence of emotional words produced by the participants. Moreover, participants completed a self-report measure of emotional intelligence and performed three working memory tasks. The results showed an influence of emotional intelligence on written expression in SSL, a positive correlation between the quality of written expression and the number of emotional words, as well as a greater use of positive words compared to the negative ones.</p>

Human Factors and the Systems Development Process

2003 ◽  
pp. 203-222 ◽  
Author(s):  
Julia Fisher
Keyword(s):  
Information System ◽  
Human Factors ◽  
Development Process ◽  
Systems Development ◽  
User Needs ◽  
Web Based ◽  
Development Team ◽  
Development Teams

Internet systems have the potential to reach a huge and unknown audience. How easy a system is to use will usually determine its success or failure and consequently the business and yet the human factors elements of systems are rarely considered. Usability describes the ease with which people can use a system to complete a task. It is often the case however that development teams focus more on the technology and less on the users when designing systems resulting in software that is not useable and therefore does not satisfy users’ need. This chapter presents recent research, which examines one approach to developing a web-based information system and demonstrates how the composition of the development team through the inclusion of people with an understanding of user needs is important to the quality of the final product and ultimately the success of the system.

scholarly journals Identifying and Addressing Sources of Measurement Error in the Norbeck Social Support Questionnaire

2014 ◽  
Vol 22 (3) ◽  
pp. 61E-76E
Author(s):  
Eileen Gigliotti ◽  
William Ellery Samuels ◽  
June Como ◽  
Tofiga Gamidova ◽  
Brian Gordon ◽  
...  
Keyword(s):  
Social Support ◽  
Measurement Error ◽  
Quantitative Research ◽  
Psychometric Testing ◽  
Size Composition ◽  
Network Size ◽  
Cognitive Interviews ◽  
Response Option ◽  
Quantitative Evidence

Background and Purpose: The Norbeck Social Support Questionnaire (NSSQ) provides a rich portrait of one's perceived social support including network size/composition and quality of support. Analyses of quantitative research reports and critiques of the NSSQ revealed non-negligible measurement error. We document evidence of measurement error, report potential sources of this error, and present forthcoming psychometric testing. Methods: Quantitative evidence of measurement error from the NSSQ literature provided the basis for initial hypotheses concerning sources of error in network nomination and support ratings. We then conducted cognitive interviews to investigate these hypotheses. Results: Cognitive interviews revealed evidence of respondents' miscomprehension and response option bias. Conclusions: The current nomination process coupled with the lack of a “not applicable” response option and embedded examples in tangible Aid items reduces the accuracy of NSSQ subscores.

scholarly journals Development and Testing of an Instrument to Measure Contextual Factors Influencing Self-Care Decisions Among Adults with Chronic Illness

2021 ◽  
Author(s):  
Shayleigh Dickson Page ◽  
Christopher Lee ◽  
Subhash Aryal ◽  
Kenneth Freedland ◽  
Anna Stromberg ◽  
...  
Keyword(s):  
Decision Making ◽  
Chronic Illness ◽  
Content Validity ◽  
Contextual Factors ◽  
Self Care ◽  
Psychometric Testing ◽  
The Self ◽  
Self Report ◽  
Cognitive Interviews ◽  
Naturalistic Decision Making

Abstract Background: Adults with chronic illness frequently experience bothersome symptoms (e.g., pain). Decisions about how to manage these symptoms are complex and influenced by factors related to the patient, their illness, and their environment. The naturalistic decision-making framework describes decision-making when conditions are dynamically evolving, and the decision maker is uncertain because the situation is ambiguous and missing information. The contextual factors influencing decisions include time stress, the perception of high stakes, and input from other individuals, which may facilitate or complicate the decision about the self-care of symptoms. There is no valid instrument to measure these contextual factors. The purpose of this study was to develop and test a self-report instrument measuring the contextual factors that influence self-care decisions about symptoms. Methods: Items were drafted from the literature and refined with patient input. Content validity of the instrument was evaluated using a Delphi survey of expert clinicians and researchers, and cognitive interviews with adults with chronic illness. Psychometric testing included exploratory factor analysis to test dimensionality, item response theory-based approaches for item recalibration, confirmatory factor analysis to generate factor determinacy scores, and evaluation of construct validity. Results: The content validity of the Self-Care Decisions Scale is excellent with all items achieving a content validity index of greater than 0.78 in the Delphi survey of experts (n=12). Adults with chronic illness (n=5) endorsed the relevance, comprehensiveness, and comprehensibility of the instrument during cognitive interviews. Initial psychometric testing (n=431) revealed a 6-factor multidimensional structure that was further refined for precision, and high multidimensional reliability. In construct validity testing, there were modest associations with some scales of the Melbourne Decision Making Questionnaire and the Self-Care of Chronic Illness Inventory. Conclusion: The Self-Care Decisions Scale is a 27-item self-report instrument that measures the extent to which contextual factors influence decisions about symptoms of chronic illness with six scales reflecting naturalistic decision making (external, urgency, uncertainty, cognitive/affective, waiting/cue competition, and concealment). The scale can support research that aims to better understand how adults with chronic illness make decisions in response to symptoms. Additional testing of the instrument is needed to evaluate clinical utility.

scholarly journals FAMILY AND MOTHER LEISURE OF CHILDREN WITH DISABILITY

2021 ◽  
Vol 4 (1) ◽  
pp. 4-12
Author(s):  
Magdalena Perić Bralo
Keyword(s):  
Children With Disabilities ◽  
Time Pressure ◽  
Leisure Activities ◽  
Well Being ◽  
Family Activities ◽  
Children With Disability ◽  
Family Leisure ◽  
Great Stress ◽  
Happy Time

Leisure is often associate with quality of life of an individual. Objective leisure definitions are used by economic, business and recreational researchers, and focused on behaviors that we can observe. Subjective definitions are more concerned with scientists who are focused on the microsphere of an individual. Modern families are under great stress and that through different family activities the reduction of stress can be achieved and also increase feel of family well-being. Family leisure is considered as very important component of family life. It often shows as idealized, constantly happy time in which everyone enjoys together, time that is pleasure for all family members as individuals and also for the whole family.During family leisure mothers usually have mixed roles of caring for children and caring for the household, thus disrupting their sense of freedom and enjoyment. Many roles that parents of children with disabilities need to take over creates a time pressure that does not occur to parents of children without disabilities. That time pressure is reflected on psychological and physical health of the parents, affecting simultaneously the lack of time for different activities such as going to work, leisure activities, personal care and social interactions. Research has shown that mothers of children with disabilities generally have much less time for themselves and family activities than when it comes to mothers of children without disabilities, no matter what type and level of disability is about. Key words: leisure, family, mothers of children with disabilities

scholarly journals RANCANG BANGUN SISTEM INFORMASI PENEMPATAN AREA KERJA CLEANING SERVICE UNTUK MENINGKATKAN PELAYANAN BANDARA

2019 ◽  
Vol 5 (2) ◽  
pp. 177-188
Author(s):  
Euis Sitinur Aisyah ◽  
Bayu Pramono ◽  
Haris Munandar
Keyword(s):  
Information System ◽  
Programming Language ◽  
Analytical Method ◽  
Development Process ◽  
System Development ◽  
Service Work ◽  
Quality Of Services ◽  
Web Based ◽  
Master Data

The airport is one of the entry gates of a country, in the airport there are many work divisions that support and facilitate all existing activities, one of which is a cleaning service that has a large enough function that is to improve cleanliness and comfort in the airport area, cleaning services that exist when This is managed by the company and works with companies that focus on cleaning service in each terminal. The placement of the cleaning service area is still manual and takes a lot of time and involves several parts in the process, and inhibits in terms of time in the process of cleaning the area at the airport so that it can reduce the quality of services that have an inconvenience, to overcome the problem. which is currently running to find out the components of the problem that exist. The results to be achieved in this study is the application of a system that facilitates the process, namely by making an information system placement of web-based cleaning service work areas that is used as a reference in the system development process later. The analytical method used in this study uses the PIECES method, to assist in the process of analyzing the system that has been running. The Programming Language used in building this system uses PHP, MySQL as a database to store master data, transactions and users.

scholarly journals Classifying and Characterizing the Development of Self-Reported Quality of Life Among the Chinese Elderly: A Twelve-Year Longitudinal Study

2021 ◽  
Author(s):  
Xitong Huang ◽  
Minqiang Zhang ◽  
Junyan Fang ◽  
Qing Zeng ◽  
Jinqing Wang ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Healthy Aging ◽  
Leisure Activities ◽  
Influential Factors ◽  
Self Report ◽  
Growth Mixture Model ◽  
Chinese Elderly ◽  
Development Patterns ◽  
Healthy Longevity

Abstract Background To promote healthy aging, the information about the development of quality of life (QoL) is of great importance for health researchers and policymakers. Up to now, the longitudinal explorations of the heterogeneity in the change of QoL under the Chinese context were largely limited. The current study aimed to identify potential different development patterns of QoL and the influential factors using a large, longitudinal, and nationally representative sample of the Chinese elderly. Methods We adopted a five-wave longitudinal dataset from the Chinese Longitudinal Healthy Longevity Survey (CLHLS), and a total of 1,645 elderly aged 65 and over were obtained. QoL was measured using a self-report item during the longitudinal process. We utilized the conditional growth mixture model (GMM) with time-invariant covariates to explore various development patterns and associated factors. Results Three subgroups with distinct trajectories of self-reported QoL were identified: the High-level Steady Group (17.08%), the Mid-level Steady Group (63.10%), and the Low-level Growth Group (19.82%). Results also indicated that several factors predicted distinct trajectories of self-reported QoL. Those elderly who received enough financial resources, had adequate nutrition, did not exhibit any disability, engaged in leisure activities, and did less physical labor or housework at the baseline were more likely to report a higher level of QoL over time. Conclusions There existed three development patterns of self-reported QoL among the Chinese elderly, and these subgroups differed in several baseline factors. These findings provided valuable implications for the maintenance and improvement of QoL among the Chinese elderly.

scholarly journals EXAMINING THE QUALITY OF ENGLISH TEST ITEMS USING PSYCHOMETRIC AND LINGUISTIC CHARACTERISTICS AMONG GRADE SIX PUPILS

2020 ◽  
Vol 17 (Number 2) ◽  
pp. 63-101
Author(s):  
S. Kanageswari Suppiah Shanmugam ◽  
Vincent Wong ◽  
Murugan Rajoo
Keyword(s):  
Item Difficulty ◽  
Classroom Teacher ◽  
Item Analysis ◽  
Classical Test Theory ◽  
Test Theory ◽  
Psychometric Analysis ◽  
Cognitive Interviews ◽  
Test Items ◽  
Item Quality

Purpose - This study examined the quality of English test items using psychometric and linguistic characteristics among Grade Six pupils. Method - Contrary to the conventional approach of relying only on statistics when investigating item quality, this study adopted a mixed-method approach by employing psychometric analysis and cognitive interviews. The former was conducted on 30 Grade Six pupils, with each item representing a different construct commonly found in English test papers. Qualitative input was obtained through cognitive interviews with five Grade Six pupils and expert judgements from three teachers. Findings - None of the items were found to be too easy or difficult, and all items had positive discrimination indices. The item on idioms was most ideal in terms of difficulty and discrimination. Difficult items were found to be vocabulary-based. Surprisingly, the higher-order-thinking subjective items proved to be excellent in difficulty, although improvements could be made on their ability to discriminate. The qualitative expert judgements agreed with the quantitative psychometric analysis. Certain results from the item analysis, however, contradicted past findings that items with the ideal item difficulty value between 0.4 and 0.6 would have equally ideal item discrimination index. Significance -The findings of the study can serve as a reminder on the significance of using Classical Test Theory, a non-complex psychometric approach in assisting classroom teacher practitioners during the meticulous process of test design and ensuring test item quality.

scholarly journals Development of a brief, generic, modular resource-use measure (ModRUM): cognitive interviews with patients

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Kirsty Garfield ◽  
Samantha Husbands ◽  
Joanna C. Thorn ◽  
Sian Noble ◽  
Will Hollingworth
Keyword(s):  
Resource Use ◽  
Content Validity ◽  
Psychometric Testing ◽  
Sampling Strategy ◽  
Self Report ◽  
Cognitive Interviews ◽  
Healthcare Use ◽  
Missing Responses ◽  
The Core ◽  
Core Module

Abstract Background Self-report resource-use measures (RUMs) are often used to collect healthcare use data from participants in healthcare studies. However, RUMs are typically adapted from existing measures on a study-by-study basis, resulting in a lack of standardisation which limits comparability across studies. Psychometric testing of RUMs is rarely conducted. This paper reports on cognitive interviews with patients to test the content validity and acceptability of a new RUM (ModRUM). ModRUM is a brief, generic RUM with a core module on healthcare use and questions/modules to increase depth and breadth. Methods A purposeful sampling strategy with maximum variation was used to recruit patients from primary care to participate in “think-aloud” interviews with retrospective probing. Participants verbalised their thought processes as they completed ModRUM, which allowed errors (issues with completion) to be identified. The interviewer asked follow-up and probing questions to investigate errors, clarity and acceptability. Interviews were audio-recorded and transcribed verbatim. Research team members independently scored transcripts to identify errors in comprehension, recall, judgement and response. Members met to agree on final scores. Interview transcripts were analysed qualitatively using techniques of constant comparison, to identify common themes and ideas for improvement. Data collection and analysis were performed concurrently and in rounds. Results Twenty participants were interviewed between December 2019 and March 2020. Interviews were conducted in three rounds, with revisions made iteratively and in response to interview findings. Seven participants completed the core module and 13 completed the core module plus depth questions. Of 71 issues, 28 were in comprehension, 14 in retrieval, 10 in judgement, 18 in response and 1 uncategorised. Most issues (21 issues by 2 participants) were due to participants including family healthcare use. Other issues included using incorrect recall periods (5 issues) and overlooking questions leading to missing responses (9 issues). Common participant suggestions included highlighting important details and providing additional definition or examples for some terms. The length, content and layout were acceptable to most participants. Conclusions A generic RUM is needed to increase study comparability. RUM development requires thorough testing to demonstrate and enhance validity. Cognitive interviewing has demonstrated the acceptability and content validity of ModRUM.

The Effect of Alternative Scoring Procedures on the Measurement Properties of a Self-Administered Depression Scale

2019 ◽  
Vol 35 (1) ◽  
pp. 55-62 ◽  
Author(s):  
Noboru Iwata ◽  
Akizumi Tsutsumi ◽  
Takafumi Wakita ◽  
Ryuichi Kumagai ◽  
Hiroyuki Noguchi ◽  
...  
Keyword(s):  
Classical Test Theory ◽  
Depression Scale ◽  
Psychometric Testing ◽  
Epidemiologic Studies ◽  
Test Theory ◽  
Measurement Properties ◽  
Irt Model ◽  
Response Alternatives ◽  
Polytomous Item Response ◽  
Θ Point

Abstract. To investigate the effect of response alternatives/scoring procedures on the measurement properties of the Center for Epidemiologic Studies Depression Scale (CES-D) which has the four response alternatives, a polytomous item response theory (IRT) model was applied to the responses of 2,061 workers and university students (1,640 males, 421 females). Test information functions derived from the polytomous IRT analyses on the CES-D data with various scoring procedures indicated that: (1) the CES-D with its standard (0-1-2-3) scoring procedure should be useful for screening to detect subjects with “at high-risk” of depression if the θ point showing the highest information corresponds to the cut-off point, because of its extremely higher information; (2) the CES-D with the 0-1-1-2 scoring procedure could cover wider range of depressive severity, suggesting that this scoring procedure might be useful in cases where more exhaustive discrimination in symptomatology is of interest; and (3) the revised version of CES-D with replacing original positive items into negatively revised items outperformed the original version. These findings have never been demonstrated by the classical test theory analyses, and thus the utility of this kind of psychometric testing should be warranted to further investigation for the standard measures of psychological assessment.

Sign in / Sign up

Export Citation Format

Share Document