Toward a more critical dialogue for enhancing self-report surveys in sport expertise and deliberate practice research

Author(s):  
Rafael A.B. Tedesqui ◽  
Lindsay McCardle ◽  
Dora Bartulovic ◽  
Bradley W. Young

Two hallmark criteria are commonly used to determine whether a variable of interest has an impact on sport expertise development: (a) discrimination of performance or skill levels and (b) association with time spent in deliberate practice activities. Our opinion is that there has been warranted criticism of the deliberate practice framework and greater methodological rigour will invigorate survey research in this area. In this paper, we aimed to provide critical perspectives on self-report methods previously used to assess group discrimination and to measure deliberate practice in survey-based work in the context of sport expertise as well as to illustrate steps that could be taken to improve confidence in the validity and reliability of these measures. First, we focus on challenges discriminating between multiple, progressively skilled groups of athletes and outline two strategies: one aimed at improving the validity of skill grouping using standardized performance measures, and another illustrating how researchers can assess variability within skill levels. Second, we highlight challenges in measuring deliberate practice activities and propose a funnel method of narrowing athletes’ estimates from general sport activity to highly individualized, purposeful practice. We argue more attention is needed on the development of self-report methods and measurements to reliably and validly assess sport expertise development.

2021 ◽  
Vol 39 (3) ◽  
pp. 56-66
Author(s):  
Jackie Lordo

Musicians and athletes share many common traits. Both groups learn a combination of physical and mental skills to attain expert status. In this literature review, I provide a short history of research on expertise development and two models: Bloom’s model of expertise development and the Developmental Model of Sport Participation. The Bloom model categorizes learning activities between combinations of free play and deliberate practice throughout the three stages of development. However, Developmental Model of Sport Participation includes a new category, deliberate play, which combines aspects of play and deliberate practice. Research indicating music learning through deliberate practice, deliberate play, and music play is presented. If students are able to learn through the more enjoyable deliberate play and music play, teachers should consider including these activities to better match developmental stages and potentially improve retention. Implications for future research and music teachers are discussed.


2011 ◽  
Vol 27 (3) ◽  
pp. 164-170 ◽  
Author(s):  
Anna Sundström

This study evaluated the psychometric properties of a self-report scale for assessing perceived driver competence, labeled the Self-Efficacy Scale for Driver Competence (SSDC), using item response theory analyses. Two samples of Swedish driving-license examinees (n = 795; n = 714) completed two versions of the SSDC that were parallel in content. Prior work, using classical test theory analyses, has provided support for the validity and reliability of scores from the SSDC. This study investigated the measurement precision, item hierarchy, and differential functioning for males and females of the items in the SSDC as well as how the rating scale functions. The results confirmed the previous findings; that the SSDC demonstrates sound psychometric properties. In addition, the findings showed that measurement precision could be increased by adding items that tap higher self-efficacy levels. Moreover, the rating scale can be improved by reducing the number of categories or by providing each category with a label.


2007 ◽  
Vol 27 (4) ◽  
pp. 140-148 ◽  
Author(s):  
Ingela Petersson ◽  
Anne G. Fisher ◽  
Helena Hemmingsson ◽  
Margareta Lilja

The objective of this study was to evaluate aspects of the validity and reliability of the Client-Clinician Assessment Protocol (C-CAP) Part I. C-CAP data for 103 people aging with disabilities in need of home modification services were analyzed using the Rasch rating scale model. The C-CAP Part I consists of a client self-report of ability in daily life tasks comprising three scales (independence, difficulty, and safety). The analysis demonstrated support for internal scale validity, person response validity, and person separation reliability of the C-CAP Part I, although the results differed among the three scales. The results of this study indicated that the C-CAP Part I has psychometric strengths and limitations. The instrument has the potential to be used in the home environment with people who are aging with disabilities. The C-CAP could complement already existing tools that are used to assess functioning in activities of daily living, especially regarding the focus on the clients' self-report of difficulty and safety in daily life at home and in the community.


2021 ◽  
Vol 4 (1) ◽  
pp. 43-54
Author(s):  
Yosef Yosef ◽  
Hasmalena Hasmalena ◽  
Sigit Dwi Sucipto

Parental involvement had benefit for the education of elementary children. Yet, knowing parental efficacy was important factor to do such involvement.  The purpose of this study was to design and examine a practical, valid, and reliable parental efficacy scale for measuring parents’ capabilities to involve in elementary education. A total of 402 parents of elementary children participated in this study, consisting of 114 fathers (28.36%) and 288 mothers (71.64%). They were selected randomly from 10 elementary schools and fulfilled informed consent showing they participated voluntarily in the study. A Parental Efficacy Scale which had been designed was tested for its practicality, validity and reliability. This self-report instrument asked parents to respond 67 items containing six aspects, namely their belief to be able parenting children, communicating with the school, helping children learn at home, becoming school volunteers, making decisions, and collaborating with community. The results showed that the scale fulfilled all of three requirements in all six aspects.


2013 ◽  
Vol 21 (1) ◽  
pp. 137-152 ◽  
Author(s):  
Mary Ann Francisco

Background and Purpose: Diabetes mellitus is an increasingly prevalent disease among hospitalized patients. Educators are challenged to build evidence-based programs for nurses based on sound nursing needs assessments using valid and reliable measures. The purpose of this integrative review is to examine instruments that measure nurses’ knowledge about diabetes. Methods: The Databases PubMed (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Cochrane Database of Systematic Reviews were searched for articles published between 1983 and 2012 using the keywords: diabetes knowledge; diabetes mellitus; diabetes self-management, nurse, and nursing knowledge. Fifteen articles reflecting the psychometric properties of 7 published instruments were reviewed. Results: The most commonly used instruments are the Diabetes Basic Knowledge Test (DBKT) and Diabetes Self-Report Test (DSRT). Several replication studies using the DBKT and DSRT did not consistently report reliability and validity measures. Five additional investigator-developed tools also lack strong validity and reliability measures. Conclusions: The findings suggest the need for continued development and psychometric testing of instruments to measure nurses’ knowledge about diabetes.


Author(s):  
Jean Neils-Strunjas ◽  
K. Jason Crandall ◽  
Brian Weiler ◽  
Annika Gabbard ◽  
Caroline Wood ◽  
...  

Purpose The purpose of this article was to describe the validity and reliability of the Fun and Social Engagement Evaluation (FUSE) developed to evaluate and measure social engagement displayed by nursing home residents during Bingocize. The FUSE combines health care worker observation and a resident self-report measure to produce a score that represents a resident's total engagement. Method To describe validity, trained health care workers who implement Bingocize were surveyed about the items on the FUSE. Visual inspection of bar graphs of responses to survey questions were used to determine content validity. To assess reliability of the FUSE, nursing home residents were evaluated by trained research assistants. Test–retest reliability of the participant scores 1 week apart was determined with the bivariate correlation (Pearson product–moment correlation coefficient). Results For validity, the majority of survey respondents indicated that the behaviors were representative of nursing home residents during Bingocize. For reliability, there was moderate–strong test–retest reliability over 1 week ( r = .60). Interrater reliability between two raters observing eight participants across two sessions was significant, κ = .68 (95% CI [.504,.848]), p < .0001. Conclusion Results offer evidence that the FUSE is a valid and reliable method for determining social engagement during Bingocize.


Author(s):  
Tina Poon

Previous literature has shown the importance of music engagement in everyday living, particularly for regulating emotions and enhancing the quality of life. However, the benefits individuals derive from music vary based on degree and method of use. Current measures of music engagement are designed for healthy populations and rely heavily on introspective self-report. Unfortunately, special populations with cognitive deficits, such as dementia patients, cannot accurately report introspective emotions and mood. Thus, there is a need for a more concrete behavioural-based measure suitable for reporting by a third party. The current study addressed these issues by developing a music engagement questionnaire suitable for dementia patients. The questionnaire will be tested with a large sample of adults with a range of ages. Furthermore, the questionnaire will undergo statistical analysis to determine validity and reliability. The result will be a measure of music engagement suitable for use with participants who suffer from dementia or other cognitive disorders.


Author(s):  
Matthew J. Koehler ◽  
Tae Seob Shin ◽  
Punya Mishra

In this chapter we reviewed a wide range of approaches to measure Technological Pedagogical Content Knowledge (TPACK). We identified recent empirical studies that utilized TPACK assessments and determined whether they should be included in our analysis using a set of criteria. We then conducted a study-level analysis focusing on empirical studies that met our initial search criteria. In addition, we conducted a measurement-level analysis focusing on individual measures. Based on our measurement-level analysis, we categorized a total of 141 instruments into five types (i.e., self-report measures, open-end questionnaires, performance assessments, interviews, and observations) and investigated how each measure addressed the issues of validity and reliability. We concluded our review by discussing limitations and implications of our study.


2019 ◽  
Vol 10 ◽  
Author(s):  
Rachel L. Kennedy ◽  
Jeffrey T. Fairbrother

Sign in / Sign up

Export Citation Format

Share Document