In search of searching skills

1985 ◽  
Vol 10 (3) ◽  
pp. 111-123 ◽  
Author(s):  
Donald Fairhall

A set of skills thought to contribute to effectiveness in searching subject indexes is defined. Of these, one group was selected for study, namely skills thought to focus a search. An objective test to measure these skills was administered to 129 students and established to have content validity, and some degree of construct validity. The skills involved did not corre late highly with each other, and are to be regarded, at least for the time being, as five separate skills, An attempt to establish the criterion, or predictive validity of the subtests of the focusing skills failed to either validate or invalidate them because of wide errors of measurement in the subtests, but more particularly in a performance test of index searching. It is suggested that future work should attempt to find practicable ways of improving test accuracy, and also that the cognitive dimensions of document relevance be investigated.

Author(s):  
Maha Wagdy Hamada ◽  
Giorgios Pafitanis ◽  
Alex Nistor ◽  
Youn Hwan Kim ◽  
Simon Myers ◽  
...  

Abstract Background In vivo and ex vivo simulation training workshops can contribute to surgical skill acquisition but require validation before becoming incorporated within curricula. Ideally, that validation should include the following: face, content, construct, concurrent, and predictive validity. Methods During two in vivo porcine surgical training workshops, 27 participants completed questionnaires relating to face and content validity of porcine in vivo flap elevation. Six participants’ performances raising a pedicled myocutaneous latissimus dorsi (LD) flap in the pig (2 experts and 4 trainees) were sequentially and objectively assessed for construct validity with hand motion analysis (HMA), a performance checklist, a blinded randomized procedure-specific rating scale of standardized video recordings, and flap viability by fluorescence imaging. Results Face and content validity were demonstrated straightforwardly. Construct validity was demonstrated for average procedure time by HMA between trainees and experts (p = 0.036). Skill acquisition was demonstrated by trainees’ HMA average number of hand movements (p = 0.046) and fluorescence flap viability (p = 0.034). Conclusion Face and content validity for in vivo porcine flap elevation simulation training were established. Construct validity was established for an in vivo porcine latissimus dorsi flap elevation simulation specifically. Predictive validity will prove more challenging to establish. Level of evidence: Not ratable .


2021 ◽  
pp. 019459982110328
Author(s):  
Tobias Albrecht ◽  
Christoph Nikendei ◽  
Mark Praetorius

Objective Otologic diseases are common in all age groups and can significantly impair the function of this important sensory organ. To make a correct diagnosis, the correct handling of the otoscope and a correctly performed examination are essential. A virtual reality simulator could make it easier to teach this difficult-to-teach skill. The aim of this study was to assess the face, content, and construct validity of the novel virtual reality otoscopy simulator and the applicability to otologic training. Study Design Face and content validity was assessed with a questionnaire. Construct validity was assessed in a prospectively designed controlled trial. Setting Training for medical students at a tertiary referral center. Method The questionnaire used a 6-point Likert scale. The otoscopy was rated with a modified Objective Structured Assessment of Technical Skills. Time to complete the task and the percentage of the assessed eardrum surface were recorded. Results The realism of the simulator and the applicability to medical training were assessed across several items. The ratings suggested good face and content validity as well as usefulness and functionality of the simulator. The otolaryngologists significantly outperformed the student group in all categories measured (P < .0001), suggesting construct validity of the simulator. Conclusion In this study, we could demonstrate face, content, and construct validity for a novel high-fidelity virtual reality otoscopy simulator. The results encourage the use of the otoscopy simulator as a complementary tool to traditional teaching methods in a curriculum for medical students.


2021 ◽  
Vol 11 (6) ◽  
pp. 2723
Author(s):  
Fatih Uysal ◽  
Fırat Hardalaç ◽  
Ozan Peker ◽  
Tolga Tolunay ◽  
Nil Tokgöz

Fractures occur in the shoulder area, which has a wider range of motion than other joints in the body, for various reasons. To diagnose these fractures, data gathered from X-radiation (X-ray), magnetic resonance imaging (MRI), or computed tomography (CT) are used. This study aims to help physicians by classifying shoulder images taken from X-ray devices as fracture/non-fracture with artificial intelligence. For this purpose, the performances of 26 deep learning-based pre-trained models in the detection of shoulder fractures were evaluated on the musculoskeletal radiographs (MURA) dataset, and two ensemble learning models (EL1 and EL2) were developed. The pre-trained models used are ResNet, ResNeXt, DenseNet, VGG, Inception, MobileNet, and their spinal fully connected (Spinal FC) versions. In the EL1 and EL2 models developed using pre-trained models with the best performance, test accuracy was 0.8455, 0.8472, Cohen’s kappa was 0.6907, 0.6942 and the area that was related with fracture class under the receiver operating characteristic (ROC) curve (AUC) was 0.8862, 0.8695. As a result of 28 different classifications in total, the highest test accuracy and Cohen’s kappa values were obtained in the EL2 model, and the highest AUC value was obtained in the EL1 model.


2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation


2021 ◽  
Vol 2 (01) ◽  
pp. 21-42
Author(s):  
Muhammad Afifullah Nizary ◽  
Ahmad Nur Kholik Nur Kholik

This article attempts to examine how to analyze the validity of the assessment instrument. In fact, not all teachers are able to make the correct instruments. Many teachers only take instruments from other schools to be used as a tool in measuring their students, even though the same instrument is not necessarily a measuring instrument with different objects. This habit needs to be improved. The teacher should be able to make their own instruments, because the teacher knows best about the differences in the abilities of each student. When the teacher uses instruments from other schools, where there are parts that the teacher has not conveyed in class, the students themselves are the losers. In making an assessment instrument the teacher must pay attention to two characteristics. Namely validity and reliability. Validity itself is divided into content validity, construct validity, and eksternal validity. Each validity has its own characteristics. Keywords: evaluation and teacher, the validity of the assessment instrument, the validity of the content


2021 ◽  
pp. 105477382110598
Author(s):  
Ganime Can Gür ◽  
Yasemin Altinbaş

The current study was planned to test the validity and reliability of the Turkish version of the COVID-19 Literacy Scale. The sample of the study was taken from 473 individuals. In this study, language validity, content validity and construct validity were examined to determine the validity of the scale. Its reliability was evaluated by internal consistency, split-half reliability, and test-retest reliability method. It was defined that the scale has a two-factor structure as a result of EFA and its factor loadings are in the appropriate range (0.852–0.324). According to the CFA result, it was determined that the model-data fit was at a good level. The Cronbach values for the whole scale and subscales were .92, .90, and .87, respectively. It was observed that the test-retest value was .95. It was concluded that the Turkish form of the COVID-19 Literacy Scale is a reliable and valid tool.


2002 ◽  
Vol 24 (1) ◽  
pp. 42-67 ◽  
Author(s):  
Jean-Philippe Heuzé ◽  
Paul Fontayne

The present report provides a summary of five studies undertaken to develop a French-language instrument to assess cohesiveness in sport teams—the “Questionnaire sur l’Ambiance du Groupe” (QAG). For the initial version of the instrument, the Group Environment Questionnaire (Carron, Widmeyer, & Brawley, 1985) was translated into French using the protocol outlined by Vallerand (1989). However, psychometric analyses undertaken in Studies 1, 2, and 3 failed to yield acceptable evidence of construct validity. Items were then revised in an attempt to make them more suitable for the French culture. Subsequent analyses in Study 4 provided support for the construct validity and reliability (internal consistency and interscale equivalence) of the QAG. In Study 5, predictive validity was demonstrated. The QAG has been found to possess satisfactory psychometric properties as a measure of cohesion in sport teams.


2018 ◽  
Vol 17 (03) ◽  
pp. 314-321
Author(s):  
José Manuel Hernández-Padilla ◽  
Matías Correa-Casado ◽  
José Granero-Molina ◽  
Alda Elena Cortés-Rodríguez ◽  
Tamara María Matarín-Jiménez ◽  
...  

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.


2014 ◽  
Vol 48 (5) ◽  
pp. 787-793 ◽  
Author(s):  
Ariane Polidoro Dini ◽  
Edinêis de Brito Guirardello

Objective Improve the content validity of the instrument for classification of pediatric patients and evaluate its construct validity. Method A descriptive exploratory study in the measurement of the content validity index, and correlational design for construct validation through exploratory factor analysis. Results The content validity index for indicators was 0.99 and it was 0.97 for graded situations. Three domains were extracted in the construct validation, namely: patient, family and therapeutic procedures, with 74.97% of explained variance. The instrument showed evidences of content and construct validity. Conclusion The validation of the instrument occurred under the approach of family-centered care, and allowed incorporating some essential needs of childhood such as playing, interaction and affection in the content of the instrument.



2015 ◽  
Vol 7 (1) ◽  
pp. 14-28
Author(s):  
ZUZANNA WALACH-BISTA

Background: This article presents the procedure of the elaboration and verification of the first Polish Sense of Team Efficacy Questionnaire (Kwestionariusz Poczucia Druzynowej Skutecznosci – KPDS). Material/Methods: Two research stages involved a total of 373 professional athletes. Based on the collected data, the internal structure and psychometric properties of the instrument were established. Results: As a result of the conducted statistical analyses, a questionnaire was obtained. Analyses confirmed the stability of the internal structure of the questionnaire. The instrument also obtained satisfactory coefficients of reliability (using Cronbach’s alpha internal reliability coefficient) and construct validity. In order to establish the convergent and discriminant validity of the KPDS, the analysis of the multitrait-multimethod matrix was applied, using the Group Environment Questionnaire (GEQ). Predictive validity was established using the result obtained in a match played directly after the conducted study. Conclusions: The obtained results confirmed the relevance of creating the KPDS. The questionnaire was made up of 21 items representing 4 subscales: fitness, preparation, effort and endurance. Calculation of a general score for the KPDS also proved to be possible.


Sign in / Sign up

Export Citation Format

Share Document