Cross-cultural adaptation and validation of the International Cooperative Ataxia Rating Scale (ICARS) to Brazilian Portuguese

ABSTRACT Introduction: The clinical assessment of patients with ataxias requires reliable scales. We aimed to translate, adapt and validate the International Cooperative Ataxia Rating Scale (ICARS) into Brazilian Portuguese. Methods: The steps of this study were forward translation, translation synthesis, backward translation, expert committee meeting, preliminary pilot testing and final assessment. Thirty patients were enrolled in the preliminary pilot testing and 61 patients were evaluated for construct validity, internal consistency, intra- and inter-rater reliability and external consistency. Results: This study showed good validity of the construct and high internal consistency for the full scale, except for the oculomotor domain (Cronbach's alpha = 0.316, intraclass correlation coefficients intra- = 82.4% and inter- = 79.2%). A high correlation with the Scale for the Assessment and Rating of Ataxia was observed. We found good intra-rater agreement and relative inter-rater disagreement, except in the posture and gait domain. Conclusion: The present ICARS version is adapted for the Brazilian culture and can be used to assess our ataxic patients.

Download Full-text

Translation, linguistic and cultural adaptation, reliability and validity of the Radboud Oral Motor Inventory for Parkinson's Disease – ROMP questionnaire

Arquivos de Neuro-Psiquiatria ◽

10.1590/0004-282x20180033 ◽

2018 ◽

Vol 76 (5) ◽

pp. 316-323 ◽

Cited By ~ 2

Author(s):

Monia Presotto ◽

Maira Rozenfeld Olchik ◽

Johanna G. Kalf ◽

Carlos R.M. Rieder

Keyword(s):

Parkinson’S Disease ◽

Parkinson's Disease ◽

Internal Consistency ◽

Rating Scale ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Brazilian Portuguese ◽

Intraclass Correlation Coefficients ◽

Oral Motor

ABSTRACT Objective: To translate and linguistically and culturally adapt to Brazilian Portuguese, and verify the reliability and validity of the Radboud Oral Motor Inventory for Parkinson's Disease (ROMP). Methods: The ROMP was translated and retranslated, and the instrument reliability was verified by analyzing the internal consistency and the reproducibility of the intra-examiner retest. The final version was applied to 27 participants with Parkinson's disease. Results: Internal consistency was 0.99 for the total ROMP and 0.96 to 0.99 for the three domains. Intraclass correlation coefficients for reproducibility were 0.99 for the total ROMP and 0.93 to 0.99 for the subscales. The ROMP and its subscales correlated substantially with the Likert-type scale, as well as with the unified Parkinson's disease rating scale II and III items. Conclusion: The linguistic and cultural equivalence of the ROMP in Brazilian Portuguese is now available, with excellent reliability and validity.

Download Full-text

Translation, cross-cultural adaptation and validation of the Brazilian version of the Nonarthritic Hip Score

Sao Paulo Medical Journal ◽

10.1590/1516-3180.2013.1314487 ◽

2013 ◽

Vol 131 (4) ◽

pp. 244-251 ◽

Cited By ~ 7

Author(s):

Leticia Nunes Carreras Del Castillo ◽

Gustavo Leporace ◽

Themis Moura Cardinot ◽

Roger Abramino Levy ◽

Liszt Palmeira de Oliveira

Keyword(s):

Internal Consistency ◽

English Language ◽

Intraclass Correlation ◽

Brazilian Portuguese ◽

Physically Active ◽

Brazilian Version ◽

Hip Function ◽

The Difference ◽

Brazilian Culture ◽

Active Patients

CONTEXT AND OBJECTIVE The Nonarthritic Hip Score (NAHS) is a clinical evaluation questionnaire that was developed in the English language to evaluate hip function in young and physically active patients. The aims of this study were to translate this questionnaire into the Brazilian Portuguese language, to adapt it to Brazilian culture and to validate it. DESIGN AND SETTING Cohort study conducted between 2008 and 2010, at Universidade do Estado do Rio de Janeiro (UERJ). METHODS Questions about physical activities and household chores were modified to better fit Brazilian culture. Reproducibility, internal consistency and validity (correlations with the Algofunctional Lequesne Index and the Western Ontario and McMaster Universities Arthritis Index [WOMAC]) were tested. The NAHS-Brazil, Lequesne and WOMAC questionnaires were applied to 64 young and physically active patients (mean age, 40.9 years; 31 women). RESULTS The intraclass correlation coefficient (which measures reproducibility) was 0.837 (P < 0.001). Bland-Altman plots revealed a mean error in the difference between the two measurements of 0.42. The internal consistency was confirmed through a Cronbach alpha of 0.944. The validity between NAHS-Brazil and Lequesne and between NAHS-Brazil and WOMAC showed high correlations, r = 0.7340 and r = 0.9073, respectively. NAHS-Brazil showed good validity with no floor or ceiling effects. CONCLUSION The NAHS was translated into the Brazilian Portuguese language and was cross-culturally adapted to Brazilian culture. It was shown to be a useful tool in clinical practice for assessing the quality of life of young and physically active patients with hip pain.

Download Full-text

Development and Testing of Screen-Based and Psychometric Instruments for Assessing Resident Performance in an Operating Room Simulator

Anesthesiology Research and Practice ◽

10.1155/2016/9348478 ◽

2016 ◽

Vol 2016 ◽

pp. 1-13 ◽

Cited By ~ 1

Author(s):

Richard R. McNeer ◽

Roman Dudaryk ◽

Nicholas B. Nedeff ◽

Christopher L. Bennett

Keyword(s):

Operating Room ◽

Internal Consistency ◽

Rating Scale ◽

Clinical Skills ◽

Intraclass Correlation ◽

Rank Correlation ◽

Correlation Coefficients ◽

Global Rating Scale ◽

Global Rating ◽

Anesthesia Residents

Introduction. Medical simulators are used for assessing clinical skills and increasingly for testing hypotheses. We developed and tested an approach for assessing performance in anesthesia residents using screen-based simulation that ensures expert raters remain blinded to subject identity and experimental condition.Methods. Twenty anesthesia residents managed emergencies in an operating room simulator by logging actions through a custom graphical user interface. Two expert raters rated performance based on these entries using custom Global Rating Scale (GRS) and Crisis Management Checklist (CMC) instruments. Interrater reliability was measured by calculating intraclass correlation coefficients (ICC), and internal consistency of the instruments was assessed with Cronbach’s alpha. Agreement between GRS and CMC was measured using Spearman rank correlation (SRC).Results. Interrater agreement (GRS: ICC = 0.825, CMC: ICC = 0.878) and internal consistency (GRS: alpha = 0.838, CMC: alpha = 0.886) were good for both instruments. Subscale analysis indicated that several instrument items can be discarded. GRS and CMC scores were highly correlated (SRC = 0.948).Conclusions. In this pilot study, we demonstrated that screen-based simulation can allow blinded assessment of performance. GRS and CMC instruments demonstrated good rater agreement and internal consistency. We plan to further test construct validity of our instruments by measuring performance in our simulator as a function of training level.

Download Full-text

Adaptação transcultural do questionário EFFECT para português brasileiro

Revista Brasileira de Educação Médica ◽

10.1590/1981-5271v45.3-20200527 ◽

2021 ◽

Vol 45 (3) ◽

Author(s):

Lourrany Borges Costa ◽

Shamyr Sulyvan de Castro ◽

Diovana Ximenes Cavalcante Dourado ◽

Bruna Soares Praxedes ◽

Thayná Custódio Mota ◽

...

Keyword(s):

Teacher Evaluation ◽

Internal Consistency ◽

Clinical Teaching ◽

Clinical Medicine ◽

Brazilian Portuguese ◽

Expert Committee ◽

Alpha Coefficient ◽

Cronbach’S Alpha ◽

Cronbach's Alpha ◽

Back Translation

Abstract: Introduction: Clinical teaching is based on a real work environment, in professional practice settings, such as health services and units, under the supervision of the preceptor. Providing medical teachers with an assessment of their teaching skills is a powerful tool for improving clinical learning for students in training. In this context, the EFFECT (Evaluation and Feedback for Effective Clinical Teaching) questionnaire was developed by Dutch researchers in 2012 for teacher evaluation, being validated based on the literature about medical teaching in the workplace and incorporates the skills of the Canadian competency-based medical curriculum. Objective: To translate and cross-culturally adapt into Brazilian Portuguese and to validate the EFFECT questionnaire for teacher evaluation by Medical students. Method: Cross-cultural adaptation with the following steps: initial translation of the English version, synthesis of translated versions, back-translation, creation of a consensual version in Brazilian Portuguese, with adaptation, review, and analysis of content validity by an expert committee, pre-test with retrospective clarification interview, and reliability analysis by factorial analysis and internal consistency test (Cronbach’s alpha coefficient). Result: In the translation and back-translation stages, the disagreements were related to the use of synonyms and none of the items were modified in terms of their understanding, but in terms of adaptation into the Brazilian context. The evaluation of the expert committee showed the versions maintained the semantic and idiomatic equivalences of the content. Eighty-nine students participated in the pre-test. The internal consistency of the EFFECT questionnaire in Brazilian Portuguese was excellent for all domains, with Cronbach’s alpha coefficient ranging from 0.82 to 0.94. Conclusion: The translated and adapted version of the EFFECT questionnaire into Brazilian Portuguese is equivalent to the original instrument and has evidence of high validity and reliability, being able to constitute a national tool to evaluate the efficiency of clinical medicine teaching.

Download Full-text

Transcultural adaptation of the Thirst Distress Scale (TDS) into Brazilian Portuguese and an analysis of the psychometric properties of the scale for patients on hemodialysis

Brazilian Journal of Nephrology ◽

10.1590/2175-8239-jbn-2019-0151 ◽

2020 ◽

Vol 42 (2) ◽

pp. 153-162

Author(s):

Clara Sandra de Araujo Sugizaki ◽

Clarice Carneiro Braga ◽

Ana Tereza Vaz de Souza Freitas ◽

Maria do Rosário Gondim Peixoto

Keyword(s):

Visual Analogue Scale ◽

Psychometric Properties ◽

Internal Consistency ◽

Analogue Scale ◽

Intraclass Correlation ◽

Brazilian Portuguese ◽

Final Version ◽

Portuguese Version ◽

Transcultural Adaptation ◽

Distress Scale

Abstract Objective: To produce a transcultural adaptation of the Thirst Distress Scale (TDS) into Brazilian Portuguese and analyze the scale’s psychometric properties for patients on hemodialysis (HD). Methods: The original scale was translated, back translated, and discussed with psychometric assessment experts. The final version was tested with 126 patients on HD and retested with 70 individuals from the original patient population. Cronbach’s alpha was used to measure the scale’s internal consistency. Reliability of thirst intensity evaluated via the visual analogue scale (VAS) was tested with Kappa statistic and the Bland-Altman plot. Reproducibility was assessed based on the intraclass correlation coefficient (ICC). Results: The wording of three items and the verb tenses of six had to be adjusted in the final version of the Brazilian Portuguese TDS. Comprehension of the scale by patients on HD was good, the scale’s internal consistency was satisfactory (0.84; p<0.001), agreement with a visual analogue scale (VAS) was moderate (kappa=0.44; p<0.001), and reproducibility neared perfection (ICC=0.87; p<0.001). Conclusion: Our results showed that the Brazilian Portuguese version of the scale might be used reliably. The Brazilian Portuguese version of the TDS is a practical, affordable, accessible and well-accepted tool that has a lot to offer for the management of patients with HD.

Download Full-text

Interformat Reliability of Web-Based Parent-Rated Questionnaires for Assessing Neurodevelopmental Disorders Among Preschoolers: Cross-sectional Community Study

JMIR Pediatrics and Parenting ◽

10.2196/20172 ◽

2021 ◽

Vol 4 (1) ◽

pp. e20172

Author(s):

Masanori Tanaka ◽

Manabu Saito ◽

Michio Takahashi ◽

Masaki Adachi ◽

Kazuhiko Nakamura

Keyword(s):

Neurodevelopmental Disorders ◽

Rating Scale ◽

Developmental Coordination Disorder ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Autism Spectrum ◽

Cross Sectional ◽

Web Based ◽

Developmental Health ◽

The Web

Background Early detection and intervention for neurodevelopmental disorders are effective. Several types of paper questionnaires have been developed to assess these conditions in early childhood; however, the psychometric equivalence between the web-based and the paper versions of these questionnaires is unknown. Objective This study examined the interformat reliability of the web-based parent-rated version of the Autism Spectrum Screening Questionnaire (ASSQ), Attention-Deficit/Hyperactivity Disorder Rating Scale (ADHD-RS), Developmental Coordination Disorder Questionnaire 2007 (DCDQ), and Strengths and Difficulties Questionnaire (SDQ) among Japanese preschoolers in a community developmental health check-up setting. Methods A set of paper-based questionnaires were distributed for voluntary completion to parents of children aged 5 years. The package of the paper format questionnaires included the ASSQ, ADHD-RS, DCDQ, parent-reported SDQ (P-SDQ), and several additional demographic questions. Responses were received from 508 parents of children who agreed to participate in the study. After 3 months, 300 parents, who were among the initial responders, were randomly selected and asked to complete the web-based versions of these questionnaires. A total of 140 parents replied to the web-based format and were included as a final sample in this study. Results We obtained the McDonald ω coefficients for both the web-based and paper formats of the ASSQ (web-based: ω=.90; paper: ω=.86), ADHD-RS total and subscales (web-based: ω=.88-.94; paper: ω=.87-.93), DCDQ total and subscales (web-based: ω=.82-.94; paper: ω=.74-.92), and P-SDQ total and subscales (web-based: ω=.55-.81; paper: ω=.52-.80). The intraclass correlation coefficients between the web-based and paper formats were all significant at the 99.9% confidence level: ASSQ (r=0.66, P<.001); ADHD-RS total and subscales (r=0.66-0.74, P<.001); DCDQ total and subscales (r=0.66-0.71, P<.001); P-SDQ Total Difficulties and subscales (r=0.55-0.73, P<.001). There were no significant differences between the web-based and paper formats for total mean score of the ASSQ (P=.76), total (P=.12) and subscale (P=.11-.47) mean scores of DCDQ, and the P-SDQ Total Difficulties mean score (P=.20) and mean subscale scores (P=.28-.79). Although significant differences were found between the web-based and paper formats for mean ADHD-RS scores (total: t132=2.83, P=.005; Inattention subscale: t133=2.15, P=.03; Hyperactivity/Impulsivity subscale: t133=3.21, P=.002), the effect sizes were small (Cohen d=0.18-0.22). Conclusions These results suggest that the web-based versions of the ASSQ, ADHD-RS, DCDQ, and P-SDQ were equivalent, with the same level of internal consistency and intrarater reliability as the paper versions, indicating the applicability of the web-based versions of these questionnaires for assessing neurodevelopmental disorders.

Download Full-text

The Arabic Version of the Mobile App Rating Scale: Development and Validation Study (Preprint)

10.2196/preprints.16956 ◽

2019 ◽

Author(s):

Marco Bardus ◽

Nathalie Awada ◽

Lilian A Ghandour ◽

Elie-Jacques Fares ◽

Tarek Gherbal ◽

...

Keyword(s):

Weight Management ◽

Information Quality ◽

Rating Scale ◽

Arab World ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Mobile App ◽

Health Apps ◽

Highly Correlated

BACKGROUND With thousands of health apps in app stores globally, it is crucial to systemically and thoroughly evaluate the quality of these apps due to their potential influence on health decisions and outcomes. The Mobile App Rating Scale (MARS) is the only currently available tool that provides a comprehensive, multidimensional evaluation of app quality, which has been used to compare medical apps from American and European app stores in various areas, available in English, Italian, Spanish, and German. However, this tool is not available in Arabic. OBJECTIVE This study aimed to translate and adapt MARS to Arabic and validate the tool with a sample of health apps aimed at managing or preventing obesity and associated disorders. METHODS We followed a well-established and defined “universalist” process of cross-cultural adaptation using a mixed methods approach. Early translations of the tool, accompanied by confirmation of the contents by two rounds of separate discussions, were included and culminated in a final version, which was then back-translated into English. Two trained researchers piloted the MARS in Arabic (MARS-Ar) with a sample of 10 weight management apps obtained from Google Play and the App Store. Interrater reliability was established using intraclass correlation coefficients (ICCs). After reliability was ascertained, the two researchers independently evaluated a set of additional 56 apps. RESULTS MARS-Ar was highly aligned with the original English version. The ICCs for MARS-Ar (0.836, 95% CI 0.817-0.853) and MARS English (0.838, 95% CI 0.819-0.855) were good. The MARS-Ar subscales were highly correlated with the original counterparts (P<.001). The lowest correlation was observed in the area of usability (r=0.685), followed by aesthetics (r=0.827), information quality (r=0.854), engagement (r=0.894), and total app quality (r=0.897). Subjective quality was also highly correlated (r=0.820). CONCLUSIONS MARS-Ar is a valid instrument to assess app quality among trained Arabic-speaking users of health and fitness apps. Researchers and public health professionals in the Arab world can use the overall MARS score and its subscales to reliably evaluate the quality of weight management apps. Further research is necessary to test the MARS-Ar on apps addressing various health issues, such as attention or anxiety prevention, or sexual and reproductive health.

Download Full-text

Translation to Brazilian Portuguese and Cultural Adaptation of the Craniocervical Dysfunction Index

International Archives of Otorhinolaryngology ◽

10.1055/s-0037-1621743 ◽

2018 ◽

Vol 22 (03) ◽

pp. 291-296

Author(s):

Ana Dias ◽

Marcelo Doi ◽

Arthur Mesas ◽

Michelle Fillis ◽

Fatima Branco-Barreiro ◽

...

Keyword(s):

Neck Pain ◽

Internal Consistency ◽

Brazilian Portuguese ◽

Portuguese Version ◽

Reliable Instrument ◽

Back Translation ◽

Good Internal Consistency ◽

Brazilian Culture ◽

Functional Alteration ◽

Craniocervical Dysfunction

Introduction Functional disorders of the craniocervical region affect 77.78% of Brazilian teachers. Among the most common instruments used to assess craniocervical disorders in a detailed and objective way, none had been translated to Brazilian Portuguese and adapted to Brazilian culture. Objectives To translate to Brazilian Portuguese and to culturally adapt the Craniocervical Dysfunction Index (CDI). Method The first phase of the study consisted of the translation, synthesis, back-translation, and review of the contents by a committee of experts, who developed a trial version and sent all the steps to the original author. The trial version was applied to 50 teachers of an institution. The reliability and internal consistency were evaluated by Cronbach α. For the validation, the Brazilian Portuguese version of the CDI was correlated with the Visual Analogue Scale (VAS) domains for cervicalgia and evaluated by Spearman ρ. Result Some expressions were adapted to the Brazilian culture. Among the participants who did not report neck pain in the VAS, 84.21% suffered from craniocervical dysfunction acording to the CDI. Among the participants who reported neck pain in the VAS, 100% suffered from craniocervical dysfunction according to the CDI. The CDI showed good internal consistency and satisfactory reliability measured by Cronbrach α (α = 0.717). There was a strong correlation between the CDI and the VAS score (ρ = 0.735). Conclusion No difficulties were encountered in the translation and back-translation of the CDI, and no problems were observed regarding the trial version developed; therefore, the Brazilian Portuguese version of the CDI is a valid and reliable instrument to evaluate the functional alteration of the craniocervical region.

Download Full-text

Validation of an Evidence-Based Medicine Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET)

Journal of Graduate Medical Education ◽

10.4300/jgme-d-12-00049.1 ◽

2013 ◽

Vol 5 (2) ◽

pp. 252-256 ◽

Cited By ~ 2

Author(s):

Hans B. Kersten ◽

John G. Frohna ◽

Erin L. Giudice

Keyword(s):

Internal Consistency ◽

Evidence Based Medicine ◽

Interrater Reliability ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Evidence Based ◽

Evaluation Tool ◽

Intraclass Correlation Coefficients ◽

Excellent Internal Consistency ◽

Based Medicine

Abstract Background Competence in evidence-based medicine (EBM) is an important clinical skill. Pediatrics residents are expected to acquire competence in EBM during their education, yet few validated tools exist to assess residents' EBM skills. Objective We sought to develop a reliable tool to evaluate residents' EBM skills in the critical appraisal of a research article, the development of a written EBM critically appraised topic (CAT) synopsis, and a presentation of the findings to colleagues. Methods Instrument development used a modified Delphi technique. We defined the skills to be assessed while reviewing (1) a written CAT synopsis and (2) a resident's EBM presentation. We defined skill levels for each item using the Dreyfus and Dreyfus model of skill development and created behavioral anchors using a frame-of-reference training technique to describe performance for each skill level. We evaluated the assessment instrument's psychometric properties, including internal consistency and interrater reliability. Results The EBM Critically Appraised Topic Presentation Evaluation Tool (EBM C-PET) is composed of 14 items that assess residents' EBM and global presentation skills. Resident presentations (N = 27) and the corresponding written CAT synopses were evaluated using the EBM C-PET. The EBM C-PET had excellent internal consistency (Cronbach α = 0.94). Intraclass correlation coefficients were used to assess interrater reliability. Intraclass correlation coefficients for individual items ranged from 0.31 to 0.74; the average intraclass correlation coefficients for the 14 items was 0.67. Conclusions We identified essential components of an assessment tool for an EBM CAT synopsis and presentation with excellent internal consistency and a good level of interrater reliability across 3 different institutions. The EBM C-PET is a reliable tool to document resident competence in higher-level EBM skills.

Download Full-text

Bolus Residue Scale: An Easy-to-Use and Reliable Videofluoroscopic Analysis Tool to Score Bolus Residue in Patients with Dysphagia

International Journal of Otolaryngology ◽

10.1155/2015/780197 ◽

2015 ◽

Vol 2015 ◽

pp. 1-7 ◽

Cited By ~ 11

Author(s):

Nathalie Rommel ◽

Charlotte Borgers ◽

Dirk Van Beckevoort ◽

Ann Goeleven ◽

Eddy Dejaeger ◽

...

Keyword(s):

Rating Scale ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Posterior Pharyngeal Wall ◽

High Specificity ◽

Analysis Tool ◽

Pharyngeal Wall ◽

Specificity And Sensitivity ◽

Low Sensitivity ◽

Sensitivity Specificity

Background. We aimed to validate an easy-to-use videofluoroscopic analysis tool, the bolus residue scale (BRS), for detection and classification of pharyngeal retention in the valleculae, piriform sinuses, and/or the posterior pharyngeal wall.Methods. 50 randomly selected videofluoroscopic images of 10 mL swallows (recorded in 18 dysphagia patients and 8 controls) were analyzed by 4 experts and 6 nonexpert observers. A score from 1 to 6 was assigned according to the number of structures affected by residue. Inter- and intrarater reliabilities were assessed by calculation of intraclass correlation coefficients (ICCs) for expert and nonexpert observers. Sensitivity, specificity, and interrater agreement were analyzed for different BRS levels.Results. Intrarater reproducibility was almost perfect for experts (mean ICC 0.972) and ranged from substantial to almost perfect for nonexperts (mean ICC 0.835). Interjudge agreement of the experts ranged from substantial to almost perfect (mean ICC 0.780), but interrater reliability of nonexperts ranged from substantial to good (mean 0.719). BRS shows for experts a high specificity and sensitivity and for nonexperts a low sensitivity and high specificity.Conclusions. The BRS is a simple, easy-to-carry-out, and accessible rating scale to locate pharyngeal retention on videofluoroscopic images with a good specificity and reproducibility for observers of different expertise levels.

Download Full-text