Assessing spoken-language interpreting

Interpreting ◽  
2021 ◽  
Author(s):  
Chao Han

Abstract In this study, we applied and evaluated a scoring method known as comparative judgement to assess spoken-language interpreting. This methodological exploration represents an extension of previous efforts to optimise scoring methods for assessing interpreting. Essentially, comparative judgement requires judges to compare two similar objects and make a binary decision about their relative qualities. To evaluate its reliability, validity and usefulness in the assessment of interpreting, we recruited two groups of judges (novice and experienced) to assess 66 two-way English/Chinese interpretations based on a computerised comparative judgement system. Our data analysis shows that the new method produced reliable and valid results across judge types and interpreting directions. However, the judges held polarised opinions about the method’s usefulness: while some considered it convenient, efficient and reliable, the opposite view was expressed by others. We discuss the results by providing an integrated analysis of the data collected, outline the perceived drawbacks and propose possible solutions to the drawbacks. We call for more evidence-based, substantive investigation into comparative judgement as a potentially useful method for assessing spoken-language interpreting in certain settings.

1997 ◽  
Vol 85 (1) ◽  
pp. 207-216 ◽  
Author(s):  
Girardin Jean-Louis ◽  
Hans von Gizycki ◽  
Ferdinand Zizi ◽  
Peter Hauri ◽  
Arthur Spielman ◽  
...  

Decades of empirical observations have established the validity of actigraphy primarily in individuals without sleep disorders. Methodological problems encountered thus far coupled with the widespread use of actigraphy signal the need for concentrated efforts to establish a consensus regarding scoring procedures. Currently available scoring methods show less reliability in clinical populations. To address these issues two validation studies were conducted: one for individuals without sleep disorders and the other for patients diagnosed with insomnia. The results of these two studies using the Actigraph Data Analysis Software as the scoring method have shown that the described system is fairly precise. It can be used for actigraphs with different features and mode of operation and is applicable to individuals with insomnia. These findings corroborate previous research showing that actigraphy is a valid instrument for assessment of sleep and wakefulness.


2020 ◽  
Vol 63 (4) ◽  
pp. 1240-1253
Author(s):  
Victoria S. Henbest ◽  
Lisa Fitton ◽  
Krystal L. Werfel ◽  
Kenn Apel

Purpose Spelling is a skill that relies on an individual's linguistic awareness, the ability to overtly manipulate language. The ability to accurately spell is important for academic and career success into adulthood. The spelling skills of adults have received some attention in the literature, but there is limited information regarding which approach for analyzing adults' spelling is optimal for guiding instruction or intervention for those who struggle. Thus, we aimed to examine the concurrent validity of four different scoring methods for measuring adults' spellings (a dichotomous scoring method and three continuous methods) and to determine whether adults' linguistic awareness skills differentially predict spelling outcomes based on the scoring method employed. Method Sixty undergraduate college students who were determined to be average readers as measured by a word reading and contextual word reading task were administered a spelling task as well as morphological, orthographic, phonemic, and syntactic awareness tasks. Results All four scoring methods were highly correlated suggesting high concurrent validity among the measures. Two linguistic awareness skills, morphological awareness and syntactic awareness, predicted spelling performance on both the dichotomous and continuous scoring methods. Contrastively, phonemic awareness and orthographic awareness predicted spelling performance only when spelling was scored using a continuous measure error analysis. Conclusions The results of this study confirm that multiple linguistic awareness skills are important for spelling in adults who are average readers. The results also highlight the need for using continuous measures of spelling when planning intervention or instruction, particularly in the areas of orthographic and phonemic awareness.


2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Soonmyung Paik ◽  
Youngmee Kwon ◽  
Moo Hyun Lee ◽  
Ji Ye Kim ◽  
Da Kyung Lee ◽  
...  

AbstractAlthough Ki67 labeling index is a potential predictive marker for chemotherapy benefit, its clinical utility has been limited by the lack of a standard scoring method resulting in poor interobserver reproducibility. Especially, there is no consensus on the use of average versus hotspot score for reporting. In order to determine the best method for Ki67 scoring and validate manual scoring method proposed by the International Ki67 Working Group (IKWG), we systematically compared average versus hotspot score in 240 cases with a public domain image analysis program QuPath. We used OncotypeDx Recurrence Score (RS) as a benchmark to compare the potential clinical utility of each scoring methods. Both average and hotspot scores showed statistically significant but only modest correlation with OncotypeDx RS. Only hotspot score could meaningfully distinguish RS low-risk versus high-risk patients. However, hotspot score was less reproducible limiting its clinical utility. In summary, our data demonstrate that utility of the Ki67 labeling index is influenced by the choice of scoring method.


2010 ◽  
Vol 118-120 ◽  
pp. 601-605
Author(s):  
Han Ming

Evaluation method of reliability parameter estimation needs to be improved effectively with the advance of science and technology. This paper develops a new method of parameter estimation, which is named E-Bayesian estimation method. In the case one hyper-parameter, the definition of E-Bayesian estimation of the failure probability is provided, moreover, the formulas of E-Bayesian estimation and hierarchical Bayesian estimation, and the property of E-Bayesian estimation of the failure probability are also provided. Finally, calculation on practical problems shows that the provided method is feasible and easy to perform.


2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Ting Qian ◽  
Ling Wei

As an important tool for data analysis and knowledge processing, formal concept analysis (FCA) has been applied to many fields. In this paper, we introduce a new method to find all formal concepts based on formal contexts. The amount of intents calculation is reduced by the method. And the corresponding algorithm of our approach is proposed. The main theorems and the corresponding algorithm are examined by examples, respectively. At last, several real-life databases are analyzed to demonstrate the application of the proposed approach. Experimental results show that the proposed approach is simple and effective.


2021 ◽  
Author(s):  
Adel Mehrabadi ◽  
Gabriele Urbani ◽  
Simona Renna ◽  
Lucia Rossi ◽  
Italo Luciani ◽  
...  

Abstract In case of giant brown fields, a proper water injection management can result in a very complex process, due to the quality and quantity of data to be analysed. Main issue is the understanding of the injected water preferential paths, especially in carbonate environment characterized by strong vertical and areal heterogeneities (karst). A structured workflow is presented to analyze and integrate a massive data set, in order to understand and optimize the water injection scheme. An extensive Production Data Analysis (PDA) has been performed, based on the integration of available geological data (including NMR and Cased Hole Logs), production (allocated rates, Well Tests, PLT), pressure (SBHP, RFT, MDT, ESP) and salinity data. The applied workflow led to build a Fluid Path Conceptual Model (FPCM), an easy but powerful tool to visualize the complex dynamic connections between injectors-producers and aquifer influence areas. Several diagnostic plots were performed to support and validate the main outcomes. On this basis, proper actions were implemented to optimize the current water injection scheme. The workflow was applied on a carbonate giant brown field characterized by three different reservoir members, hydraulically communicating at original conditions, characterized by high vertical heterogeneity and permeability contrast. Moreover, dissolution phenomena, localized in the uppermost reservoir section, led to important permeability enhancement through a wide network of connected vugs, acting as water preferential communication pathways. The geological analysis played a key role to investigate the reservoir water flooding mechanism in dynamic conditions. The water rising mechanism was identified to be driven by the high permeability contrast, hence characterized by lateral independent movements in the different reservoir members. The integrated analysis identified room for optimization of the current water injection strategy. In particular, key factor was the analysis and optimization at block scale, intended as areal and vertical sub-units, as identified by the PDA and visualized through the FPCM. Actions were suggested, including injection rates optimization and the definition of new injections points. A detailed surveillance plan was finally implemented to monitor the effects of the proposed actions on the field performances, proving the robustness of the methodology. Eni workflow for water injection analysis and optimization was previously successfully tested only in sandstone reservoirs. This paper shows the robustness of the methodology also in carbonate environment, where water encroachment is strongly driven by karst network. The result is a clear understanding of the main dynamics in the reservoir, which allows to better tune any action aimed to optimize water injection and increase the value of mature assets.


2001 ◽  
Vol 35 (2) ◽  
pp. 231-235 ◽  
Author(s):  
Susan Donath

Objective: To investigate the specificity and sensitivity of three different scoring methods of the 12-item General Health Questionnaire (GHQ-12) and hence to determine the best GHQ-12 threshold score for the detection of mental illness in community settings in Australia. Method: Secondary data analysis of the 1997 Australian National Survey of Health and Wellbeing (n = 10 641), using the Composite International Diagnostic Interview as the gold standard for diagnosis of mental illness. Results: The area under the Receiver Operating Characteristic (ROC) curve for the C-GHQ scoring method was 0.84 (95% CI = 0.83–0.86) compared with the area for the standard scoring method of 0.78 (95% CI = 0.76–0.80). The best threshold with C-GHQ was 3/4, with sensitivity 82.9% (95% CI = 80.2–85.5%) and specificity 69.0% (95% CI = 68.6–69.4%). The best threshold score with the standard scoring method was 0/1, with sensitivity 75.4% (95% CI = 72.5–78.4%) and specificity 69.9% (95% CI = 69.5–70.3%). These were also the best thresholds for a subsample of the population who had consulted a health practitioner in the previous 4 weeks. Conclusion: In the Australian setting, the C-GHQ scoring method is preferable to the standard method of scoring the GHQ-12. In Australia the GHQ-12 appears to be a less useful instrument for detecting mental illness than in many other countries.


2017 ◽  
Vol 24 (1) ◽  
pp. 22-32 ◽  
Author(s):  
Carlos Cantú-Brito ◽  
Gisele Sampaio Silva ◽  
Sebastián F. Ameriso

Atrial fibrillation (AF) is a prominent risk factor for stroke and a leading cause of death and disability throughout Latin America. Contemporary evidence-based guidelines for the management of AF and stroke incorporate the use of practical and relatively simple scoring methods to estimate both stroke and bleeding risk, in order to assist in matching patients with appropriate interventions. This review examines consistencies and differences among guidelines for reducing stroke risk in patients with AF, assessing the role of user-friendly scoring methods to determine appropriate patients for anticoagulation and other treatment options. Current options include warfarin and direct oral anticoagulants such as dabigatran, rivaroxaban, apixaban, and edoxaban. These agents have been found to be superior or noninferior to standard vitamin K antagonist anticoagulation in large randomized trials. Potential benefits of these agents mainly include lower ischemic stroke rates, reduced intracranial bleeding, no need for regular monitoring, and fewer drug–drug and drug–food interactions. Expert opinions regarding clinical situations for which data are presently lacking, such as emergency bleeding and stroke in anticoagulated patients, are also provided. Enhanced attention and adherence to evidence-based guidelines are essential components for a strategy to reduce stroke morbidity and mortality across Latin America.


2020 ◽  
Vol 3 (1) ◽  
pp. 49
Author(s):  
Budi Nugraha Hidayat ◽  
Maryani Maryani

Language is needed whether it is written or spoken. Language is very necessary for people as a mean of communication. The objective of this research was to analyze the students’ ability in writing simple sentences in past tense. This research used qualitaive research and the data were analyzed to investigate the second year of students’ ability in writing English simple sentences. The participant of this research was consisted of 32 students. Data analysis shows that 27.81% the students have difficulties in structure English simple sentence in past tense. Furthermore 38.12% the students have difficulties using regular verbs in past tense, whereas 71.8% the students have difficulties using irregural verbs in past tense. Over all, the students’ ability in writing English simple sentence in past tense can be considered in medium level. This is due to their confusion in using verb (regular verbs and irregular verbs).


Sign in / Sign up

Export Citation Format

Share Document