scholarly journals Validating an Academic Group Tutorial Discussion Speaking Test

2016 ◽  
Vol 6 (4) ◽  
pp. 12 ◽  
Author(s):  
Peter Crosthwaite ◽  
Simon Boynton ◽  
Sam Cole
Keyword(s):  
Language Proficiency ◽  
Visual Cues ◽  
Intraclass Correlation ◽  
Active Listening ◽  
Speaking Test ◽  
Group Settings ◽  
Threats To Validity ◽  
Freshmen Students ◽  
Post Hoc ◽  
Academic Group

<p>This study attempts to validate an academic group tutorial discussion speaking test for undergraduate freshmen students taking initial EAP training at a university in Hong Kong in terms of task, rater and criterion validity. Three quantitative measures (Cronbach’s Alpha, Intraclass Correlation Coefficient, and Exploratory Factor Analysis) are used to assess validity of rater scores for the test using a rubric with considerations for assessment of academic stance presentation, inter-candidate interaction, and individual language proficiency. These results are triangulated with post-hoc interview data from the raters regarding the difficulties they face assessing individual proficiency and group interaction over time. The results suggest that current provisions of the rubric in dealing with the assessment of interaction in group settings (namely visual cues such as “active listening” as well as provisions for interruptions in the form of “domination”) are problematic, and that raters are unable to separate the grading of academic stance from the grading of language concerns. We also note affective and cognitive difficulties involved with assessing extended periods of interactional discourse including student talking time (or lack of it), the group dynamic, and raters” personal beliefs and practice as threats to validity that the statistical measurements were unable to capture. A new sample rubric and further suggestions for improving the validity of group tutorial assessments are provided.</p>

Change in pelvic incidence between the supine and standing positions in patients with bilateral sacroiliac joint vacuum signs

2021 ◽  
pp. 1-6
Author(s):  
Anthony L. Mikula ◽  
Jeremy L. Fogelson ◽  
Soliman Oushy ◽  
Zachariah W. Pinter ◽  
Pierce A. Peters ◽  
...  
Keyword(s):  
Chart Review ◽  
Pelvic Incidence ◽  
Intraclass Correlation ◽  
Retrospective Chart Review ◽  
Significant Difference ◽  
Spinopelvic Parameter ◽  
Fixed Parameter ◽  
Si Joint ◽  
Post Hoc ◽  
Supine Radiograph

OBJECTIVEPelvic incidence (PI) is a commonly utilized spinopelvic parameter in the evaluation and treatment of patients with spinal deformity and is believed to be a fixed parameter. However, a fixed PI assumes that there is no motion across the sacroiliac (SI) joint, which has been disputed in recent literature. The objective of this study was to determine if patients with SI joint vacuum sign have a change in PI between the supine and standing positions.METHODSA retrospective chart review identified patients with a standing radiograph, supine radiograph, and CT scan encompassing the SI joints within a 6-month period. Patients were grouped according to their SI joints having either no vacuum sign, unilateral vacuum sign, or bilateral vacuum sign. PI was measured by two independent reviewers.RESULTSSeventy-three patients were identified with an average age of 66 years and a BMI of 30 kg/m2. Patients with bilateral SI joint vacuum sign (n = 27) had an average absolute change in PI of 7.2° (p < 0.0001) between the standing and supine positions compared to patients with unilateral SI joint vacuum sign (n = 20) who had a change of 5.2° (p = 0.0008), and patients without an SI joint vacuum sign (n = 26) who experienced a change of 4.1° (p = 0.74). ANOVA with post hoc Tukey test showed a statistically significant difference in the change in PI between patients with the bilateral SI joint vacuum sign and those without an SI joint vacuum sign (p = 0.023). The intraclass correlation coefficient between the two reviewers was 0.97 for standing PI and 0.96 for supine PI (p < 0.0001).CONCLUSIONSPatients with bilateral SI joint vacuum signs had a change in PI between the standing and supine positions, suggesting there may be increasing motion across the SI joint with significant joint degeneration.

scholarly journals Applicability of Dmax Method on Heart Rate Variability to Estimate the Lactate Thresholds in Male Runners

2019 ◽  
Vol 2019 ◽  
pp. 1-9
Author(s):  
Eduardo Marcel Fernandes Nascimento ◽  
Diego Antunes ◽  
Paulo Cesar do Nascimento Salvador ◽  
Fernando Klitzke Borszcz ◽  
Ricardo Dantas de Lucas
Keyword(s):  
Heart Rate ◽  
Heart Rate Variability ◽  
Blood Lactate ◽  
Standard Error ◽  
Intraclass Correlation ◽  
Effect Sizes ◽  
Initial Speed ◽  
Limits Of Agreement ◽  
Aerobic Threshold ◽  
Post Hoc

Introduction. The purpose of this study was to evaluate the application of the Dmax method on heart rate variability (HRV) to estimate the lactate thresholds (LT), during a maximal incremental running test (MIRT). Methods. Nineteen male runners performed two MIRTs, with the initial speed at 8 km·h−1 and increments of 1 km·h−1 every 3 minutes, until exhaustion. Measures of HRV and blood lactate concentrations were obtained, and lactate (LT1 and LT2) and HRV (HRVTDMAX1 and HRVTDMAX2) thresholds were identified. ANOVA with Scheffe’s post hoc test, effect sizes (d), the bias ± 95% limits of agreement (LoA), standard error of the estimate (SEE), Pearson’s (r), and intraclass correlation coefficient (ICC) were calculated to assess validity. Results. No significant differences were observed between HRVTDMAX1 and LT1 when expressed for speed (12.1 ± 1.4 km·h−1 and 11.2 ± 2.1 km·h−1; p=0.55; d = 0.45; r = 0.46; bias ± LoA = 0.8 ± 3.7 km·h−1; SEE = 1.2 km·h−1 (95% CI, 0.9–1.9)). Significant differences were observed between HRVTDMAX2 and LT2 when expressed for speed (12.0 ± 1.2 km·h−1 and 14.1 ± 2.5 km·h−1; p=0.00; d = 1.21; r = 0.48; bias ± LoA = −1.0 ± 1.8 km·h−1; SEE = 1.1 km·h−1 (95% CI, 0.8–1.6)), respectively. Reproducibility values were found for the LT1 (ICC = 0.90; bias ± LoA = −0.7 ± 2.0 km·h−1), LT2 (ICC = 0.97; bias ± LoA = −0.1 ± 1.1 km·h−1), HRVTDMAX1 (ICC = 0.48; bias ± LoA = −0.2 ± 3.4 km·h−1), and HRVTDMAX2 (ICC = 0.30; bias ± LoA = 0.3 ± 3.5 km·h−1). Conclusions. The Dmax method applied over a HRV dataset allowed the identification of LT1 that is close to aerobic threshold, during a MIRT.

Dynamic Footprint Measurement Collection Technique and Intrarater Reliability

2012 ◽  
Vol 102 (2) ◽  
pp. 130-138 ◽  
Author(s):  
Jeanna M. Fascione ◽  
Ryan T. Crews ◽  
James S. Wrobel
Keyword(s):  
Repeated Measures ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Healthy Population ◽  
Intrarater Reliability ◽  
Intraclass Correlation Coefficients ◽  
Foot Posture ◽  
Arch Index ◽  
Post Hoc ◽  
Dynamic Footprint

Background: Identifying the variability of footprint measurement collection techniques and the reliability of footprint measurements would assist with appropriate clinical foot posture appraisal. We sought to identify relationships between these measures in a healthy population. Methods: On 30 healthy participants, midgait dynamic footprint measurements were collected using an ink mat, paper pedography, and electronic pedography. The footprints were then digitized, and the following footprint indices were calculated with photo digital planimetry software: footprint index, arch index, truncated arch index, Chippaux-Smirak Index, and Staheli Index. Differences between techniques were identified with repeated-measures analysis of variance with post hoc test of Scheffe. In addition, to assess practical similarities between the different methods, intraclass correlation coefficients (ICCs) were calculated. To assess intrarater reliability, footprint indices were calculated twice on 10 randomly selected ink mat footprint measurements, and the ICC was calculated. Results: Dynamic footprint measurements collected with an ink mat significantly differed from those collected with paper pedography (ICC, 0.85–0.96) and electronic pedography (ICC, 0.29–0.79), regardless of the practical similarities noted with ICC values (P = .00). Intrarater reliability for dynamic ink mat footprint measurements was high for the footprint index, arch index, truncated arch index, Chippaux-Smirak Index, and Staheli Index (ICC, 0.74–0.99). Conclusions: Footprint measurements collected with various techniques demonstrate differences. Interchangeable use of exact values without adjustment is not advised. Intrarater reliability of a single method (ink mat) was found to be high. (J Am Podiatr Med Assoc 102(2): 130–138, 2012)

Exploring the effect of eye gaze cues on novel L2 morphosyntactic pattern learning

2020 ◽  
pp. 026765831989682
Author(s):  
Dato Abashidze ◽  
Kim McDonough ◽  
Yang Gao
Keyword(s):  
Visual Cues ◽  
Eye Gaze ◽  
Generalization Test ◽  
Pattern Learning ◽  
The Gaze ◽  
Movement Data ◽  
Visual Events ◽  
Static Images ◽  
Post Hoc ◽  
Gaze Cues

Recent research that explored how input exposure and learner characteristics influence novel L2 morphosyntactic pattern learning has exposed participants to either text or static images rather than dynamic visual events. Furthermore, it is not known whether incorporating eye gaze cues into dynamic visual events enhances dual pattern learning. Therefore, this exploratory eye-tracking study examined whether eye gaze cues during dynamic visual events facilitate novel L2 pattern learning. University students ( n = 72) were exposed to 36 training videos with two dual novel morphosyntactic patterns in pseudo-Georgian: completed events ( bich-ma kocn-ul gogoit, ‘boy kissed girl’) and ongoing actions ( bich-su kocn-ar gogoit, ‘boy is kissing girl’). They then carried out an immediate test with 24 items using the same vocabulary words, followed by a generalization test with 24 items created from new vocabulary words. Results indicated that learners who received the eye gaze cues scored significantly higher on the immediate test and relied on the verb cues more than on the noun cues. A post-hoc analysis of eye-movement data indicated that the gaze cues elicited longer looks to the correct images. Findings are discussed in relation to visual cues and novel morphosyntactic pattern learning.

scholarly journals Physiological Compensation for Advanced Bolus Location at Swallow Onset: A Retrospective Analysis in Healthy Seniors

2019 ◽  
Vol 62 (12) ◽  
pp. 4351-4355 ◽  
Author(s):  
Erica G. Herzberg ◽  
Danielle Brates ◽  
Sonja M. Molfenter
Keyword(s):  
Intraclass Correlation ◽  
Barium Swallow ◽  
Bolus Volume ◽  
Posterior Angle ◽  
Linear Mixed Effects ◽  
Main Effect ◽  
Laryngeal Vestibule ◽  
Post Hoc ◽  
Main Effects ◽  
The Relationship

Purpose Previous work has established that advanced bolus location at swallow onset (BLSO) alone is not correlated with an increased swallowing safety risk in healthy seniors. The primary goal of this retrospective study was to examine whether healthy seniors systematically alter their laryngeal vestibule closure reaction time (LVCrt) to maintain a safe swallow in the context of advanced BLSO. The secondary goal was to determine if longer LVCrt distinguished Penetration–Aspiration Scale (PAS; Rosenbek, Robbins, Roecker, Coyle, & Wood, 1996) scores of 1 versus 2. Method Videofluoroscopy studies from 43 healthy seniors (21 men, 22 women; M age = 76.7 years, SD = 7.2) were analyzed. LVCrt was calculated for 3 × 5 ml and 3 × 20 ml thin liquid barium boluses per participant. PAS and BLSO (Modified Barium Swallow Impairment Profile Component 6) were scored for all swallows. Reliability (intraclass correlation coefficient > .75) was established on all measures. A linear mixed-effects regression was run to examine the effect of PAS and BLSO on LVCrt while controlling for bolus volume and repeated swallow trial. Results There was a main effect of BLSO ( F = 4.6, p = .004) and PAS ( F = 29.3, p < .001) on LVCrt. Post hoc pairwise comparisons revealed that LVCrt was significantly faster in BLSO scores of 3 (pyriforms) compared to scores of both 0 (posterior angle of the ramus) and 1 (valleculae). Significantly prolonged LVCrt was observed in PAS scores of 2 in comparison to 1. No significant main effects of bolus volume or trial, or interactions, were observed. Conclusions Our findings suggest that healthy seniors compensate for advanced BLSO by increasing their LVCrt. Furthermore, faster LVCrt was shown to distinguish PAS scores of 1 versus 2. Additional work should explore the relationship between LVCrt, BLSO, and PAS scores in dysphagic populations, specifically those with known sensory impairments.

scholarly journals The sentence repetition task as a measure of sign language proficiency

2021 ◽  
pp. 1-19
Author(s):  
Krister Schönström ◽  
Peter C. Hauser
Keyword(s):  
Sign Language ◽  
Language Proficiency ◽  
Mixed Model ◽  
Linear Mixed Model ◽  
Intraclass Correlation ◽  
Linguistic Knowledge ◽  
Internal Reliability ◽  
Sentence Repetition ◽  
Language Research ◽  
The Impact

Abstract Sign language research is important for our understanding of languages in general and for the impact it has on policy and on the lives of deaf people. There is a need for a sign language proficiency measure, to use as a grouping or continuous variable, both in psycholinguistics and in other sign language research. This article describes the development of a Swedish Sign Language Sentence Repetition Test (STS-SRT) and the evidence that supports the validity of the test’s interpretation and use. The STS-SRT was administered to 44 deaf adults and children, and was shown to have excellent internal reliability (Cronbach’s alpha of 0.915) and inter-rater reliability (Intraclass Correlation Coefficient [ICC] = 0.900, p < .001). A linear mixed model analysis revealed that adults scored 20.2% higher than children, and delayed sign language acquisition were associated with lower scores. As the sign span of sentences increased, participants relied on their implicit linguistic knowledge to scaffold their sentence repetitions beyond rote memory. The results provide reliability and validity evidence to support the use of STS-SRT in research as a measure of STS proficiency.

scholarly journals Show Me More! The Influence of Visibility on Sustainable Food Choices

Foods ◽  
2019 ◽  
Vol 8 (6) ◽  
pp. 186 ◽  
Author(s):  
Nicky Coucke ◽  
Iris Vermeir ◽  
Hendrik Slabbinck ◽  
Anneleen Van Kerckhove
Keyword(s):  
Visual Cues ◽  
Meat Products ◽  
Purchase Behavior ◽  
Post Intervention ◽  
Sustainable Food ◽  
Policy Makers ◽  
Poultry Products ◽  
Display Area ◽  
Store Environment ◽  
Post Hoc

Visual cues are omnipresent in an in-store environment and can enhance the visibility of a product. By using these visual cues, policy makers can design a choice environment to nudge consumers towards more sustainable consumer behavior. In this study, we use a combined nudge of display area size and quantity of displayed products to nudge consumers towards more sustainable meat choices. We performed a field experiment of four weeks in a butchery, located in a supermarket. The size of the display area and quantity of displayed poultry products, serving as the nudging intervention, were increased, whereas these were decreased for less sustainable meat products. In order to evaluate the effectiveness of our nudging intervention, we also collected data from a control store and performed a pre-and post-intervention measurement. We kept records of the sales data of the sold meat (amount of weight & revenue). When conducting a three-way ANOVA and post hoc contrast tests, we found that the sales of poultry increased during the nudging intervention, but did not decrease for less sustainable meat products. When removing the nudge again, the sales of poultry decreased again significantly in the experimental store. Changing the size of display area and the amount of products displayed in this display area created a shift in the consumers’ purchase behavior of meat.

Increasing Altitude and the Optokinetic Cervical Reflex

2021 ◽  
Vol 92 (5) ◽  
pp. 319-325
Author(s):  
Matthew A. Stewart ◽  
Sravan Pingali ◽  
David G. Newman
Keyword(s):  
High Altitude ◽  
Opposite Direction ◽  
Spatial Orientation ◽  
Visual Cues ◽  
Head Tilt ◽  
Flight Simulator ◽  
Visual Environment ◽  
Bank Angle ◽  
Environment Changes ◽  
Post Hoc

INTRODUCTION: When an aircraft banks pilots will reflexively tilt their heads in the opposite direction, known as the optokinetic cervical reflex (OKCR). This is elicited by the appearance of the horizon and is an attempt to keep the moving horizon stable on the pilots retina to help maintain spatial orientation. The appearance of the horizon and the visual environment changes at higher altitudes and there is little research studying the effects of this. Our hypothesis was that increasing altitude would alter the visual cues present and decrease the OKCR.METHODS: There were 16 subjects who flew two flights in a flight simulator while their head tilt, aircraft altitude, and angle of aircraft bank were recorded. The flights were at an altitude of under 1500 ft above ground and above 15,000 ft above ground.RESULTS: Aircraft bank caused head tilt in the opposite direction at both altitudes. A two-way ANOVA with Bonferroni post hoc tests showed that 86% of aircraft bank angles from 0 to 90 in either direction had a head tilt that was statistically significantly smaller at high altitude.DISCUSSION: This study shows that there appears to be a difference between the OKCR at low and high altitude. Pilots at higher altitude seem to exhibit a smaller head tilt for the same aircraft bank angle. More research is required to fully understand why there is a decrease in the OKCR at high altitude, as well as the actual consequences of the decreased reflex on pilot orientation.Stewart MA, Pingali S, Newman DG. Increasing altitude and the optokinetic cervical reflex. Aerosp Med Hum Perform. 2021; 92(5):319325.

scholarly journals APPLYING ITEM RESPONSES THEORY FOR MEASURING STUDENT’S ABILITY IN ACADEMIC SPEAKING

2020 ◽  
Vol 8 (2) ◽  
pp. 305-312
Author(s):  
Memet Sudaryanto ◽  
Kundharu Saddhono ◽  
Lina
Keyword(s):  
Language Proficiency ◽  
Generalizability Theory ◽  
Item Parameter ◽  
Background Information ◽  
Research Approach ◽  
Speaking Test ◽  
Qualitative And Quantitative ◽  
Item Responses ◽  
Proficiency Assessment ◽  
Variance Balance

Purpose of the study: Every human being is required to be skilled at communicating, skilled at expressing thoughts, ideas, and feelings. This research aims to explain student’s ability in academic speaking based on the framework of item responses theory. Methodology: This research uses a mix method research approach; qualitative and quantitative approaches are used together to answer the formulated problems. A qualitative approach is used for digging up information about the needs to develop the speaking test. The try out subjects was 25 university student taking Bahasa Indonesia subject; while 125 students were used as the measurement subject. The data were students’ responses to the speaking test which was scored by two people (rater). The reliability of the instrument was estimated by the Generalizability theory. Rasch model analysis was used to estimate the item parameter; while the Maximum Likelihood was used to estimate the students’ ability. Main Findings: The value of 𝜎 ̂(𝑜) s influenced by the similarity to the average mean score observed in academic speaking. The value of 𝜎 ̂(𝑝) and 𝜎 ̂(𝑜) suggests that the distribution of variability in person and item is the same and high. A sufficiently large value of 𝜎 ̂(𝑝i) implies the fact that the value involves all residual sources for a variance. Balance alternatives, weigh consequently and decide rationally. Applications of this study: Based on the design proposed for the Indonesian Language Proficiency assessment, other generalizability design (G-Design) used is a cross design because each student (p) becomes the object of observation of two observers (r) who both assess four aspects of observation/indicator. It is used to determine the reliability (i.e., reproducibility) of measurements under specific conditions in academic speaking. Novelty/Originality of this study: Some rater qualifications that must be met include the process of gathering and using the appropriateness of background information before assessing. Measuring the ability of students in academic speaking by applying G theory and conducting an IRT analysis approach needs.

Sign in / Sign up

Export Citation Format

Share Document