Satisfaction of what? Post hoc versus real‐time construct validity

Abstract Few studies have examined the relative effectiveness of reinforcing versus aversive consequences at changing behavior in real-world environments. Real-time sensing devices makes it easier to investigate such questions, offering the potential to improve both intervention outcomes and theory. This research aims to describe the development of a real-time, operant theory-based secondhand smoke (SHS) intervention and compare the efficacy of aversive versus aversive plus reinforcement contingency systems. Indoor air particle monitors were placed in the households of 253 smokers for approximately three months. Participants were assigned to a measurement-only control group (N = 129) or one of the following groups: 1.) aversive only (AO, N = 71), with aversive audio/visual consequences triggered by the detection of elevated air particle measurements, or 2.) aversive plus reinforcement (AP, N = 53), with reinforcing consequences contingent on the absence of SHS added to the AO intervention. Residualized change ANCOVA analysis compared particle concentrations over time and across groups. Post-hoc pairwise comparisons were also performed. After controlling for Baseline, Post-Baseline daily particle counts (F = 6.42, p = 0.002), % of time >15,000 counts (F = 7.72, p < 0.001), and daily particle events (F = 4.04, p = 0.02) significantly differed by study group. Nearly all control versus AO/AP pair-wise comparisons were statistically significant. No significant differences were found for AO versus AP groups. The aversive feedback system reduced SHS, but adding reinforcing consequences did not further improve outcomes. The complexity of real-world environments requires the nuances of these two contingency systems continue to be explored, with this study demonstrating that real-time sensing technology can serve as a platform for such research.

Download Full-text

The Substrate-Independence Theory: Advancing Constructor Theory to Scaffold Substrate Attributes for the Recursive Interaction between Knowledge and Information

Systems ◽

10.3390/systems10010007 ◽

2022 ◽

Vol 10 (1) ◽

pp. 7

Author(s):

John Turner ◽

Dave Snowden ◽

Nigel Thurlow

Keyword(s):

Real Time ◽

Complex Adaptive Systems ◽

Adaptive Systems ◽

Structure Learning ◽

Social Systems ◽

Complex Environments ◽

External Threats ◽

Complex Adaptive ◽

Construction Tasks ◽

Post Hoc

The substrate-independence theory utilizes sensemaking techniques to provide cognitively based scaffolds that guide and structure learning. Scaffolds are cognitive abstractions of constraints that relate to information within a system. The substrate-independence theory concentrates on the flow of information as the underlying property of the host system. The substrate-independence theory views social systems as complex adaptive systems capable of repurposing their structure to combat external threats by utilizing constructors and substrates. Constructor theory is used to identify potential construction tasks, the legitimate input and output states that are possible, to map the desired change in the substrate’s attributes. Construction tasks can be mapped in advance for ordered and known environments. Construction tasks may also be mapped in either real-time or post hoc for unordered and complex environments using current sensemaking techniques. Mapping of the construction tasks in real-time becomes part of the landscape, and scaffolds are implemented to aid in achieving the desired state or move to a more manageable environment (e.g., from complex to complicated).

Download Full-text

Validation of an Instrument for Real-Time Assessment of Neonatal Intubation Skills: A Randomized Controlled Simulation Study

American Journal of Perinatology ◽

10.1055/s-0040-1715530 ◽

2020 ◽

Author(s):

Lindie J.M.K. Kuijpers ◽

Mathijs Binkhorst ◽

Nicole K. Yamada ◽

Romy N. Bouwmeester ◽

Arno F.J. van Heijst ◽

...

Keyword(s):

Construct Validity ◽

Real Time ◽

Simulation Study ◽

Intraclass Correlation ◽

Intervention Group ◽

Control Group ◽

Validity And Reliability ◽

Patient Simulator ◽

Randomized Controlled ◽

Time Assessment

Objective This study aimed to evaluate the construct validity and reliability of real-time assessment of a previously developed neonatal intubation scoring instrument (NISI). Study Design We performed a randomized controlled simulation study at a simulation-based research and training facility. Twenty-four clinicians experienced in neonatal intubation (“experts”) and 11 medical students (“novices”) performed two identical elective intubations on a neonatal patient simulator. Subjects were randomly assigned to either the intervention group, receiving predefined feedback between the two intubations, or the control group, receiving no feedback. Using the previously developed NISI, all intubations were assessed, both in real time and remotely on video. Construct validity was evaluated by (1) comparing the intubation performances, expressed as percentage scores, with and without feedback, and (2) correlating the intubation performances with the subjects' level of experience. The intrarater reliability, expressed as intraclass correlation coefficient (ICC), of real-time assessment compared with video-based assessment was determined. Results The intervention group contained 18 subjects, the control group 17. Background characteristics and baseline intubation scores were comparable in both groups. The median (IQR) change in percentage scores between the first and second intubation was significantly different between the intervention and control group (11.6% [4.7–22.8%] vs. 1.4% [0.0–5.7%], respectively; p = 0.013). The 95% CI for this 10.2% difference was 2.2 to 21.4%. The subjects' experience level correlated significantly with their percentage scores (Spearman's R = 0.70; p <0.01). ICC's were 0.95 (95% CI: 0.89–0.97) and 0.94 (95% CI: 0.89–0.97) for the first and second intubation, respectively. Conclusion Our NISI has construct validity and is reliable for real-time assessment. Key Points

Download Full-text

Continuous, Real-Time, Noninvasive Hemodynamic Cardiac Doppler Monitoring With a Novel Hands-Free Device: A Feasibility Study Compared to Standard Echo

Journal of Medical Devices ◽

10.1115/1.4036024 ◽

2017 ◽

Vol 11 (3) ◽

Author(s):

Gilead I. Lancaster ◽

Ilan Hay ◽

Michael Eldar

Keyword(s):

Blood Flow ◽

Diastolic Function ◽

Real Time ◽

Tissue Doppler ◽

Hemodynamic Parameters ◽

Myocardial Wall ◽

Cardiac Hemodynamics ◽

Technical Issues ◽

Post Hoc ◽

Cardiac Doppler

This study sought to determine the feasibility of using noninvasive cardiac hemodynamics (NICHE), a new noninvasive Doppler-based device, to monitor real-time, simultaneous tissue and blood-flow Doppler measurements in a clinical setting, and to obtain preliminary performance data compared to a commercially available system. Doppler-based measurements have been shown to correlate well with invasive hemodynamic data and diastolic function, but their use in clinical applications has been limited by various technical issues. The NICHE device was developed to obtain simultaneous tissue and blood-flow Doppler measurements automatically, in real-time and in a hands-free manner. Thirty participants (ten normal volunteers and 20 patients in a cardiac rehab program) underwent standard echocardiographic/Doppler studies followed immediately by NICHE monitoring. Early diastolic transmitral blood-flow velocity (E) and tissue Doppler myocardial wall velocity during early relaxation (E′) were acquired using a standard echo device; and E/E′ was derived post hoc. NICHE measurements included E, E′, and directly measured instantaneous E/E′. NICHE was successfully used in 28 participants. Measurements of ENICHE ranged from 40 cm/s to over 120 cm/s and correlated well with Eecho (R = 0.93). ENICHE′ ranged from 2 to 23 cm/s and correlated well with the averaged Eecho′ (R = 0.91). Directly measured E/ENICHE′ ratios ranged from 3 to 23 and correlated well with derived E/Eecho′ (R = 0.91). The NICHE device can monitor patients in a hands-free manner and can supply real-time Doppler derived measurements of hemodynamic parameters and diastolic function that correlate well with measurements from standard echo devices.

Download Full-text

Influencing Anesthesia Provider Behavior Using Anesthesia Information Management System Data for Near Real-Time Alerts and Post Hoc Reports

Anesthesia & Analgesia ◽

10.1213/ane.0000000000001038 ◽

2015 ◽

Vol 121 (5) ◽

pp. 1404

Keyword(s):

Real Time ◽

Information Management ◽

Management System ◽

Information Management System ◽

Anesthesia Provider ◽

Anesthesia Information Management System ◽

Provider Behavior ◽

System Data ◽

Post Hoc

Download Full-text

Neuromedin B Receptor Antagonist Suppresses Pomc Expression in AtT-20 Cells and Human Corticotroph Adenoma Cells

Journal of the Endocrine Society ◽

10.1210/jendso/bvab048.1113 ◽

2021 ◽

Vol 5 (Supplement_1) ◽

pp. A546-A547

Author(s):

Tomonori Sekizaki ◽

Hiraku Kameda ◽

Akinobu Nakamura ◽

Hiroshi Nomoto ◽

Kyu Yong Cho ◽

...

Keyword(s):

Cell Proliferation ◽

Pituitary Adenoma ◽

Mrna Expression ◽

Real Time ◽

Hormone Secretion ◽

Corticotroph Adenoma ◽

Adenoma Cell ◽

Pomc Mrna ◽

Post Hoc ◽

Real Time Qpcr

Abstract Objective: We previously reported that Neuromedin B (NMB) is expressed in murine pituitary corticotrophs under adrenal insufficiency (1). Because NMB is also expressed in several cancer cells and stimulates ACTH secretion, we hypothesized that NMB is related to corticotroph adenoma cell proliferation and hormone secretion. To examine this hypothesis, we investigated the expression of NMB and its receptor NMBR in human corticotroph adenoma and the effects of a NMBR antagonist on AtT-20 cells, a mouse corticotroph adenoma cell line, and patient-derived corticotroph adenoma cells. Methods: 1. NMB and NMBR expression in human pituitary adenoma: We performed real-time qPCR and immunostaining on human pathological specimens of corticotrophs, somatotrophs, and non-functioning pituitary adenoma to investigate NMB and NMBR expression. 2. Experiments in AtT-20 cells: We extracted mRNAs and proteins from AtT-20 cells after incubation with 100nM NMBR antagonist PD168368, and performed real-time qPCR and western blotting analyses to investigate Pomc expression. 3. Experiments in patient-derived corticotroph adenoma cells: We isolated surgically resected human corticotroph adenoma cells from patients who underwent trans-sphenoidal surgery and investigated POMC mRNA expression by real-time qPCR after incubation with PD168368. Statistical analysis: One-way ANOVA was employed to compare values among multiple groups. If the ANOVA revealed significant differences, the Tukey-Kramer post-hoc test was employed to compare values between two specific groups. Dunnett’s post-hoc test was employed to compare values with the control group. Statistical significance was defined as p < 0.05. Results: 1. NMB and NMBR expression levels were significantly higher in human corticotroph adenoma (13 and 33 times higher than non-functioning adenoma, respectively) than in somatotroph adenoma (2 and 3 times higher than non-functioning adenoma, respectively) and non-functioning adenoma in the qPCR analyses. Immunostaining confirmed higher expression of NMB and NMBR in corticotroph adenoma than in somatotroph and non-functioning adenoma. 2. Treatment with 100 nM PD168368 significantly suppressed Pomc mRNA and protein expression in AtT-20 cells by 22%±3% and 25%±10%, respectively. 3. Treatment with 1 µM PD168368 significantly suppressed POMC mRNA expression in human corticotroph adenoma cells by 18%±1%. Conclusions: NMB and NMBR were both expressed in human corticotroph adenoma, suggesting that NMB may stimulate adenoma cell proliferation and hormone secretion in autocrine or paracrine manners. Because the NMBR antagonist suppressed Pomc expression in both AtT-20 cells and human corticotroph adenoma cells, it may represent a potential treatment for Cushing disease. Reference: (1) Kameda H et al., Endocrinology 2014;155(7):2492-9.

Download Full-text

Reliable variant calling during runtime of Illumina sequencing

10.1101/387662 ◽

2018 ◽

Cited By ~ 1

Author(s):

Tobias P. Loka ◽

Simon H. Tausch ◽

Bernhard Y. Renard

Keyword(s):

Real Time ◽

Disease Outbreaks ◽

Variant Calling ◽

Read Mapping ◽

Mapping Algorithm ◽

Infectious Disease Outbreaks ◽

Whole Exome ◽

Similar Accuracy ◽

Post Hoc

AbstractThe sequential paradigm of data acquisition and analysis in next-generation sequencing leads to high turnaround times for the generation of interpretable results. We combined a novel real-time read mapping algorithm with fast variant calling to obtain reliable variant calls still during the sequencing process. Thereby, our new algorithm allows for accurate read mapping results for intermediate cycles and supports large reference genomes such as the complete human reference. This enables the combination of real-time read mapping results with complex follow-up analysis. In this study, we showed the accuracy and scalability of our approach by applying real-time read mapping and variant calling to seven publicly available human whole exome sequencing datasets. Thereby, up to 89% of all detected SNPs were already identified after 40 sequencing cycles while showing similar precision as at the end of sequencing. Final results showed similar accuracy to those of conventional post-hoc analysis methods. When compared to standard routines, our live approach enables considerably faster interventions in clinical applications and infectious disease outbreaks. Besides variant calling, our approach can be adapted for a plethora of other mapping-based analyses.

Download Full-text

iCatcher: A Neural Network Approach for Automated Coding of Young Children’s Eye Movements

10.31234/osf.io/6ysu9 ◽

2021 ◽

Author(s):

Yotam Erel ◽

Christine Potter ◽

Sagi Jaffe-Dax ◽

Casey Lew-Williams ◽

Amit Bermano

Keyword(s):

Neural Network ◽

Real Time ◽

Gaze Estimation ◽

Data Loss ◽

Low Resolution ◽

Large Dataset ◽

Neural Network Approach ◽

Real Time Processing ◽

Automated Coding ◽

Post Hoc

Infants’ looking behaviors are often used for measuring attention, real-time processing, and learning – often using low-resolution videos. Despite the ubiquity of gaze-related methods in developmental science, current techniques usually involve laborious post hoc coding, imprecise real-time coding, or expensive eye trackers that may increase data loss and require a calibration phase. As a solution, we used computer-vision methods to perform automatic gaze estimation from low-resolution videos. At the core of this approach is an artificial neural network that classifies gaze directions in real time. We tested our method, called iCatcher, on data collected using the looking-while-listening procedure, where infants look at one of two locations on a screen. Using a large dataset of manually-annotated videos from prior research, we demonstrate that the accuracy of iCatcher approximates that of human annotators and replicates the results. Our method is publicly available as an open-source repository at https://github.com/yoterel/iCatcher.

Download Full-text

Test re-test reliability and construct validity of the star-track test of manual dexterity

10.7287/peerj.preprints.683 ◽

2014 ◽

Author(s):

Niels Kildebro ◽

Ilda Amirian ◽

Ismail Gögenur ◽

Jacob Rosenberg

Keyword(s):

Construct Validity ◽

Repeated Measures ◽

Manual Dexterity ◽

Test Reliability ◽

University Hospital ◽

Controlled Study ◽

Validity Study ◽

Study Test ◽

Post Hoc ◽

Track Test

Objectives: To determine test re-test reliability and construct validity of the star-track test of manual dexterity. Design: Test re-test reliability was tested in a controlled study. Construct validity was tested in a blinded randomized crossover study. Setting: The study was performed at a university hospital in Denmark.Participants: A total of 11 subjects for test re-test and 20 subjects for the construct validity study were included. All were healthy volunteers. Intervention: The test re-test trial had two measurements with 2 days pause in between. The interventions in the construct validity study included baseline measurement, intervention 1: fatigue, intervention 2: stress, and intervention 3: fatigue and stress. There was a 2 day pause between each intervention. Main outcome measure: Integrated measure of completion time and number of errors. Results: All participants completed the study (test re-test n = 11; construct validity n=20). Test re-test showed a strong Pearson product-moment correlation (r= 0.90, n= 11, P < 0.01) with no sign of learning effect. The 20 subjects in the construct validity trial were randomized to the order of the four interventions, so that all subjects completed each intervention once. A repeated measures ANOVA determined that mean integrated measure differed between interventions (p = 0.003). Post hoc tests using Bonferroni correction revealed that compared with baseline all interventions had significantly higher integrated scores ranging from 47-59% difference in mean. Conclusion: The star track test of manual dexterity had a strong test re-test reliability, and was able to discriminate between a subject´s normal manual dexterity and dexterity after exposure to fatigue and/or stress.

Download Full-text