Increasing the Rigor of Procedural Fidelity Assessment: An Empirical Comparison of Direct Observation and Permanent Product Review Methods

2013 ◽  
Vol 23 (1) ◽  
pp. 60-88 ◽  
Author(s):  
Lisa M. Hagermoser Sanetti ◽  
Melissa A. Collier-Meek
Keyword(s):  
Direct Observation ◽  
Empirical Comparison ◽  
Product Review ◽  
Procedural Fidelity ◽  
Fidelity Assessment

Exploring the Influences of Assessment Method, Intervention Steps, Intervention Sessions, and Observation Timing on Treatment Fidelity Estimates

2019 ◽  
Vol 46 (1) ◽  
pp. 3-13 ◽  
Author(s):  
Melissa A. Collier-Meek ◽  
Lisa M. Sanetti ◽  
Lindsay Fallon ◽  
Sandra Chafouleas
Keyword(s):  
Data Collection ◽  
Direct Observation ◽  
Treatment Fidelity ◽  
Assessment Method ◽  
Self Report ◽  
Group Contingency ◽  
Research Reporting ◽  
Fidelity Assessment ◽  
Implementation Assessment ◽  
Assessment Research

Treatment fidelity data are critical to evaluate intervention effectiveness, yet there are only general guidelines regarding treatment fidelity measurement. Initial investigations have found treatment fidelity data collected via direct observation to be more reliable than data collected via permanent product or self-report. However, the comparison of assessment methods is complicated by the intervention steps accounted for, observation timing, and intervention sessions accounted for, which may impact treatment fidelity estimates. In this study, we compared direct observation and permanent product data to evaluate these varied assessment and data collection decisions on treatment fidelity data estimates in three classrooms engaged in a group contingency intervention. Findings revealed that treatment fidelity estimates, in addition to being different across assessment method, are, in fact, different depending on the intervention steps assessed, intervention sessions accounted for, and observation timing. Implications for treatment fidelity assessment research, reporting in intervention research broadly, and implementation assessment in practice are described.

Assessing the Implementation of the Good Behavior Game: Comparing Estimates of Adherence, Quality, and Exposure

2018 ◽  
Vol 45 (2) ◽  
pp. 95-109 ◽  
Author(s):  
Melissa A. Collier-Meek ◽  
Lindsay M. Fallon ◽  
Emily R. DeFouw
Keyword(s):  
Direct Observation ◽  
Student Outcomes ◽  
Treatment Fidelity ◽  
Assessment Methods ◽  
Exploratory Analysis ◽  
Three Dimensions ◽  
Good Behavior Game ◽  
Observation Window ◽  
Fidelity Assessment

Treatment fidelity assessment is critical to evaluating the extent to which interventions, such as the Good Behavior Game, are implemented as intended and impact student outcomes. The assessment methods by which treatment fidelity data are collected vary, with direct observation being the most popular and widely recommended. The current study presents an exploratory analysis of the differences between fidelity estimates collected through direct observation versus permanent product across three dimensions of treatment fidelity: adherence, quality, and exposure. Findings indicate that direct observation may allow for a more complete estimate of adherence when compared with permanent product, if implementation occurs within the observation window. Quality was only captured via direct observation. Direct observation may not produce adequate estimates of exposure depending on implementation timing. Implications for treatment fidelity assessment are reviewed.

On Expanding the Definition and Use of Procedural Fidelity

2021 ◽  
pp. 154079692110369
Author(s):  
Phil Strain ◽  
Lise Fox ◽  
Erin E. Barton
Keyword(s):  
Child Outcomes ◽  
Scale Up ◽  
Severe Disabilities ◽  
Status Quo ◽  
Significant Progress ◽  
Procedural Fidelity ◽  
Fidelity Assessment ◽  
The Status ◽  
Pyramid Model ◽  
Efficacy Assessment

Although our field has made significant progress in the measurement of procedural fidelity in research studies, we argue for a more nuanced and expansive perspective on procedural fidelity. Specifically, we review the status quo of procedural fidelity measurement in intervention research along with specific suggestions for increasing both precision and focused research on the levels of procedural fidelity that are needed to maximize outcomes for individual participants. Second, we offer an expanded example of procedural fidelity by examining the data on the influence of typical peers, particularly on how the data influence a broad range of skills for individuals with severe disabilities. Finally, we examine the need for multiple layers of procedural fidelity assessment if we are to fully understand the vast array of contextual variables that can influence both procedural fidelity and child outcomes, particularly in a progression of research from initial efficacy assessment through scale-up and replication. We utilize the program-wide implementation of the Pyramid Model for illustrative purposes.

Direct Observation of Heat Exchanger Deposits by Cross Sectioning

1967 ◽  
Vol 25 ◽  
pp. 364-365
Author(s):  
R. W. Anderson ◽  
D. L. Senecal
Keyword(s):  
Electron Microscopy ◽  
Transmission Electron Microscopy ◽  
Heat Exchanger ◽  
Direct Observation ◽  
Cross Sections ◽  
Preparation Method ◽  
Specimen Preparation ◽  
Flowing Water ◽  
Transmission Electron ◽  
Deposit Layer

A problem was presented to observe the packing densities of deposits of sub-micron corrosion product particles. The deposits were 5-100 mils thick and had formed on the inside surfaces of 3/8 inch diameter Zircaloy-2 heat exchanger tubes. The particles were iron oxides deposited from flowing water and consequently were only weakly bonded. Particular care was required during handling to preserve the original formations of the deposits. The specimen preparation method described below allowed direct observation of cross sections of the deposit layers by transmission electron microscopy.The specimens were short sections of the tubes (about 3 inches long) that were carefully cut from the systems. The insides of the tube sections were first coated with a thin layer of a fluid epoxy resin by dipping. This coating served to impregnate the deposit layer as well as to protect the layer if subsequent handling were required.

Application of a Simple Cold Stub to the Direct Observation of Frozen Hydrated Sand

1973 ◽  
Vol 31 ◽  
pp. 212-213
Author(s):  
John M. Wehrung ◽  
Richard J. Harniman
Keyword(s):  
United States ◽  
Surface Water ◽  
Direct Observation ◽  
Controlled Study ◽  
Clay Particles ◽  
Organic Debris ◽  
Rock Formations ◽  
Water Tables ◽  
Permeable Rock ◽  
Natural Means

Water tables in aquifer regions of the southwest United States are dropping off at a rate which is greater than can be replaced by natural means. It is estimated that by 1985 wells will run dry in this region unless adequate artificial recharging can be accomplished. Recharging with surface water is limited by the plugging of permeable rock formations underground by clay particles and organic debris.A controlled study was initiated in which sand grains were used as the rock formation and water with known clay concentrations as the recharge media. The plugging mechanism was investigated by direct observation in the SEM of frozen hydrated sand samples from selected depths.

Direct Observation of the Diffusionless β → β + ω Transformation in Titanium Alloys

1971 ◽  
Vol 29 ◽  
pp. 122-123
Author(s):  
N. E. Paton ◽  
D. de Fontaine ◽  
J. C. Williams
Keyword(s):  
Electron Microscope ◽  
Titanium Alloys ◽  
Direct Observation ◽  
Dark Field ◽  
X Ray Diffraction ◽  
Resistivity Measurements ◽  
Selected Area Electron Diffraction ◽  
Ti Alloys ◽  
Thin Foils ◽  
Field Device

The electron microscope has been used to study the diffusionless β → β + ω transformation occurring in certain titanium alloys at low temperatures. Evidence for such a transformation was obtained by Cometto et al by means of x-ray diffraction and resistivity measurements on a Ti-Nb alloy. The present work shows that this type of transformation can occur in several Ti alloys of suitable composition, and some of the details of the transformation are elucidated by means of direct observation in the electron microscope.Thin foils were examined in a Philips EM-300 electron microscope equipped with a uniaxial tilt, liquid nitrogen cooled, cold stage and a high resolution dark field device. Selected area electron diffraction was used to identify the phases present and the ω-phase was imaged in dark field by using a (101)ω reflection. Alloys were water quenched from 950°C, thinned, and mounted between copper grids to minimize temperature gradients in the foil.

A New 1000kv Electron Microscope

1969 ◽  
Vol 27 ◽  
pp. 100-101
Author(s):  
J.L. Williams ◽  
K. Heathcote ◽  
E.J. Greer
Keyword(s):  
Electron Microscope ◽  
Direct Observation ◽  
High Voltage ◽  
Three Dimensional ◽  
Dimensional Structure ◽  
Specimen Thickness ◽  
Voltage Electron ◽  
High Voltage Electron Microscope ◽  
Dynamic Experiments ◽  
Conventional Instrument

High Voltage Electron Microscope already offers exciting experimental possibilities to Biologists and Materials Scientists because the increased specimen thickness allows direct observation of three dimensional structure and dynamic experiments on effectively bulk specimens. This microscope is designed to give maximum accessibility and space in the specimen region for the special stages which are required. At the same time it provides an ease of operation similar to a conventional instrument.

Direct Observation of Monolayer Zones in Al-wt 4% Cu

1990 ◽  
Vol 48 (1) ◽  
pp. 14-15
Author(s):  
B. Jouffrey ◽  
D. Dorignac ◽  
A. Bourret
Keyword(s):  
Solid Solution ◽  
Synchrotron Radiation ◽  
Direct Observation ◽  
Supersaturated Solid Solution ◽  
Original Model ◽  
X Ray ◽  
Image Position

Since the early works on GP zones and the model independently proposed by Preston and Guinier on the first steps of precipitation in supersaturated solid solution of aluminium containing a few percent of copper, many works have been performed to understand the structure of different stages in the sequence of precipitation.The scheme which is generally admitted can be drawn from a work by Phillips.In their original model Guinier and Preston analysed a GP zone as composed of a single (100) copperrich plane surrounded by aluminum atomic planes with a slightly shorter distance from the original plane than in the solid solution.From X-ray measurements it has also been shown that GP1 zones were not only copper monolayer zones. They could be up to a few atomic planes thick. Different models were proposed by Guinier, Gerold, Toman. Using synchrotron radiation, proposals have been recently made.

Clinical Update: Functional Capacity Evaluations and Disability

1998 ◽  
Vol 3 (2) ◽  
pp. 4-5
Author(s):  
Glenn Pransky
Keyword(s):  
Direct Observation ◽  
Functional Capacity ◽  
Work Capacity ◽  
Functional Capacity Evaluation ◽  
Whole Body ◽  
Validity Of Results ◽  
Job Tasks ◽  
Capacity Evaluation ◽  
Physical Abilities ◽  
The Relationship

Abstract According to the AMA Guides to the Evaluation of Permanent Impairment, a functional capacity evaluation (FCE) measures an individual's physical abilities via a set of activities in a structured setting and provides objective data about the relationship between an impairment and maximal ability to perform work activities. A key distinction between FCEs and self-reported activities of daily living is that the former involve direct observation by professional evaluators. Numerous devices can quantify the physical function of a specific part of the musculoskeletal system but do not address the performance of whole body tasks in the workplace, and these devices have not been shown to predict accurately the ability to perform all but the simplest job tasks. Information about reliability has been proposed as a way to identify magnification and malingering, but variability due to pain and poor comprehension of instructions may cause variations in assessments. Structured work capacity evaluations involve a set of activities but likely underestimate the individual's ability to do jobs that involve complex or varying activities. Job simulations involve direct observation of an individual performing actual job tasks, require a skilled and experienced evaluator, and raise questions about expense, time, objectivity and validity of results, and interpretation of results in terms of the ability to perform specific jobs. To understand the barriers to return to work, examiners must supplement FCEs with information regarding workplace environment, accommodations, and demotivators.

Sign in / Sign up

Export Citation Format

Share Document