Inter- and Intra-rater Reliability in Lithic Analysis: a Case Study in Handedness Determination Methodologies

2019 ◽  
Vol 27 (2) ◽  
pp. 220-244
Author(s):  
Lana Ruck ◽  
Chloe Holden ◽  
Shelby S. J. Putt ◽  
Kathy Schick ◽  
Nicholas Toth
Keyword(s):  
Lithic Analysis ◽  
Rater Reliability

scholarly journals Application of the intervention Complexity Assessment Tool for Systematic Reviews within a Cochrane review: an illustrative case study

2020 ◽  
Vol 3 ◽  
pp. 31
Author(s):  
Cathal A. Cadogan ◽  
Audrey Rankin ◽  
Simon Lewin ◽  
Carmel M. Hughes
Keyword(s):  
Systematic Reviews ◽  
Assessment Tool ◽  
Cochrane Review ◽  
Guidance Document ◽  
Cohen’S Kappa ◽  
Rater Reliability ◽  
Cohen's Kappa ◽  
Holistic Understanding ◽  
Complexity Assessment

Background: The intervention Complexity Assessment Tool for Systematic Reviews (iCAT_SR) has been developed to facilitate detailed assessments of intervention complexity in systematic reviews. Worked examples of the tool’s application are needed to promote its use and refinement. The aim of this case study was to apply the iCAT_SR to a subset of 20 studies included in a Cochrane review of interventions aimed at improving appropriate polypharmacy in older people. Methods: Interventions were assessed independently by two authors using the six core iCAT_SR dimensions: (1) ‘Target organisational levels/categories’; (2) ‘Target behaviour/actions’; (3) ‘Active intervention components’; (4) ‘Degree of tailoring’; (5) ‘Level of skill required by intervention deliverers’; (6) ‘Level of skill required by intervention recipients’. Attempts were made to apply four optional dimensions: ‘Interaction between intervention components’; ‘Context/setting’; ‘Recipient/provider factors’; ‘Nature of causal pathway’. Inter-rater reliability was assessed using Cohen’s Kappa coefficient. Disagreements were resolved by consensus discussion. The findings are presented narratively. Results: Assessments involving the core iCAT_SR dimensions showed limited consistency in intervention complexity across included studies, even when categorised according to clinical setting. Interventions were delivered across various organisational levels and categories (i.e. healthcare professionals and patients) and typically comprised multiple components. Intermediate skill levels were required by those delivering and receiving the interventions across all studies. A lack of detail in study reports precluded application of the iCAT_SR’s optional dimensions. The inter-rater reliability was substantial (Cohen's Kappa = 0.75) Conclusions: This study describes the application of the iCAT_SR to studies included in a Cochrane systematic review. Future intervention studies need to ensure more detailed reporting of interventions, context and the causal pathways underlying intervention effects to allow a more holistic understanding of intervention complexity and facilitate replication in other settings. The experience gained has helped to refine the original guidance document relating to the application of iCAT_SR.

Assessing the reliability of the Outcomes Star in research and practice

2014 ◽  
Vol 17 (4) ◽  
pp. 188-197 ◽  
Author(s):  
Joy Mackeith
Keyword(s):  
Service Providers ◽  
Case Study Method ◽  
Point Scale ◽  
Rater Reliability ◽  
Content Type ◽  
Study Approach ◽  
The Family ◽  
Client Data ◽  
Practical Implications

Purpose – The purpose of this paper is to describe a pilot to test an approach to measuring inter-rater reliability of the Outcomes Star suite of tools. The intention, in publishing this account, is to show transparency in on-going development of the tool, and to invite further co-operative development. Design/methodology/approach – In total, 24 workers, trained to use the first edition Family Star, scored a tested case study. Scoring was analysed using two metrics on the ten-point scale and the underlying five-point Journey of Change. The case study approach and metrics were evaluated for validity and accessibility. Findings – This initial evaluation suggests this edition of the Family Star has good inter-rater reliability for the five-point Journey of Change, reaching the accepted threshold of 0.8 for the inter-rater reliability coefficient when three outlying workers are excluded. The reliability for the full ten point scale was moderate. Research limitations/implications – The sample size of 24 raters is small, though sufficient for an initial test of the approach, which will now be applied to larger samples, using other versions of the Outcomes Star. Practical implications – The findings indicate that it is important that service providers test worker understanding of the scales to ensure consistency of use. The second edition of the Family Star incorporates more precise definitions of the ten-point scales to help improve the reliability. Originality/value – The case study method and metrics provide an accessible measure of reliability, both for Star development and to enable managers to assess the reliability of an organisation's client data for internal and external purposes.

The Genesis and Internal Dynamics of El Salvador's People's Revolutionary Army, 1970–1976

2014 ◽  
Vol 38 (01) ◽  
pp. 102-129
Author(s):  
ALBERTO MARTÍN ÁLVAREZ ◽  
EUDALD CORTINA ORERO
Keyword(s):  
Latin America ◽  
El Salvador ◽  
Early Years ◽  
Left Wing ◽  
Internal Dynamics ◽  
Internal Coherence ◽  
The 1960S

AbstractUsing interviews with former militants and previously unpublished documents, this article traces the genesis and internal dynamics of the Ejército Revolucionario del Pueblo (People's Revolutionary Army, ERP) in El Salvador during the early years of its existence (1970–6). This period was marked by the inability of the ERP to maintain internal coherence or any consensus on revolutionary strategy, which led to a series of splits and internal fights over control of the organisation. The evidence marshalled in this case study sheds new light on the origins of the armed Salvadorean Left and thus contributes to a wider understanding of the processes of formation and internal dynamics of armed left-wing groups that emerged from the 1960s onwards in Latin America.

Culture and the plasticity of perception

2020 ◽  
Vol 43 ◽  
Author(s):  
Michael Lifshitz ◽  
T. M. Luhrmann
Keyword(s):  
Cultural Context ◽  
Sensory Experience ◽  
Cultural Learning ◽  
The World

Abstract Culture shapes our basic sensory experience of the world. This is particularly striking in the study of religion and psychosis, where we and others have shown that cultural context determines both the structure and content of hallucination-like events. The cultural shaping of hallucinations may provide a rich case-study for linking cultural learning with emerging prediction-based models of perception.

Dual systems for all: Higher-order, role-based relational reasoning as a uniquely derived feature of human cognition

2019 ◽  
Vol 42 ◽  
Author(s):  
Daniel J. Povinelli ◽  
Gabrielle C. Glorioso ◽  
Shannon L. Kuznar ◽  
Mateja Pavlic
Keyword(s):  
Temporal Reasoning ◽  
Higher Order ◽  
Important Case ◽  
Human Cognition ◽  
Relational Reasoning ◽  
Dual Systems ◽  
First Order ◽  
Reasoning System ◽  
Role Based

Abstract Hoerl and McCormack demonstrate that although animals possess a sophisticated temporal updating system, there is no evidence that they also possess a temporal reasoning system. This important case study is directly related to the broader claim that although animals are manifestly capable of first-order (perceptually-based) relational reasoning, they lack the capacity for higher-order, role-based relational reasoning. We argue this distinction applies to all domains of cognition.

Sociocultural memory development research drives new directions in gadgetry science

2019 ◽  
Vol 42 ◽  
Author(s):  
Penny Van Bergen ◽  
John Sutton
Keyword(s):  
Episodic Memory ◽  
Autobiographical Memory ◽  
Developmental Psychology ◽  
Cross Cultural ◽  
Memory Development ◽  
Development Research ◽  
Cultural Research ◽  
New Directions ◽  
Cross Cultural Research

Abstract Sociocultural developmental psychology can drive new directions in gadgetry science. We use autobiographical memory, a compound capacity incorporating episodic memory, as a case study. Autobiographical memory emerges late in development, supported by interactions with parents. Intervention research highlights the causal influence of these interactions, whereas cross-cultural research demonstrates culturally determined diversity. Different patterns of inheritance are discussed.

Construction of plastic contact deformation maps on ceramics: a case study on aluminum nitride

1996 ◽  
Vol 54 ◽  
pp. 636-637
Author(s):  
D. L. Callahan
Keyword(s):  
Plastic Deformation ◽  
Aluminum Nitride ◽  
Mechanical Response ◽  
Three Dimensional ◽  
Bright Field Image ◽  
Perfectly Plastic ◽  
Contrast Analysis ◽  
Deformation Patterns

Modern polishing, precision machining and microindentation techniques allow the processing and mechanical characterization of ceramics at nanometric scales and within entirely plastic deformation regimes. The mechanical response of most ceramics to such highly constrained contact is not predictable from macroscopic properties and the microstructural deformation patterns have proven difficult to characterize by the application of any individual technique. In this study, TEM techniques of contrast analysis and CBED are combined with stereographic analysis to construct a three-dimensional microstructure deformation map of the surface of a perfectly plastic microindentation on macroscopically brittle aluminum nitride.The bright field image in Figure 1 shows a lg Vickers microindentation contained within a single AlN grain far from any boundaries. High densities of dislocations are evident, particularly near facet edges but are not individually resolvable. The prominent bend contours also indicate the severity of plastic deformation. Figure 2 is a selected area diffraction pattern covering the entire indentation area.

Sign in / Sign up

Export Citation Format

Share Document