Developing a behavioural marker system for farmer non-technical skills (FLINTS).

2021 ◽  
Author(s):  
Amy Irwin ◽  
Ilinca-Ruxandra Tone ◽  
Nejc Sedlar
Keyword(s):  
Situation Awareness ◽  
Cognitive Skills ◽  
Expert Knowledge ◽  
Technical Skills ◽  
Technical Skill ◽  
Assessment System ◽  
Research Knowledge ◽  
Marker System ◽  
The Social ◽  
Research Findings

Objective: Non-technical skills, the social and cognitive skills thought necessary for safe and effective working, have been studied within the farming context over the past six years. However, these skills are not yet taught as part of a safety curriculum for farmers, due, in part, to a lack of defined framework and assessment system. The current paper describes the development of the FLINTS behavioural marker system for discussion, observation, evaluation and feedback on non-technical skills for farmers.Method: The development of the behavioural marker system proceeded through three key stages. First, the current research knowledge on non-technical skills was synthesised to compile a list of non-technical skill categories and elements. Second, a series of discussion groups with subject matter experts was conducted to develop behavioural markers for each element. Lastly, refinement and review of the system was undertaken by academics and experts.Results: The FLINTS taxonomy containing five non-technical skill categories and 16 elements was produced. The non-technical skill categories comprised situation awareness, teamwork & communication, leadership, task management and decision-making each with specific elements and behavioural markers.Conclusion: FLINTS represents the first behavioural marker system for farmer non-technical skills, constructed through expert knowledge and advice via discussion and review groups, combined with underpinning research findings. This represents the first step towards the development of non-technical training and assessment for farmers. The FLINTS system was produced as a handbook and is freely available to all potential users (https://research.abdn.ac.uk/nts-farming/flints/).

Medical Students’ Non-Technical Skills (Medi-StuNTS): preliminary work developing a behavioural marker system for the non-technical skills of medical students in acute care

2018 ◽  
Vol 5 (3) ◽  
pp. 130-139 ◽  
Author(s):  
Ailsa L Hamilton ◽  
Joanne Kerins ◽  
Marc A MacCrossan ◽  
Victoria R Tallentire
Keyword(s):  
Medical Students ◽  
Acute Care ◽  
Situation Awareness ◽  
Rating Scale ◽  
Medical Training ◽  
Poor Performance ◽  
Technical Skills ◽  
Face Validity ◽  
Self Awareness ◽  
Marker System

IntroductionGood non-technical skills (NTS) are critical to the delivery of high-quality patient care. It is increasingly recognised that training in such skills should be incorporated into primary medical training curricula. This study aimed to develop an NTS behavioural marker system (BMS), specifically applicable to medical students, for use within simulated acute care scenarios.MethodsThe methodology used to develop other BMS was adopted and modified. Following ethical approval, 16 final year medical students participated in acute care simulated scenarios. Semistructured interviews were performed to gauge the understanding of NTS. A panel meeting of subject matter experts was convened to translate key NTS into skill elements and observable behaviours. A second expert panel was consulted to refine aspects of the BMS. Further refinement and initial face validity was undertaken by a third panel of experts using the prototype BMS to observe prerecorded simulation scenarios.ResultsFive categories of NTS were identified: situation awareness, teamwork and communication, decision-making and prioritisation, self-awareness, and escalating care. Observable behaviours in each category describe good and poor performance. Escalating care was identified as a unique component that incorporated behaviours related to each of the other four skill categories. A 5-point rating scale was developed to enable both peer-to-peer and tutor-to–student feedback.ConclusionThe Medi-StuNTS (Medical Students’ Non-Technical Skills) system is the first BMS for the NTS of medical students. It reinforces the importance of escalating care effectively. It provides an exciting opportunity to provide feedback to medical students and may ultimately aid their preparedness for professional practice.

Validity of the Medi-StuNTS behavioural marker system: assessing the non-technical skills of medical students during immersive simulation

2020 ◽  
Vol 7 (1) ◽  
pp. 3-10 ◽  
Author(s):  
Emma Claire Phillips ◽  
Samantha Eve Smith ◽  
Benjamin Clarke ◽  
Ailsa Lauren Hamilton ◽  
Joanne Kerins ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Acute Care ◽  
Situation Awareness ◽  
Test Performance ◽  
Technical Skills ◽  
Strong Positive Correlation ◽  
Marker System ◽  
Significant Difference ◽  
Better Than

BackgroundThe Medical Students’ Non-Technical Skills (Medi-StuNTS) behavioural marker system (BMS) is the first BMS to be developed specifically for medical students to facilitate training in non-technical skills (NTS) within immersive simulated acute care scenarios. In order to begin implementing the tool in practice, validity evidence must be sought. We aimed to assess the validity of the Medi-StuNTS system with reference to Messick’s contemporary validity framework.MethodsTwo raters marked video-recorded performances of acute care simulation scenarios using the Medi-StuNTS system. Three groups were marked: third-year and fourth-year medical students (novices), final-year medical students (intermediates) and core medical trainees (experts). The scores were used to make assessments of relationships to the variable of clinical experience through expert–novice comparisons, inter-rater reliability, observability, exploratory factor analysis, inter-rater disagreements and differential item functioning.ResultsA significant difference was found between the three groups (p<0.005), with experts scoring significantly better than intermediates (p<0.005) and intermediates scoring significantly better than novices (p=0.001). There was a strong positive correlation between the two raters’ scores (r=0.79), and an inter-rater disagreement of more than one point in less than one-fifth of cases. Across all scenarios, 99.7% of skill categories and 84% of skill elements were observable. Factor analysis demonstrated appropriate grouping of skill elements. Inconsistencies in test performance across learner groups were shown specifically in the skill categories of situation awareness and decision making and prioritisation.ConclusionWe have demonstrated evidence for several aspects of validity of the Medi-StuNTS system when assessing medical students’ NTS during immersive simulation. We can now begin to introduce this system into simulation-based education to maximise NTS training in this group.

Building research capacity and capabilities in Fiji: are we there yet?

2020 ◽  
Vol 21 (5) ◽  
pp. 265-271
Author(s):  
Jyotishna Mudaliar ◽  
Bridget Kool ◽  
Janice Natasha ◽  
Judith McCool
Keyword(s):  
Low Income ◽  
Research Capacity ◽  
Research Knowledge ◽  
Research Skills ◽  
Research Findings ◽  
Access And Quality ◽  
The University ◽  
Local Investigator ◽  
Research Capacity Development

Introduction: A barrier to local investigator-led research in low income settings, is the limited availability of personnel with appropriate research skills or qualifications to conduct the type of research required for evidence-informed policy making to improve access and quality of health care. In response to this, Fiji National University’s College of Medicine, Nursing and Health Sciences in Fiji, collaborated with academics based at the University of Auckland, New Zealand to deliver a series of research capacity development workshops in Fiji. Methods: Participants who attended any of the nine workshops (n=123) were contacted via email to take part in a brief survey regarding their perceptions of the effectiveness of the research capacity building workshops. Of the possible 123 participants, 80% (n=76) completed the questionnaire.  Results: Findings demonstrate that the majority of participants reported that they had gained research skills from the workshops (75%) including proposal development skills (68%) and knowledge of appropriate research methods (59%). Furthermore, 70% agreed that the workshops built their research confidence.  Since attending a workshop, 18% of respondents had successfully applied and received funding for research grants and/or fellowships.  Barriers to conduct research included workload (75%), lack of research knowledge, experience or skills (51%), and lack of institutional support (41%). Suggestions for future workshops included: more focus on data analysis, regular courses rather than ‘one offs’, and preparation of research findings (e.g. publications). Conclusion: Our findings indicate that research workshops of this nature may increase individual research capabilities but sustained, locally led initiatives, backed by institutional and supplementary technical support are essential.

Debriefing Surgeons on Non-Technical Skills in the Operating Room - Results from a Pilot Study

2007 ◽  
Vol 51 (11) ◽  
pp. 663-667
Author(s):  
S. Yule ◽  
R. Flin ◽  
N. Maran ◽  
D. Rowley ◽  
G. Youngson ◽  
...  
Keyword(s):  
Operating Room ◽  
Cognitive Skills ◽  
Technical Skills ◽  
Assessment Tools ◽  
Valuable Adjunct ◽  
Surgical Trainees ◽  
Operative Surgery ◽  
Enhance Patient Safety ◽  
Behaviour Rating ◽  
Current Assessment

Briefing and debriefing are common practices for safety in high risk industries but are not systematically done in surgery. Regular debriefing of performance after operative surgery can greatly assist surgical trainees' development and help optimize learning from the limited time they spend in the Operating Room (OR). We developed and tested the NOTSS (Non-Technical Skills for Surgeons) behaviour rating system with subject matter experts. It allows surgeons to observe trainees' behaviour in the OR and provide them with structured feedback for improvement. This paper describes process of debriefing and the results of a pilot usability trial. The majority of participants reported that the NOTSS system was useful for debriefing trainees, provided a common language to discuss non-technical skills, and was a valuable adjunct to current assessment tools. Some surgeons found interpersonal skills more difficult to rate than cognitive skills. 73% felt that routine use of the system would enhance patient safety.

scholarly journals Are you really using Yarning research? Mapping Social and Family Yarning to strengthen Yarning research quality

2021 ◽  
pp. 117718012110154
Author(s):  
Petah Atkinson ◽  
Marilyn Baird ◽  
Karen Adams
Keyword(s):  
Research Method ◽  
Research Question ◽  
Research Quality ◽  
Aboriginal Community ◽  
Participant Recruitment ◽  
The Social ◽  
Research Findings ◽  
Convenience Sampling ◽  
Missing Feature ◽  
Published Research

Yarning as a research method has its grounding as an Aboriginal culturally specified process. Significant to the Research Yarn is relationality, however; this is a missing feature of published research findings. This article aims to address this. The research question was, what can an analysis of Social and Family Yarning tell us about relationality that underpins a Research Yarn. Participant recruitment occurred using convenience sampling, and data collection involved Yarning method. Five steps of data analysis occurred featuring Collaborative Yarning and Mapping. Commonality existed between researcher and participants through predominantly experiences of being a part of Aboriginal community, via Aboriginal organisations and Country. This suggests shared explicit and tacit knowledge and generation of thick data. Researchers should report on their experience with Yarning, the types of Yarning they are using, and the relationality generated from the Social, Family and Research Yarn.

Objective Measures of Surgeon Nontechnical Skills in Surgery: A Scoping Review

2021 ◽  
pp. 001872082199531
Author(s):  
Jackie S. Cha ◽  
Denny Yu
Keyword(s):  
Situation Awareness ◽  
Cognitive Skills ◽  
Behavioral Science ◽  
Assessment Tools ◽  
Objective Measures ◽  
Communication Model ◽  
Eligibility Criteria ◽  
Surgical Performance ◽  
Nontechnical Skills ◽  
Objective Metrics

Objective The purpose of this study was to identify, synthesize, and discuss objective behavioral or physiological metrics of surgeons’ nontechnical skills (NTS) in the literature. Background NTS, or interpersonal or cognitive skills, have been identified to contribute to safe and efficient surgical performance; however, current assessments are subjective, checklist-based tools. Intraoperative skill evaluation, such as technical skills, has been previously utilized as an objective measure to address such limitations. Methods Five databases in engineering, behavioral science, and medicine were searched following PRISMA reporting guidelines. Eligibility criteria included studies with NTS objective measurements, surgeons, and took place within simulated or live operations. Results Twenty-three articles were included in this review. Objective metrics included communication metrics and measures from physiological responses such as changes in brain activation and motion of the eye. Frequencies of content-coded communication in surgery were utilized in 16 studies and were associated with not only the communication construct but also cognitive constructs of situation awareness and decision making. This indicates the underlying importance of communication in evaluating the NTS constructs. To synthesize the scoped literature, a framework based on the one-way communication model was used to map the objective measures to NTS constructs. Conclusion Objective NTS measurement of surgeons is still preliminary, and future work on leveraging objective metrics in parallel with current assessment tools is needed. Application Findings from this work identify objective NTS metrics for measurement applications in a surgical environment.

scholarly journals Agricultural Land Suitability Assessment Using Satellite Remote Sensing-Derived Soil-Vegetation Indices

Land ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 223
Author(s):  
Rubaiya Binte Mostafiz ◽  
Ryozo Noguchi ◽  
Tofael Ahamed
Keyword(s):  
Remote Sensing ◽  
Satellite Remote Sensing ◽  
Agricultural Land ◽  
Expert Knowledge ◽  
Vegetation Indices ◽  
Land Suitability ◽  
Assessment System ◽  
Yield Estimation ◽  
Suitability Assessment ◽  
Land Suitability Assessment

Satellite remote sensing technologies have a high potential in applications for evaluating land conditions and can facilitate optimized planning for agricultural sectors. However, misinformed land selection decisions limit crop yields and increase production-related costs to farmers. Therefore, the purpose of this research was to develop a land suitability assessment system using satellite remote sensing-derived soil-vegetation indicators. A multicriteria decision analysis was conducted by integrating weighted linear combinations and fuzzy multicriteria analyses in a GIS platform for suitability assessment using the following eight criteria: elevation, slope, and LST vegetation indices (SAVI, ARVI, SARVI, MSAVI, and OSAVI). The relative priorities of the indicators were identified using a fuzzy expert system. Furthermore, the results of the land suitability assessment were evaluated by ground truthed yield data. In addition, a yield estimation method was developed using indices representing influential factors. The analysis utilizing equal weights showed that 43% of the land (1832 km2) was highly suitable, 41% of the land (1747 km2) was moderately suitable, and 10% of the land (426 km2) was marginally suitable for improved yield productions. Alternatively, expert knowledge was also considered, along with references, when using the fuzzy membership function; as a result, 48% of the land (2045 km2) was identified as being highly suitable; 39% of the land (2045 km2) was identified as being moderately suitable, and 7% of the land (298 km2) was identified as being marginally suitable. Additionally, 6% (256 km2) of the land was described as not suitable by both methods. Moreover, the yield estimation using SAVI (R2 = 77.3%), ARVI (R2 = 68.9%), SARVI (R2 = 71.1%), MSAVI (R2 = 74.5%) and OSAVI (R2 = 81.2%) showed a good predictive ability. Furthermore, the combined model using these five indices reported the highest accuracy (R2 = 0.839); this model was then applied to develop yield prediction maps for the corresponding years (2017–2020). This research suggests that satellite remote sensing methods in GIS platforms are an effective and convenient way for agricultural land-use planners and land policy makers to select suitable cultivable land areas with potential for increased agricultural production.

Objective structured assessment of technical skill in temporal bone dissection: validation of a novel tool

2021 ◽  
pp. 1-11
Author(s):  
M Stavrakas ◽  
G Menexes ◽  
S Triaridis ◽  
P Bamidis ◽  
J Constantinidis ◽  
...  
Keyword(s):  
Temporal Bone ◽  
Rating Scale ◽  
Assessment Tool ◽  
Three Dimensional ◽  
Technical Skills ◽  
Technical Skill ◽  
Global Rating Scale ◽  
Global Rating ◽  
Validity And Reliability ◽  
Cortical Mastoidectomy

Abstract Objective This study developed an assessment tool that was based on the objective structured assessment for technical skills principles, to be used for evaluation of surgical skills in cortical mastoidectomy. The objective structured assessment of technical skill is a well-established tool for evaluation of surgical ability. This study also aimed to identify the best material and printing method to make a three-dimensional printed temporal bone model. Methods Twenty-four otolaryngologists in training were asked to perform a cortical mastoidectomy on a three-dimensional printed temporal bone (selective laser sintering resin). They were scored according to the objective structured assessment of technical skill in temporal bone dissection tool developed in this study and an already validated global rating scale. Results Two external assessors scored the candidates, and it was concluded that the objective structured assessment of technical skill in temporal bone dissection tool demonstrated some main aspects of validity and reliability that can be used in training and performance evaluation of technical skills in mastoid surgery. Conclusion Apart from validating the new tool for temporal bone dissection training, the study showed that evolving three-dimensional printing technologies is of high value in simulation training with several advantages over traditional teaching methods.

scholarly journals Specialist Knowledge Practices of Craftsmen and Clerics in Senegal

Africa ◽  
2009 ◽  
Vol 79 (1) ◽  
pp. 53-70 ◽  
Author(s):  
Roy Dilley
Keyword(s):  
Knowledge Acquisition ◽  
Expert Knowledge ◽  
Social Processes ◽  
Social Consequences ◽  
Specialized Knowledge ◽  
Knowledge Practices ◽  
Hierarchical Relations ◽  
The Social ◽  
Specialist Knowledge ◽  
Relations Of Power

This article examines the specialized knowledge practices of two sets of culturally recognized ‘experts’ in Senegal: Islamic clerics and craftsmen. Their respective bodies of knowledge are often regarded as being in opposition, and in some respects antithetical, to one another. The aim of this article is to examine this claim by means of an investigation of how knowledge is conceived by each party. The analysis attempts to expose local epistemologies, which are deduced from an investigation of ‘expert’ knowledge practices and indigenous claims to knowledge. The social processes of knowledge acquisition and transmission are also examined with reference to the idea of initiatory learning. It is in these areas that commonalities between the bodies of knowledge and sets of knowledge practices are to be found. Yet, despite parallels between the epistemologies of both bodies of expertise and between their respective modes of knowledge transmission, the social consequences of ‘expertise’ are different in each case. The hierarchical relations of power that inform the articulation of the dominant clerics with marginalized craftsmen groups serve to profile ‘expertise’ in different ways, each one implying its own sense of authority and social range of legitimacy.

Investigating the role of Non-Technical Skills in Railway Traffic Operations through Expert Knowledge Elicitation

2021 ◽  
Vol 65 (1) ◽  
pp. 262-266
Author(s):  
Iga Jarosz* ◽  
Julia Lo ◽  
Jan Lijs
Keyword(s):  
Traffic Control ◽  
Expert Knowledge ◽  
Skill Training ◽  
Technical Skills ◽  
Knowledge Elicitation ◽  
Protective Function ◽  
Nontechnical Skills ◽  
Railway Traffic ◽  
The One ◽  
Expert Classification

Many high-risk industries identify non-technical skills as safety-critical abilities of the operational staff that have a protective function against human fallibility. Based on an established non-technical skills classification system, methods for expert knowledge elicitation were used to describe non-technical skills in the specific context of train traffic control in the Netherlands. The findings offer insights regarding the skill importance for good operational outcomes, skill difficulty, categorization, and attitudes based on subject matter experts’ opinions. Substantial overlap between the employed non-technical skills framework and the observed expert classification was found, which might indicate that the experts utilize a mental model of nontechnical skills similar to the one used. Furthermore, considerations concerning the organizational culture and the attitudes towards change provide a promising outlook when introducing novel solutions to non-technical skill training and assessment.

Sign in / Sign up

Export Citation Format

Share Document