Analyzing Evidence

Author(s):  
Jacqueline M. Dewar

Chapter 7 focuses on two methods for analyzing qualitative data: rubrics and content analysis or coding. Rubrics facilitate the assessment of separate aspects of a complex task. A rubric with dimensions and performance levels that align well with the research question can be a valuable assessment tool in a scholarship of teaching and learning (SoTL) study. The chapter takes the reader through the process of creating a rubric, and then applying it, as well as a discussion of achieving inter-rater agreement. It also describes techniques for coding qualitative data (also called content analysis) to extract meaning by using codes or labels to identify common themes that appear throughout the data set. Multiple examples are provided of science, technology, engineering, and mathematics (STEM) studies that used or developed rubrics and of studies that did a content analysis of verbal and non-verbal data. It also describes and compares the standards used to assess quantitative research and qualitative research.

2015 ◽  
Vol 10 ◽  
pp. 82-97 ◽  
Author(s):  
Abdul Hakim Bin Abdullah ◽  
Ab. Aziz Bin Sulaiman ◽  
Wan Ismail Bin Wan Abdullah

The purpose of this study is identify factors that affect students motivation in  learning Arabic among lower secondary level students at Naim Lilbanat National Religious Secondary School (SMKA), Kota Bharu, Kelantan. To achieve this purpose, four objectives have been outlined; to identify the level of students performance in Arabic, to identify the level of students interest towards Arabic, to identify factors that affect students motivation towards Arabic and to evaluate the relationship between motivation and students performance in Arabic. This quantitative research used questionnaires for collecting data. 93 students at lower secondary level at SMKA Naim Lilbanat were selected by simple random technique as the sample that represent 40% of the research population. A pilot study was conducted to ensure the quality of feasibility, validity and reliability of the instrument. The validity of items was obtained by referring to 10 experts of the subject matter. Coefficient of reliability value was obtained at a high level that is 0.86 through Cronbach Alpha test using SPSS version 19. The study found that 88 (94.6%) respondents have a good performance in Arabic and 78 (83.9%) respondents have a good interest towards Arabic. According to this study, five factors that affect students motivation in descending order are: attitude toward Arabic as they consider it as important, Arabic environment, attitude toward Arabic as they consider it as easy to learn and understand, self-awareness and the effectiveness of teaching and learning in the classroom. The Pearson correlation test showed that there is a positive significant relationship at a moderate level between level of interest and performance of Arabic among lower secondary level students at SMKA Naim Lilbanat.   Kajian ini bertujuan untuk mengenal pasti faktor-faktor yang membentuk motivasi terhadap pembelajaran bahasa Arab dalam kalangan pelajar peringkat menengah rendah di Sekolah Menengah Kebangsaan Agama (SMKA) Naim Lilbanat, Kota Bharu, Kelantan. Bagi mencapai tujuan tersebut, empat objektif telah digariskan iaitu mengenal pasti tahap pencapaian pelajar bagi mata pelajaran Bahasa Arab, mengenal pasti tahap minat pelajar terhadap mata pelajaran Bahasa Arab, mengenal pasti faktor-faktor yang mempengaruhi motivasi pelajar terhadap mata pelajaran Bahasa Arab dan menguji hubungan tahap motivasi pelajar dengan pencapaian Bahasa Arab. Kajian ini berbentuk kuantitatif dan menggunakan soal selidik sebagai alat pengumpulan data. Seramai 93 orang pelajar peringkat menengah rendah di SMKA Naim Lilbanat telah dipilih secara rawak mudah sebagai sampel yang merupakan 40% daripada jumlah populasi kajian. Satu kajian rintis telah dijalankan bagi menjamin kualiti kebolehlaksanaan, kesahan dan kebolehpercayaan instrumen. Kesahan instrumen diperoleh secara merujuk kepada 10 orang pakar bidang. Nilai keefisienan kebolehpercayaan item diperoleh pada tahap tinggi iaitu 0.86 daripada ujian Alpha Cronbach menggunakan perisian SPSS versi 19. Kajian ini mendapati 88 orang (94.6%) responden mempunyai pencapaian yang baik dalam mata pelajaran Bahasa Arab. Kajian ini juga mendapati 78 orang (83.9%) responden mempunyai tahap minat yang baik terhadap mata pelajaran Bahasa Arab. Lima faktor yang paling mempengaruhi motivasi pelajar secara turutan menurun ialah: sikap terhadap mata pelajaran Bahasa Arab yang dianggap penting, persekitaran bahasa Arab, sikap terhadap mata pelajaran Bahasa Arab yang dianggap mudah dipelajari dan difahami, kesedaran diri dan keberkesanan pengajaran dan pembelajaran dalam bilik darjah. Ujian korelasi Pearson memperlihatkan wujud hubungan positif yang signifikan pada kadar sederhana antara tahap motivasi dan pencapaian Bahasa Arab dalam kalangan pelajar peringkat menengah rendah di SMKA Naim Lilbanat.


2020 ◽  
Vol 122 (12) ◽  
pp. 1-26
Author(s):  
Michelle P. Martin-Raugh ◽  
Harrison J. Kell ◽  
Richard J. Tannenbaum

Background/Context Rich classroom discussions are thought to provide several benefits to students, including improved connections to course content and general literacy development, and they provide a rich evidence stream from which teachers can make inferences about student learning to contribute to decisions about next teaching and learning steps. However, the way in which teachers perceive complex social situations characterized by student behaviors and aspects of the learning environment varies. Research has shown that expert teachers are better than novice teachers at identifying information that is important in complex social situations and that this expertise translates into improved teaching decisions. Purpose/Objective/Research Question/Focus of Study This study examined whether situation perception is related to teachers’ performance when they lead classroom discussions. Research Design A total of 126 elementary school teacher candidates completed video-based situation perception and personality measures; scores were used to predict performance in simulations of facilitated classroom discussions. Findings/Results Situation perception was associated with candidates’ performance in discussions (r = .20, p < .05), and agreeableness was associated with situation perception (r = .21, p < .05) and performance in leading discussions (r = .19, p < .05). Conclusions/Recommendations Findings provide preliminary evidence to suggest that situation perception may be an important skill for teachers in leading discussions.


2019 ◽  
Vol 11 (1) ◽  
pp. 90-101 ◽  
Author(s):  
Mark Angolia ◽  
April Helene Reed

PurposeThe purpose of this paper is to encourage the use of simulations early in a semester, rather than as a course capstone activity, in an effort to utilize simulations as a foundational experience. The intent is to support teaching and learning, as opposed to using simulations as a capstone assignment or assessment tool.Design/methodology/approachA comprehensive literature review synthesizing higher education business simulation effectivity and evaluation methods provides support for the analysis of 60 undergraduate supply chain management students and 96 surveys conducted over two years. The research question explores effectiveness based on the point of time during a semester a simulation was used.FindingsThe analysis of simulation effectiveness, based on the impact of course enjoyment and assistance with learning key course competencies, showed no significant differences for simulations used early in a semester or as an end-of-semester capstone event.Practical implicationsSimulations are effective tools regardless of when they are employed, but there may be significant benefits to using a simulation early in a semester by capitalizing on the tool’s inherent experiential learning functionality, active learning theory and the Kolb Experiential Learning Cycle. Early use of simulations provides common student experiences and creates a foundation for educators to develop a deeper understanding of course concepts. Additional instructor effort is needed to develop external, course specific student work to supplement and enhance the simulation experience. Early use also creates post-simulation debriefing benefits that may be precluded by the end-of-semester simulation events.Originality/valueEvidence suggests that simulations are primarily utilized as course capstone events and/or serve as comprehensive tools to integrate/assess a semester’s worth of conceptual learning. This work fills a gap in the research concerning time frames within a semester when simulations are traditionally employed, presenting a paradigm shift toward early utilization.


Author(s):  
Jacqueline M. Dewar

Chapter 5 describes the use of surveys in scholarship of teaching and learning (SoTL) studies. Topics include how to design a survey, the reliability and validity of surveys, and response rates and how to improve them. The chapter also includes a detailed discussion of a special type of survey called a knowledge survey that is used to measure students’ confidence in their knowledge of disciplinary content. Multiple uses for knowledge surveys are described: a means to assess changes in student learning, a way to improve course organization and coordination across multiple sections, and as guide through the course material for students. The importance of a survey being a good match for the type of research question—What works? What is? What could be?—is emphasized. Many examples are given of studies of student learning in science, technology, engineering, and mathematics (STEM) fields that employed surveys.


Author(s):  
Hollis Haotian Chai ◽  
Sherry Shiqian Gao ◽  
Kitty Jieyi Chen ◽  
Duangporn Duangthip ◽  
Edward Chin Man Lo ◽  
...  

Qualitative research collects non-numerical data that explores human behaviour, attitudes, beliefs and personality characteristics unamendable to quantitative research. The qualitative research questions are open-ended, evolving and non-directional. The study design is flexible and iterative. Purposive sampling is commonly used. The sample size is determined by theoretical saturation. Data collection is generally through in-depth interviews, focus groups and observations. Qualitative research commonly uses thematic analysis and framework analysis, although there is no consensus on analysing qualitative data. The reporting format can be comprehensive, a summary, developmental or selective, subject to the research question. Qualitative research’s potential functions are to describe the form or nature of what exists (contextual), to examine the reasons for or associations between what exists (explanatory), to appraise the effectiveness of what exists (evaluative), and to aid the development of strategies (generative). Qualitative research can be time consuming to conduct because it explores evolving questions; difficult to generalise because it recruits limited participants; and arduous when it comes to making systematic comparisons because responses are subjective. However, qualitative research can provide depth and detail, create openness, simulate people’s individual experiences and avoid pre-judgements. This concise review provides an overview and suggestions for dental researchers when conducting a qualitative study.


2020 ◽  
Vol 1 (2) ◽  
pp. 67-75
Author(s):  
Abena Okyerewa ◽  
Siaw Samuel Nortey ◽  
Edwin K. Bodjawah

This study used qualitative and quantitative research methods in tandem to compare teaching and learning processes to illuminate differences in students' academic performance gap in the Visual Arts in urban, peri-urban and rural Senior High Schools in the Ashanti Region. With the use of purposive and simple random sampling techniques, a sample of six schools – two in each setting, comprising 120 students and 18 teachers were selected for in-depth study. The study found that urban schools perform better than rural schools because they have prestigious names and character, more qualified teachers, and they attract and admit high performance BECE applicants into the Visual Arts department. The study revealed that the geographical settings of the school and educational opportunities directly influence the academic performance and achievement of students. Environmental factors, lack of studio facilities, and differences in teaching methodologies in the different geographical settings seem to influence students' learning and performance. Keywords: Teachingandlearning;Visualarts;Ruralandurbaneducation;Academicperformance.


2021 ◽  
pp. 146879412110059
Author(s):  
Elizabeth Yakel ◽  
Rebecca D Frank ◽  
Kara Suzuka ◽  
Jasmine Smith

This article investigates data reuse or the secondary analysis of qualitative data, specifically video records of practice in education, which are used to study the complex cognitive, social, and logistical issues involved in teaching and learning processes. It examines reuse through the lens of the invisibilities experienced by educational researchers who perform secondary analysis on video records of practice. Drawing on 22 in-depth interviews with educational researchers, we examine how they conceptualize secondary analysis of qualitative video data and cope with invisibilities in the data. For example, knowing the original research question was not sufficient: reusers needed to understand more about the intentionality of the data producer. They also sought more information on the reflexivity of the original researcher and how this influenced data production. Additionally, reusers discussed the creation of evidence from the video during secondary analysis as teaching and learning themselves entail invisible processes.


2018 ◽  
Vol 15 (3) ◽  
pp. 66-78
Author(s):  
Priscilla Lucia Cerqueira ◽  
Reginaldo Fernando Carneiro

Teacher education of the early years of Elementary School -as well as this education for science and mathematics teaching -has been on the agenda of many studies in the area of Education. In this article, part of a masters study, aims to investigate the perceptions of undergraduates in Pedagogy about the experience of education proposal in science and mathematics in an interdisciplinary perspective. To that end, a qualitative research was developed in which we used for data production, the activities carried out by the students, a questionnaire and an interview with the teacher trainers who participated in a proposal of interdisciplinary work carried out in the disciplines of Theoretical and Methodological Foundations and School Practice in Science I and Theoretical and Methodological Foundations and School Practice in Mathematics I of a Pedagogy course of a public university in Minas Gerais. For data analysis, we are guided in the theory of content analysis. The data analyzes, based on the theory of the content analysis, showed that the undergraduates had clarity that their education in science and mathematics teaching could not be based on the perspective of the transmission, but in a process that seeks to articulate the conceptsand contents of the different disciplines. In this way, they valued interdisciplinarity as a possibility of integration and as a facilitator of the teaching and learning process.


2021 ◽  
Vol 74 (1) ◽  
Author(s):  
Camila Henriques Nunes ◽  
Mario Sergio Michaliszyn ◽  
Eduardo Shimoda ◽  
Karla Rangel Ribeiro ◽  
Ronilson Gonçalves Rocha

ABSTRACT Objectives: to analyze the insertion of environmental issues in the postgraduate stricto sensu in nursing in Brazil. Methods: quali-quantitative research, of exploratory approach, with documental research in the Sucupira Platform and in sites of the 112 courses stricto sensu in Nursing in Brazil, in 2018. We analyzed the curricular matrixes; course menus; teaching profile; dissertations and thesis (2004-2016); and bibliographic productions of the four-year evaluation 2013-2016. The analysis of quantitative data was performed by statistical methods; and qualitative data, by the Content Analysis Technique, outlined by Bardin. Results: the results demonstrate incipiency in the treatment of environmental issues. Regarding the theme, we highlight those that refer to socio-historical-cultural aspects in relation to the more direct environmental approach and facilitator of environmental conservation and consequent promotion of health. Final Considerations: The analysis allows identifying the fragility of the environmental approach in the analyzed programs, being necessary to improve the cross-sectionality of environmental issues.


Author(s):  
Jacqueline M. Dewar

Chapter 6 gives detailed instructions for gathering evidence through focus groups, interviews, and think-alouds. When seeking to answer questions about science, technology, engineering, or mathematics (STEM) student thinking, motivation, attitudes, or underlying reasons for certain behaviors, a scholarship of teaching and learning (SoTL) investigator should consider using one or more of these methods even though they may be unfamiliar. Numerous examples are given of studies of student learning in science, engineering, and mathematics that employed these methods. The investigator is advised to select a method that is appropriate for the type of research question—What works? What is? What could be? The chapter closes with a discussion of the key role that student voices play in SoTL, including the positive outcomes resulting from several projects that engaged students as co-investigators or provided undergraduate research experience in pedagogical research.


Sign in / Sign up

Export Citation Format

Share Document