A Tough Nut to Crack

Author(s):  
Lei Liu ◽  
Jiangang Hao ◽  
Alina A. von Davier ◽  
Patrick Kyllonen ◽  
Juan-Diego Zapata-Rivera

The purpose of our project is to explore the measurement of cognitive skills in the domain of science through collaborative problem solving tasks, measure the collaborative skills, and gauge the potential feasibility of using game-like environments with avatar representation for the purposes of assessing the relevant skills. We are comparing students' performance in two conditions. In one condition, students work individually with two virtual agents in a game-like task. In the second condition, dyads of students work collaboratively with two virtual agents in the similar game-like task through a chat box. Our research is motivated by the distributed nature of cognition, extant research on computer-supported collaborative learning (CSCL) which has shown great value of collaborative activities for learning, and the framework for the Programme for International Student Assessment (PISA) framework. This chapter focuses on the development and implementation of a conceptual model to measure individuals' cognitive and social skills through collaborative activities.

2018 ◽  
Vol 34 (3) ◽  
Author(s):  
Vu Phuong Lien

Study the structure of collaborative problem solving (CPS) competence through teaching of the topic “nonmetals” using integrated natural science approach, the paper proposes a topic-building process, corresponding indicators, assessment toolkit, and teaching implementation process and measures for the formation and development of students’ CPS competence. Key words Competence, collaborative problem solving competency, integrated natural science teaching, teaching properties of nonmetals References 1. Greiff, S. (2012), From interactive to collaborative problem solving: current issues in the Programme for International Student Assessment. 2. Grinffin, E. C. (2015), Assessment of Collaborative Problem Solving. 3. NESTA, Solved! Making the case for collaborative problem-solving4. Kỉ yếu hội thảo dạy học tích hợp dạy học phân hóa (2014)5. Patrick Griffin, Esther Care, 2015, Assessment and teaching of 21st Century 6. Patrick Griffin, Esther Care, 2015, Developing learners’ collaborative problem solving skills. 7. PISA 2015, Draft Collaborative Problem Solving framework, OECD Programme for International Student Assessment 2015 8. PISA 2015 Released field trial cognitive items, OECD Programme for International Student Assessment 2015 9. PISA 2018, Draft framework 10. Richard M. Fealder, Rebecca Brent, Cooperative Learning 11. Rod Ellis, The Methodology of Task-based teaching 12. Weinert, F. E. (2001), Concept of Competence: a conceptual definition. In: Rychen, D.S.; Salganik, L.H., eds. Defining and Selecting Key Competencies, p46. 13. Worf, A. (1995), Competence – Based Assessment.14. Lê Thái Hưng, Vũ Phương Liên, Nguyễn Thị Phương Vy, Assessing Collaborative Problem Solving Competency Through Integrated Theme Based Teaching Chemistry, Proceedings of the International Conference on Research of Educational Administration and Management (ICREAM 2017), October 17, 2017, Bandung, Indonesia, Taylor & Francis Group, UK.15. Trần Trunh Ninh, Vũ Phương Liên, Năng lực hợp tác giải quyết vấn đề của học sinh thông qua dạy học Hóa học THPT, Tạp chí Khoa học Giáo dục, Số 2, 02/ 2018. 16. Vũ Phương Liên, Ngô Nam Sinh, Hình thành năng lực hợp tác giải quyết vấn đề thông qua dạy học hóa học theo hình thức trải nghiệm, Tạp chí Khoa học Giáo dục, Số 146, 11/2017 17. Vũ Phương Liên, Lê Thái Hưng, Ngô Ngọc Kiên, Bước đầu triển khai dạy học tích hợp liên môn các môn khoa học tự nhiên ở trường THPT, Tạp chí Giáo dục, số 380, 4/2016


2021 ◽  
Vol 6 ◽  
Author(s):  
Pan Tang ◽  
Hao Liu ◽  
Hongbo Wen

Collaborative problem solving (CPS) competency is critical in the twenty-first century. The Program for International Student Assessment (PISA) launched a large-scale assessment of CPS competency for the first time in 2015. Beijing, Shanghai, Jiangsu, and Guangdong provinces in China participated the assessment and scored an average of 496, which was slightly lower than the OECD average 500 and ranked 25th among the 51 countries and economies participating in the assessment. Therefore, this research was conducted to dig into the factors predicting students’ CPS competency, and help students improve it. Most research about CPS has fallen into the construction of the CPS framework and the effectiveness of CPS; research focusing on the factors predicting CPS competency is rare. Accordingly, a hierarchical linear model (HLM) was constructed to investigate the factors predicting students’ CPS competency in the current research. The model revealed that there was a large difference of students’ CPS competency among schools. In addition, among student-level variables, gender, grade, ESCS, ICT resources, students’ attitude toward CPS, and teacher unfairness were effective in predicting students’ CPS competency; among school-level variables, school location, schools’ ESCS and the proportion of all teachers fully certified predicted students’ CPS competency positively. The findings implied that in order to enhance students’ CPS competency, CPS competency training should be permeated through all the subjects; schools should employ teachers who are fully qualified; teachers should treat each student fairly; and students should be provided with more ICT resources and etc.


2020 ◽  
Vol 64 (3) ◽  
pp. 282-303
Author(s):  
Claire Scoular ◽  
Sofia Eleftheriadou ◽  
Dara Ramalingam ◽  
Dan Cloney

Collaboration is a complex skill, comprised of multiple subskills, that is of growing interest to policy makers, educators and researchers. Several definitions and frameworks have been described in the literature to support assessment of collaboration; however, the inherent structure of the construct still needs better definition. In 2015, the Organisation for Economic Cooperation and Development, in their Programme for International Student Assessment assessed 15-year-old students’ collaborative problem solving achievement, with the use of computer-simulated agents, aiming to address the lack of internationally comparable data in this field. This paper explores what the data from this assessment tell us about the skill, and how these data compare with data from two other assessments of collaboration. Analyses enable comment on the extent to which the three assessments are measuring the same construct, and the extent to which the construct can be covered using computer-based assessments. These investigations generate better understanding of this complex and innovative domain.


2019 ◽  
Vol 286 (1901) ◽  
pp. 20190408 ◽  
Author(s):  
Alicia P. Melis ◽  
Michael Tomasello

Successful collaboration often relies on individuals' capacity to communicate with each other. Despite extensive research on chimpanzee communication, there is little evidence that chimpanzees are capable, without extensive human training, of regulating collaborative activities via communication. This study investigated whether pairs of chimpanzees were capable of communicating to ensure coordination during collaborative problem-solving. The chimpanzee pairs needed two tools to extract fruits from an apparatus. The communicator in each pair could see the location of the tools (hidden in one of two boxes), whereas only the recipient could open the boxes. The subjects were first successfully tested for their capacity to understand the pointing gestures of a human who indicated the location of the tools. In a subsequent conspecifics test, the communicator increasingly communicated the tools’ location, by approaching the baited box and giving the key needed to open it to the recipients. The recipient used these signals and obtained the tools, transferring one of the tools to the communicator so that the pair could collaborate in obtaining the fruits. The study suggests that chimpanzees have the necessary socio-cognitive skills to naturally develop a simple communicative strategy to ensure coordination in a collaborative task.


2019 ◽  
Vol 17 (1) ◽  
pp. 11-26 ◽  
Author(s):  
Euan Auld ◽  
Paul Morris

The Organisation for Economic Co-operation and Development (OECD) has unveiled plans to move into the field of early childhood education through the introduction of the International Early Learning Study (IELS), a new comparative test of five-year olds that is being piloted in three nations. This article explores the dynamics of this new project and serves three purposes. First, we situate IELS within the OECD’s broader agenda in education governance, and with regard to its existing comparative assessments, namely the Programme for International Student Assessment (PISA). Second, we identify the main commentaries and critiques of the OECD’s activity and assessments, specifically relating to PISA. In the concluding section we anticipate a possible future when such tests are established in the early childhood education sector and reflect on its possible impact. We argue that the advent of comparative testing of five-year olds heralds an attempt to introduce a new paradigm for early childhood education, one which stresses cognitive skills and children’s role as future sources of human capital.


2021 ◽  
Author(s):  
Kylie Hillman ◽  
Sue Thomson

Australia was one of nine countries and economies to participate in the 2018 TALIS-PISA link study, together with Cuidad Autónoma de Buenos Aires (Argentina), Colombia, the Czech Republic, Denmark, Georgia, Malta, Turkey and Viet Nam. This study involved coordinating the samples of schools that participated in the Program of International Student Assessment (PISA, a study of the performance of 15-year-old students) and the Teaching and Learning International Survey (TALIS, a study that surveys teachers and principals in lower secondary schools) in 2018. A sample of teachers from schools that were selected to participate in PISA were invited to respond to the TALIS survey. TALIS data provides information regarding the background, beliefs and practices of lower secondary teachers and principals, and PISA data delivers insights into the background characteristics and cognitive and non-cognitive skills of 15-year-old students. Linking these data offers an internationally comparable dataset combining information on key education stakeholders. This report presents results of analyses of the relationships between teacher and school factors and student outcomes, such as performance on the PISA assessment, expectations for further study and experiences of school life. Results for Australia are presented alongside those of the average (mean) across all countries and economies that participated in the TALIS-PISA link study for comparison, but the focus remains on what relationships were significant among Australian students.


SAGE Open ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 215824401989943
Author(s):  
Ömer Volkan Yaz ◽  
Mehmet Altan Kurnaz

The purpose of this study is to comparatively investigate the science teaching curricula in Turkey, which have undergone changes four times since the millennium. For this purpose, we carried out a technical and taxonomic examination of the learning outcomes listed in the science curricula that were introduced in 2000, 2005, 2013, and 2017 concerning Revised Bloom Taxonomy (RBT). In this study, the document analysis method was used. We classified a total of 2,613 learning outcomes in our analyses, which were limited to those related to the cognitive domain. The reliability score of the classifications was .89 according to the equation proposed by Miles and Huberman. The analyses showed that the teaching curricula decreased the intensity of the focus on knowledge and cognitive skills rather than making fundamental changes. Moreover, there was significant parallelism among the examined curricula in terms of the dimensions of the taxonomy. Using national-level results in international exams such as PISA (Programme for International Student Assessment) and TIMSS (Trends in International Mathematics and Science Study), we concluded that Turkey had not been successful enough in developing the examined curricula.


Sign in / Sign up

Export Citation Format

Share Document