scholarly journals Evaluation of MirMe® Online Assessment for 21st Century Skills: Situational Intelligence (SQ) and online psychometric assessment of 21st century skills

2021 ◽  
Author(s):  
Shenghua Luan ◽  
Mark Nowacki

We assess the Situational Intelligence (SQ) component of the MirMe assessment system for 21st century skills. MirMe is an online, game-based psychometric instrument developed by LogicMills. The SQ component measures skills related to decision-making and critical thinking. It does so via AI-driven heuristic engines that deploy analogs of “fast and frugal” heuristics. Approximately 7,000 participants (aged 5 to 92) and 25,000 gameplays were involved in the various validation studies. Results support the conclusion that MirMe’s SQ measures are internally consistent (Cronbach alpha ranging from .71 to .93). Results also suggest that MirMe may be a better predictor of student academic performance (measured by GPA) than A-levels (MirMe <i>r<sup>2</sup></i> = .265, <i>p</i> < .001; A-levels <i>r<sup>2</sup></i> = .209, <i>p</i> < .001). MirMe also appears to predict the kinds of co-curricular activities students participate in both prior to and during university.

2021 ◽  
Author(s):  
Shenghua Luan ◽  
Mark Nowacki

We assess the Situational Intelligence (SQ) component of the MirMe assessment system for 21st century skills. MirMe is an online, game-based psychometric instrument developed by LogicMills. The SQ component measures skills related to decision-making and critical thinking. It does so via AI-driven heuristic engines that deploy analogs of “fast and frugal” heuristics. Approximately 7,000 participants (aged 5 to 92) and 25,000 gameplays were involved in the various validation studies. Results support the conclusion that MirMe’s SQ measures are internally consistent (Cronbach alpha ranging from .71 to .93). Results also suggest that MirMe may be a better predictor of student academic performance (measured by GPA) than A-levels (MirMe <i>r<sup>2</sup></i> = .265, <i>p</i> < .001; A-levels <i>r<sup>2</sup></i> = .209, <i>p</i> < .001). MirMe also appears to predict the kinds of co-curricular activities students participate in both prior to and during university.


2020 ◽  
Vol 3 (1) ◽  
pp. 49-56
Author(s):  
Hala El-Senousy

In the digital age, the interaction between the ICT and the educational system has led to fundamental transformations and changes to all elements of the learning process. Intelligent devices have enabled the learner to access knowledge resources at any time and anywhere. Learning management systems have produced a smart E-learning environment which enables active learning, Communication, and interaction among users. Quality Assurance in Higher Education has become urgent and aspires to qualify graduates who have mastered diverse and varied skills appropriate with the digital age. The academic programs requisite to rely upon the evaluation of learning outcomes, not only cognitive but also skills, thus the modification of the current assessment system is demanded. This study identified the 21st century skills and performance of learners in five categories: Critical Thinking Skills, Problem Solving Skills, Digital Communication & Sharing Skills, the Productivity of Creative Innovation Skills, and Self Regulated Learning & Career Skills. While Higher education is required to provide evidence of student learning skills, the study suggests E-Portfolios, which are considered as a tool that allows the student to: organize, save, document, publish, and digitally share his work as an accurate assessment tool. The study discusses the foundations, principles, objectives, and analyzes the application of E-Portfolio as a learning and assessment tool of 21st century skills in higher education. Keywords: E –Portfolio, 21st century skill, Quality of smart E-Learning.


2020 ◽  
Vol 3 (2) ◽  
pp. 222-233
Author(s):  
Veronika Fany Monica Yuniarti ◽  
Nurul Anriani ◽  
Cecep Anwar H. F. Santosa

Abstrak: Penelitian ini bertujuan untuk menghasilkan aplikasi e-modul berbasis smartphone pada materi integral tak tentu berorientasi keterampilan abad ke-21 yang valid, praktis, dan efektif. Penelitian menggunakan metode Research and Development (R&D) dari Borg dan Gall yang dimodifikasi menjadi enam langkah. Hasil penelitian menyatakan bahwa hasil skor validasi ahli materi sebesar 4.2 termasuk kategori valid, ahli media diperoleh 3.8 termasuk kategori valid dan guru matematika diperoleh 3.7 termasuk kategori valid. Sedangkan hasil efektivitas diperoleh dari persentase ketuntasan 70% dengan kategori tinggi, dan n-gain sebesar 0,7682 termasuk kategori interpretasi tinggi. Lebih jauh, hasil praktis diperoleh 44.55 jumlah rata-rata skor pernyataan yang termasuk kategori sangat praktis dan 39.80 jumlah rata-rata skor pernyataan yang termasuk kategori praktis. Berdasarkan hasil tersebut maka dapat disimpulkan bahwa pengembangan aplikasi e-modul berbasis smartphone merupakan media yang valid, praktis, dan efektif. Abstract: The research aims to produce a valid, practical, and effective smartphone-based e-module applications 21st-century skills-oriented integral material. The Research method was developmental research (R&D) according to Borg and Gall which was modified into six steps. The results of the research show that the validity of material experts score is 4.2 (valid category), media experts obtained is 3.8 (valid category) and the mathematics teacher score is 3.7 (valid category). While the effectiveness results obtained from the percentage of completeness of 70% with a high category and n-gain of 0.7682 including the high interpretation category. As well as the practical results obtained 44.55 the average number of statements in the very practical category and 39.80 the average number of statements in the practical category. Based on these results it can be concluded that the development of smartphone-based e-module applications is a valid, practical, and effective medium.


Author(s):  
Antonova Albena ◽  
Stefanova Eliza ◽  
Nikolova Nikolina ◽  
Mihnev Pencho ◽  
Bontchev Boyan

2021 ◽  
Vol 1764 (1) ◽  
pp. 012142
Author(s):  
Ahmad Khoiri ◽  
Evalina ◽  
Nur Komariah ◽  
Rahayu Tri Utami ◽  
Vip Paramarta ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document