scholarly journals An AI-Based System for Formative and Summative Assessment in Data Science Courses

2020 ◽  
Author(s):  
Pierpaolo Vittorini ◽  
Stefano Menini ◽  
Sara Tonelli
Keyword(s):  
Data Science ◽  
Ad Hoc ◽  
Online Courses ◽  
Assessment Tools ◽  
Science Courses ◽  
Summative Assessments ◽  
Assessment Activity ◽  
Automated Grading ◽  
Automated Feedback

AbstractMassive open online courses (MOOCs) provide hundreds of students with teaching materials, assessment tools, and collaborative instruments. The assessment activity, in particular, is demanding in terms of both time and effort; thus, the use of artificial intelligence can be useful to address and reduce the time and effort required. This paper reports on a system and related experiments finalised to improve both the performance and quality of formative and summative assessments in specific data science courses. The system is developed to automatically grade assignments composed of R commands commented with short sentences written in natural language. In our opinion, the use of the system can (i) shorten the correction times and reduce the possibility of errors and (ii) support the students while solving the exercises assigned during the course through automated feedback. To investigate these aims, an ad-hoc experiment was conducted in three courses containing the specific topic of statistical analysis of health data. Our evaluation demonstrated that automated grading has an acceptable correlation with human grading. Furthermore, the students who used the tool did not report usability issues, and those that used it for more than half of the exercises obtained (on average) higher grades in the exam. Finally, the use of the system reduced the correction time and assisted the professor in identifying correction errors.

scholarly journals Developing and Deploying a Scalable Computing Platform to Support MOOC Education in Clinical Data Science

2020 ◽  
Author(s):  
David Mayer ◽  
Seth Russell ◽  
Melissa P. Wilson ◽  
Michael G. Kahn ◽  
Laura K. Wiley
Keyword(s):  
Clinical Data ◽  
Data Science ◽  
Online Courses ◽  
Computing Environment ◽  
Computing Systems ◽  
Science Courses ◽  
Computing Platform ◽  
Access To Health ◽  
And Performance ◽  
Massively Open Online Courses

AbstractOne of the challenges of teaching applied data science courses is managing individual students’ local computing environment. This is especially challenging when teaching massively open online courses (MOOCs) where students come from across the globe and have a variety of access to and types of computing systems. There are additional challenges with using sensitive health information for clinical data science education. Here we describe the development and performance of a computing platform developed to support a series of MOOCs in clinical data science. This platform was designed to restrict and log all access to health datasets while also being scalable, accessible, secure, privacy preserving, and easy to access. Over the 19 months the platform has been live it has supported the computation of more than 2300 students from 101 countries.

Assessment of Individual Student Performance in Online Team Projects

2011 ◽  
Vol 15 (3) ◽  
Author(s):  
Jay Alden
Keyword(s):  
Student Performance ◽  
Group Process ◽  
Online Courses ◽  
Peer Assessment ◽  
Individual Student ◽  
Assessment Practice ◽  
Group Project ◽  
Team Members ◽  
Team Projects

The use of team projects has been shown to be beneficial in higher education. There is also general agreement that team efforts should be assessed and that the grading ought to represent both (1) the quality of the product developed jointly by the team as well as (2) the degree of participation and quality of contribution by each individual student involved in the group process. The latter grading requirement has posed a challenge to faculty so the question addressed in this paper is “How should individual team members in online courses be assessed for the extent and quality of their contributions to the group project?” To answer this question, four common team member evaluation practices were reviewed and compared to seven criteria representing positive attributes of an assessment practice in an online learning environment. Whereas the Peer Assessment practice received the greatest support in the literature in face-to-face courses, this study that considered the perceptions of graduate faculty and students recommended the Faculty Review practice as the default assessment

Data science in economics: comprehensive review of advanced machine learning and deep learning methods

2020 ◽  
Author(s):  
Saeed Nosratabadi ◽  
Amir Mosavi ◽  
Puhong Duan ◽  
Pedram Ghamisi ◽  
Ferdinand Filip ◽  
...  
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Data Science ◽  
State Of The Art ◽  
Science Methods ◽  
Learning Models ◽  
Diverse Range ◽  
Hybrid Machine ◽  
Economics Research

This paper provides a state-of-the-art investigation of advances in data science in emerging economic applications. The analysis was performed on novel data science methods in four individual classes of deep learning models, hybrid deep learning models, hybrid machine learning, and ensemble models. Application domains include a wide and diverse range of economics research from the stock market, marketing, and e-commerce to corporate banking and cryptocurrency. Prisma method, a systematic literature review methodology, was used to ensure the quality of the survey. The findings reveal that the trends follow the advancement of hybrid models, which, based on the accuracy metric, outperform other learning algorithms. It is further expected that the trends will converge toward the advancements of sophisticated hybrid deep learning models.

A Bandwidth and Energy Aware QoS Routing Protocol for Enhanced Performance in Ad-hoc Networks

2019 ◽  
Vol 9 (2) ◽  
pp. 203-213
Author(s):  
Priyanka Bharadwaj ◽  
Surjeet Balhara
Keyword(s):  
Ad Hoc Networks ◽  
Routing Protocol ◽  
Ad Hoc ◽  
Qos Routing ◽  
Delivery Ratio ◽  
Energy Aware ◽  
Multimedia Services ◽  
Average Delay ◽  
Hoc Networks

Background & Objective: There are some challenging issues such as providing Quality of Service (QoS), restricted usage of channels and shared bandwidth pertaining to ad-hoc networks in a dynamic topology. Hence, there is a requirement to support QoS for the application environment and multimedia services in ad-hoc networks with the fast growing and emerging development of information technology. Eventually, bandwidth is one of the key elements to be considered. Methods: Energy aware QoS routing protocol in an ad-hoc network is presented in this article. Results and Conclusion: The simulation results indicate that the improved protocol outperforms Adhoc On-Demand Distance Vector (AODV) routing protocol in terms of QoS metric such as throughput, packet delivery ratio, loss rate and average delay.

Assessing Medical Evidence

2018 ◽  
Author(s):  
Jacob Stegenga
Keyword(s):  
Quality Assessment ◽  
Randomized Trials ◽  
Empirical Studies ◽  
Allocation Concealment ◽  
Assessment Tools ◽  
Medical Evidence ◽  
Empirical Methods ◽  
First Order ◽  
First Order Methods

Medical scientists employ ‘quality assessment tools’ to assess evidence from medical research, especially from randomized trials. These tools are designed to take into account methodological details of studies, including randomization, subject allocation concealment, and other features of studies deemed relevant to minimizing bias. There are dozens of such tools available. They differ widely from each other, and empirical studies show that they have low inter-rater reliability and low inter-tool reliability. This is an instance of a more general problem called here the underdetermination of evidential significance. Disagreements about the quality of evidence can be due to different—but in principle equally good—weightings of the methodological features that constitute quality assessment tools. Thus, the malleability of empirical research in medicine is deep: in addition to the malleability of first-order empirical methods, such as randomized trials, there is malleability in the tools used to evaluate first-order methods.

Evaluating Qualitative Research

2017 ◽  
Author(s):  
Jeasik Cho
Keyword(s):  
Qualitative Research ◽  
Large Scale ◽  
Academic Research ◽  
Research Community ◽  
Assessment Tools ◽  
Journal Articles ◽  
Journal Editors ◽  
The Past ◽  
Grant Proposals

This book provides the qualitative research community with some insight on how to evaluate the quality of qualitative research. This topic has gained little attention during the past few decades. We, qualitative researchers, read journal articles, serve on masters’ and doctoral committees, and also make decisions on whether conference proposals, manuscripts, or large-scale grant proposals should be accepted or rejected. It is assumed that various perspectives or criteria, depending on various paradigms, theories, or fields of discipline, have been used in assessing the quality of qualitative research. Nonetheless, until now, no textbook has been specifically devoted to exploring theories, practices, and reflections associated with the evaluation of qualitative research. This book constructs a typology of evaluating qualitative research, examines actual information from websites and qualitative journal editors, and reflects on some challenges that are currently encountered by the qualitative research community. Many different kinds of journals’ review guidelines and available assessment tools are collected and analyzed. Consequently, core criteria that stand out among these evaluation tools are presented. Readers are invited to join the author to confidently proclaim: “Fortunately, there are commonly agreed, bold standards for evaluating the goodness of qualitative research in the academic research community. These standards are a part of what is generally called ‘scientific research.’ ”

scholarly journals Evaluation of the efficacy of hearing aids in older adults: a multiparametric longitudinal study protocol

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Domenico Cuda ◽  
Sara Ghiselli ◽  
Alessandra Murri
Keyword(s):  
Quality Of Life ◽  
Older Adults ◽  
Speech Perception ◽  
Hearing Aids ◽  
Assessment Tools ◽  
Elderly Subjects ◽  
Single Subject ◽  
Measurement Tools ◽  
First Time

Abstract Background Prevalence of hearing loss increases with age. Its estimated prevalence is 40–50 % in people over 75 years of age. Recent studies agree that declinein hearing threshold contribute to deterioration in sociality, sensitivity, cognition, and quality of life for elderly subjects. The aim of the study presented in this paper is to verify whether or not rehabilitation using first time applied Hearing Aids (HA) in a cohort of old people with hearing impairment improves both speech perception in a noisy environment over time and the overall health-related quality of life. Methods The monocentric, prospective, repeated measurements, single-subject, clinical observational study is to recruit 100 older adults, first-time HA recipients (≥ 65 years).The evaluation protocol is designed to analyze changes in specific measurement tools a year after the first HA usage in comparison with the evaluation before HA fitting. Evaluations will consist of multiparametric details collected through self-report questionnaires completed by the recipients and a series of commonly used audiometric measures and geriatric assessment tools. The primary indicator of changes in speech perception in noise to be used is the Italian version of Oldenburg Satz (OLSA) test whereas the indicator of changes in overall quality of life will be the Assessment of Quality of Life (AQoL) and Hearing Handicap Inventory for the Elderly (HHIE) questionnaires. The Montreal Cognitive Assessment (MoCA) will help in screening the cognitive state of the subjects. Discussion The protocol is designed to make use of measurement tools that have already been applied to the hearing-impaired population in order to compare the effects of HA rehabilitation in the older adults immediately before first HA usage (Pre) and after 1 year of experience (Post). This broad approach will lead to a greater understanding of how useful hearing influences the quality of life in older individuals, and therefore improves potentials for healthy aging. The data is to be analyzed by using an intrasubject endpoint comparison. Outcomes will be described and analyzed in detail. Trial registration This research was retrospectively registered underno. NCT04333043at ClinicalTrials.gov (http://www.clinicaltrials.gov/) on the 26 March 2020. This research has been registered with the Ethics Committee of the Area Vasta Emilia Nord under number 104, date of approval 17/07/2017.

scholarly journals Comparative Study of Burnout in Professional Caregivers of Institutionalized Elderly with Dementia and other Diseases

2011 ◽  
Vol 1 (2) ◽  
pp. 61-70
Author(s):  
Inmaculada Méndez ◽  
Esther Secanilla ◽  
Juan P. Martínez ◽  
Josefa Navarro
Keyword(s):  
Quality Of Life ◽  
Ad Hoc ◽  
Maslach Burnout Inventory ◽  
Well Being ◽  
Measuring Instruments ◽  
Global Approach ◽  
People With Dementia ◽  
Quality Of Patient Care ◽  
Psychoeducational Programs

In a global approach about the need of paying attention to staff working with and for older people with dementia and other diseases in residential care, it is necessary to investigate their emotional well-being to provide strategies to improve their quality of life and therefore their quality of patient care. Professional caregivers of people with dementia and other diseases have specific psycho-sociological problems. They are more prone to stress which can sometimes lead to the “burnout” due to specific functions in the workplace. To define the sample was decided to compare two residential centers of two regions, Murcia and Barcelona. We proceeded to the administration of the following measuring instruments: the scale Maslach Burnout Inventory (MBI) and an ad hoc survey conducted for professional caregivers. Finally, the results offer the possibility of carrying out programs to prevent emotional exhaustion in professional carers, as well as the possibility of designing psychoeducational programs for staff care and even future proactive and reactive interventions.

Sign in / Sign up

Export Citation Format

Share Document