scholarly journals Improvement of the student evaluation system based on the ICT use

2020 ◽  
Vol 166 ◽  
pp. 10018
Author(s):  
Olena Pshenychna ◽  
Roman Klopov ◽  
Oleksandr Gura ◽  
Tetiana Gura
Keyword(s):  
Evaluation System ◽  
Student Evaluation ◽  
Item Difficulty ◽  
Student Assessment ◽  
Reliability And Validity ◽  
Computer Applications ◽  
Process Efficiency ◽  
Test Task ◽  
Higher Education Quality ◽  
National University

Today, considerable attention is paid to the higher education quality issues. The problem is solved by using tests that should provide a reliable student evaluation. The article presents the technology for improving test tasks. It includes functional procedures that specify the test and test task improvement sequence. It is found that it is better to use specialized computer applications for their implementation, that is why this technology involves the use of the author program “Statistical Analysis of Test Results”. This program calculates the indicators – the item difficulty, discrimination, reliability and validity – according to empirical student testing data. The indicators help identify unsatisfactory quality test tasks and improve the student assessment means, as the program derives the recommendations. The steps set out by the testing result processing technology with the help of a statistical package increase the improvement process efficiency. The correlation and factor analyses help identify the tasks that put the highest load into the test score. These procedures influence on making a decision on the test task review need. The technology involves repeated checking procedures. The presented technology has been tested at Zaporizhzhya National University and Zaporizhzhya Regional Institute of Postgraduate Teacher Education. ANOVA has helped prove its effectiveness.

Tracking and Targeting: Investigating Item Performance on the English Section of a University Entrance Examination over a 4-Year Period

2008 ◽  
Vol 30 (1) ◽  
pp. 105
Author(s):  
Christopher Weaver ◽  
Yoko Sato
Keyword(s):  
Test Performance ◽  
Systematic Approach ◽  
Rating Scales ◽  
Item Difficulty ◽  
Language Skills ◽  
Measurement Theory ◽  
Entrance Examination ◽  
University Admissions ◽  
Entrance Examinations ◽  
National University

This empirical study introduces population targeting and cut-off point targeting as a systematic approach to evaluating the performance of items in the English section of university entrance examinations. Using Rasch measurement theory, we found that the item difficulty and the types of items in a series of national university entrance examinations varied considerably over a 4-year period. However, there was progress towards improved test performance in terms of an increased number of items assessing different language skills and content areas as well as an increased number targeting test takers’ knowledge of English. This study also found that productive items rather than receptive items better targeted test takers’ overall knowledge of English. Moreover, productive items were more consistently located around the probable cut point for university admissions. The paper concludes with a detailed account of a number of probable factors that could influence item performance, such as the use of rating scales. 本論文では、ある国立大学における大学入試の英語の問題の変化を実証的に検証したものである。テスト項目の結果を検証するための体系的なアプローチとして、「母集団を対象としたアプローチ」および「足きり点を対象としたアプローチ」という方法を導入した。ラッシュ・モデリングを用いて分析した結果、過去４年間の間に、項目の困難度および項目の型について、様々な技能を測定していること、内容も多様であること、英語の知識を検証している項目が増えたこと、などの点で大きく変化していることがわかった。さらに、産出能力の方が受容能力を測定する項目よりも入学者決定の際の足きり点の周辺に収束する傾向が見られた。項目ごとの成績に影響を及ぼす可能性のある多様な要因について詳細な検討を行った。

scholarly journals Subjective Product Evaluation System Based on Kansei Engineering and Analytic Hierarchy Process

Symmetry ◽  
2020 ◽  
Vol 12 (8) ◽  
pp. 1340 ◽  
Author(s):  
Yaxue Zuo ◽  
Zhenya Wang
Keyword(s):  
Evaluation System ◽  
Comprehensive Evaluation ◽  
Subjective Evaluation ◽  
Reliability And Validity ◽  
Objective Evaluation ◽  
Product Evaluation ◽  
Kansei Engineering ◽  
Analytic Hierarchy ◽  
Evaluation Indexes ◽  
Hierarchy Process

Product evaluation is very important for product improvement and development, and subjective product evaluation determines customer’s evaluation of products to some extent, so the purpose of this study is to establish a reasonable subjective product evaluation system. In this study, we comprehensively determine the evaluation indexes based on Kansei engineering (KE), establish an overall product evaluation system by using analytic hierarchy process (AHP), and establish the subjective product evaluation system by classifying the evaluation indexes in the overall product evaluation system into “objective evaluation index” and “subjective evaluation index”, removing the objective evaluation indexes, and retaining the subjective evaluation indexes. Additionally, we select some modern chairs as experimental samples to verify the reliability and validity of this subjective product evaluation system by means of questionnaires. The experimental results show that, in this subjective product evaluation system, the subjective evaluation of the product is positively correlated with the “favorite” level of the product in comprehensive evaluation, and negatively correlated with the “least favorite” level of the product in comprehensive evaluation, indicating that this subjective product evaluation system realizes a symmetry between subjective product evaluation and comprehensive product evaluation. Therefore, it can be concluded that this subjective product evaluation system based on KE and AHP proposed in this study has reliability and validity, and can be used for product evaluation to judge the popularity of products and enhance the competitiveness of products.

scholarly journals The Role of Entropy in Construct Specification Equations (CSE) to Improve the Validity of Memory Tests

Entropy ◽  
2021 ◽  
Vol 23 (2) ◽  
pp. 212
Author(s):  
Jeanette Melin ◽  
Stefan Cano ◽  
Leslie Pendrill
Keyword(s):  
Rating Scales ◽  
Short Term Memory ◽  
Item Difficulty ◽  
Digit Span ◽  
Reliability And Validity ◽  
Practice Research ◽  
Theory Approach ◽  
Memory Tests ◽  
Using Data ◽  
Block Test

Commonly used rating scales and tests have been found lacking reliability and validity, for example in neurodegenerative diseases studies, owing to not making recourse to the inherent ordinality of human responses, nor acknowledging the separability of person ability and item difficulty parameters according to the well-known Rasch model. Here, we adopt an information theory approach, particularly extending deployment of the classic Brillouin entropy expression when explaining the difficulty of recalling non-verbal sequences in memory tests (i.e., Corsi Block Test and Digit Span Test): a more ordered task, of less entropy, will generally be easier to perform. Construct specification equations (CSEs) as a part of a methodological development, with entropy-based variables dominating, are found experimentally to explain (r=R2 = 0.98) and predict the construct of task difficulty for short-term memory tests using data from the NeuroMET (n = 88) and Gothenburg MCI (n = 257) studies. We propose entropy-based equivalence criteria, whereby different tasks (in the form of items) from different tests can be combined, enabling new memory tests to be formed by choosing a bespoke selection of items, leading to more efficient testing, improved reliability (reduced uncertainties) and validity. This provides opportunities for more practical and accurate measurement in clinical practice, research and trials.

scholarly journals Construction practice of student evaluation system based on JFinal + webix integrated framework and Baidu AI platform

2021 ◽  
Vol 336 ◽  
pp. 05016
Author(s):  
Zhan Gao ◽  
Zhihai Suo ◽  
Jun Liu ◽  
Mo Xu ◽  
Dandan Hong ◽  
...  
Keyword(s):  
Evaluation System ◽  
Student Evaluation ◽  
Evaluation Model ◽  
Teaching Quality ◽  
Integration Framework ◽  
Online Student ◽  
Evaluation Of Teaching ◽  
Multi Level ◽  
Level Student ◽  
Construction Practice

Students' evaluation of teaching is a key link to realize teaching quality monitoring and promote teachers' teaching level. Based on the practice of student evaluation in our university, this paper constructs a multi-level student evaluation system, and develops an online student evaluation system by using JFinal+webix integration framework. The new Internet plus evaluation model is established to improve the efficiency of student evaluation and the enthusiasm of students to evaluate teaching. Meanwhile, based on the analysis of students' comments on teaching by Baidu AI platform, It provides data support for the improvement of learning level and the optimization of teaching evaluation.

Online Courses

2011 ◽  
pp. 125-140 ◽  
Author(s):  
Linda Cooper
Keyword(s):  
Online Courses ◽  
Student Assessment ◽  
Computer Applications ◽  
Course Evaluations ◽  
Instructional Materials ◽  
Course Management System ◽  
Online Classes ◽  
Online Business ◽  
Computer Applications Course ◽  
Assessment Procedures

This chapter provides instructors who are interested in offering online classes with various strategies used and found successful in the instruction of an online Business Computer Applications course. Topics such as the importance of an initial class meeting, providing diverse instructional materials, the value of student course evaluations, and the dilemma of student assessment procedures will be addressed. Although a course management system (CMS) is used to manage the online Business Computer Applications course discussed in this chapter, many of the procedures incorporated can be effective in the facilitation of any online course. The advantages of using a CMS to implement and manage online courses will also be discussed later in this chapter.

Marking and Evaluating Index of Scientific Research Nurturing Teaching in Universities

2012 ◽  
Vol 524-527 ◽  
pp. 3782-3787
Author(s):  
Wei Jun Yang ◽  
Gui Jin Zhang ◽  
Ting Ting Zhang ◽  
Shuai Yuan
Keyword(s):  
Evaluation System ◽  
Objective Assessment ◽  
Scientific Research ◽  
Direct Analysis ◽  
University Teaching ◽  
Core Knowledge ◽  
Higher Education Quality ◽  
Long Time ◽  
Research Achievement ◽  
Quality Evaluation System

Experts and scholars have debated for the relationship and importance of university researching and teaching for a long time, owing to the problem that classroom teaching is not attached importance exists objectively, and becomes more serious. Through the direct analysis of teaching activity which is sufficient to embody the content and methods of the scientific research, the effectiveness of university research nurturing teaching is very notable. The teaching content and core knowledge is studied by taking a course as an example. Through the introduction of scientific research achievement, internationalization, and engineering elements, the mark of scientific research nurturing teaching is embodied, and then the operable evaluation index of scientific research nurturing teaching is put forward, which is expecting objective assessment of the connotation of teaching in order to provide a reference for the revision of China's higher education quality evaluation system and to promote the improvement of the quality of university teaching.

scholarly journals Quest for a New Instrument for Measuring Academic Program Quality

2019 ◽  
Vol 10 (4) ◽  
pp. 40
Author(s):  
Kaushik Mandal ◽  
Chandan Kumar Banerjee ◽  
Iwona Otola
Keyword(s):  
Factor Analysis ◽  
Reliability And Validity ◽  
Academic Program ◽  
Program Quality ◽  
Hospitality Education ◽  
New Instrument ◽  
Higher Education Quality ◽  
Education In India ◽  
Quality Aspect

This research explores and confirms a new way of measuring the quality aspect of an academic program based on hospitality education. In our opinion, there is a growing demand for specialists in hospitality education in India. The fact that the number of hospitality education institutes is increasing doesn’t go hand in hand with the care for the quality of education. Hence, we present one set an alternative trajectory by offering a new instrument APQUAL for measurement of quality of hospitality program offered by an educational institute. A critical review of the literature on the major instrument for measuring higher education quality has been done. The empirical part of the paper presents the developed in eight steps APQUAL construct that is an effective instrument to analyze the academic program quality. This work explored a number of facets of program quality by employing EFA (exploratory factor analysis) and CFA (confirmatory factor analysis) to fit the first order nonrecursive model and calculated the reliability and validity of our proposed instrument. This research provides a valid measure of academic program quality, which can be also applicable at the micro-level.

Teaching performance: determinants of the student assessment

2014 ◽  
Vol 27 (3) ◽  
pp. 402-418
Author(s):  
Adriana Morales Rodríguez ◽  
Joan‐Lluís Capelleras ◽  
Víctor M. Gimenez Garcia
Keyword(s):  
Higher Education ◽  
Student Evaluation ◽  
Student Assessment ◽  
Multivariate Techniques ◽  
Teaching Performance ◽  
Research Activity ◽  
Content Type ◽  
Teacher Student ◽  
Wide Range ◽  
Performance Determinants

Purpose The purpose of this paper is to identify the nature and factors that influence student evaluation of the teaching performance of university teachers by integrating two areas of research: services marketing and higher education. Design/methodology/approach A set of hypotheses were developed taking into consideration customer (student), employee (teacher) and service (course) characteristics. They were then tested using data from 952 courses for a three‐year period and employing different multivariate techniques. Findings Students basically evaluate the expertise, attitude and behavior of teachers. The results also indicate that this evaluation is a complex phenomenon that depends on factors related to teacher, student and course profiles. Research limitations/implications Given the nature of the data used here, future studies should extend the scope of research to other institutions, examine quality from an objective standpoint and include teachers’ perceptions and the outcomes of their research activity. Practical implications Based on the results of this paper, the authors recommend the following: to permit teachers to teach the same courses repeatedly, allowing them to consolidate their practice; to provide training in teaching techniques and ethics; to pay particular attention to those students who move to another degree program; and to maintain an appropriate class size. Originality/value This study integrates two areas of research and proposes a wide range of service quality determinants in the context of higher education, including several factors that had not been previously considered.

Sign in / Sign up

Export Citation Format

Share Document