Evaluating Computerized Adaptive Testing Systems

2009 ◽  
pp. 186-202
Author(s):  
Anastasios A. Economides ◽  
Chrysostomos Roupas
Keyword(s):  
Large Scale ◽  
Computerized Adaptive Testing ◽  
Adaptive Testing ◽  
Evaluation Framework ◽  
Educational Organizations ◽  
Human Errors ◽  
Media Type ◽  
Large Scale Testing ◽  
The Cost

Many educational organizations are trying to reduce the cost of exams, the workload, delay of scoring, and the human errors. Also, organizations try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use Computerized Adaptive Testing (CAT) as the method for large scale testing. This chapter investigates the current state of CAT systems and identifies their strengths and weaknesses. It evaluates 10 CAT systems using an evaluation framework of 15 domains categorized into 3 dimensions: Educational, Technical and Economical. The results show that the majority of the CAT systems give priority to security, reliability, and maintainability. However, they do not offer to the examinee any advanced support and functionalities. Also, the feedback to the examinee is limited and the presentation of the items is poor. Recommendations are made in order to enhance the overall quality of a CAT system. For example, alternative multimedia items should be available so that the examinee would choose his preferred media type. Feedback could be improved by providing more information to the examinee or providing information anytime the examinee wished.

Evaluation of Computer Adaptive Testing Systems

2008 ◽  
pp. 1265-1281
Author(s):  
Anastasios A. Economides ◽  
Chrysostomos Roupas
Keyword(s):  
Large Scale ◽  
Adaptive Testing ◽  
Evaluation Framework ◽  
Computer Adaptive Testing ◽  
Three Dimensions ◽  
Educational Organizations ◽  
Human Errors ◽  
Media Type ◽  
Large Scale Testing ◽  
The Cost

Many educational organizations are trying to reduce the cost of the exams, the workload and delay of scoring, and the human errors. Also, they try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use computer adaptive testing (CAT) as the method for large scale testing. This article investigates the current state of CAT systems and identifies their strengths and weaknesses. It evaluates 10 CAT systems using an evaluation framework of 15 domains categorized into three dimensions: educational, technical, and economical. The results show that the majority of the CAT systems give priority to security, reliability, and maintainability. However, they do not offer to the examinee any advanced support and functionalities. Also, the feedback to the examinee is limited and the presentation of the items is poor. Recommendations are made in order to enhance the overall quality of a CAT system. For example, alternative multimedia items should be available so that the examinee would choose a preferred media type. Feedback could be improved by providing more information to the examinee or providing information anytime the examinee wished.

Evaluation of Computer Adaptive Testing Systems

2008 ◽  
pp. 596-612
Author(s):  
Anastasios A. Economides ◽  
Chrysostomos Roupas
Keyword(s):  
Large Scale ◽  
Adaptive Testing ◽  
Evaluation Framework ◽  
Computer Adaptive Testing ◽  
Three Dimensions ◽  
Educational Organizations ◽  
Human Errors ◽  
Media Type ◽  
Large Scale Testing ◽  
The Cost

Many educational organizations are trying to reduce the cost of the exams, the workload and delay of scoring, and the human errors. Also, they try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use computer adaptive testing (CAT) as the method for large scale testing. This article investigates the current state of CAT systems and identifies their strengths and weaknesses. It evaluates 10 CAT systems using an evaluation framework of 15 domains categorized into three dimensions: educational, technical, and economical. The results show that the majority of the CAT systems give priority to security, reliability, and maintainability. However, they do not offer to the examinee any advanced support and functionalities. Also, the feedback to the examinee is limited and the presentation of the items is poor. Recommendations are made in order to enhance the overall quality of a CAT system. For example, alternative multimedia items should be available so that the examinee would choose a preferred media type. Feedback could be improved by providing more information to the examinee or providing information anytime the examinee wished.

Evaluation of Computer Adaptive Testing Systems

2011 ◽  
pp. 220-236
Author(s):  
Anastasios A. Economides ◽  
Chrysostomos Roupas
Keyword(s):  
Large Scale ◽  
Adaptive Testing ◽  
Evaluation Framework ◽  
Computer Adaptive Testing ◽  
Three Dimensions ◽  
Educational Organizations ◽  
Human Errors ◽  
Media Type ◽  
Large Scale Testing ◽  
The Cost

Many educational organizations are trying to reduce the cost of the exams, the workload and delay of scoring, and the human errors. Also, they try to increase the accuracy and efficiency of the testing. Recently, most examination organizations use computer adaptive testing (CAT) as the method for large scale testing. This article investigates the current state of CAT systems and identifies their strengths and weaknesses. It evaluates 10 CAT systems using an evaluation framework of 15 domains categorized into three dimensions: educational, technical, and economical. The results show that the majority of the CAT systems give priority to security, reliability, and maintainability. However, they do not offer to the examinee any advanced support and functionalities. Also, the feedback to the examinee is limited and the presentation of the items is poor. Recommendations are made in order to enhance the overall quality of a CAT system. For example, alternative multimedia items should be available so that the examinee would choose a preferred media type. Feedback could be improved by providing more information to the examinee or providing information anytime the examinee wished.

Adaptive Weight Estimation of Latent Ability: Application to Computerized Adaptive Testing With Response Revision

2020 ◽  
pp. 107699862097280
Author(s):  
Shiyu Wang ◽  
Houping Xiao ◽  
Allan Cohen
Keyword(s):  
Large Scale ◽  
Computerized Adaptive Testing ◽  
Estimation Method ◽  
Adaptive Testing ◽  
Ability Estimation ◽  
Weight Estimation ◽  
Data Set ◽  
Adaptive Weight ◽  
Latent Ability ◽  
Estimation Procedures

An adaptive weight estimation approach is proposed to provide robust latent ability estimation in computerized adaptive testing (CAT) with response revision. This approach assigns different weights to each distinct response to the same item when response revision is allowed in CAT. Two types of weight estimation procedures, nonfunctional and functional weight, are proposed to determine the weight adaptively based on the compatibility of each revised response with the assumed statistical model in relation to remaining observations. The application of this estimation approach to a data set collected from a large-scale multistage adaptive testing demonstrates the capability of this method to reveal more information regarding the test taker’s latent ability by using the valid response path compared with only using the very last response. Limited simulation studies were concluded to evaluate the proposed ability estimation method and to compare it with several other estimation procedures in literature. Results indicate that the proposed ability estimation approach is able to provide robust estimation results in two test-taking scenarios.

Desertification or Sustainable Yields from Arid Environments

1988 ◽  
Vol 15 (3) ◽  
pp. 197-204 ◽  
Author(s):  
John L. Cloudsley-Thompson
Keyword(s):  
Third World ◽  
Large Scale ◽  
Agricultural Land ◽  
Agricultural Practices ◽  
Agricultural Products ◽  
Arid Environments ◽  
Multinational Organizations ◽  
Ecological Principles ◽  
The Cost

Throughout their existence, civilized peoples have been turning their environment into desert. The causes of desertification are well known—overgrazing, the felling of trees for fuel, and bad agricultural practices. Their effects are apparent in disasters such as the Sahel drought and recent famines in Ethiopia, the Sudan, and elsewhere. The population explosion enhances the extent of the environmental degradation. More agricultural land is currently being lost through salinization and waterlogging than is being created by new irrigation schemes, but this is only part of a problem that faces all tropical third-world countries and for which multinational organizations and the affluent nations of temperate regions are, regrettably and often unknowingly, largely responsible.Because the poorer countries receive, for their agricultural products, cash of which the market value does not take into account the cost to the environment of overexploiting the land, they are apparently doomed to a vicious circle of increasing poverty, deprivation, and famine. Yet it is not beyond the abilities of civilization to devise a viable scheme, based upon sound ecological principles, by which the quality of life of desert peoples could be immeasurably improved. Instead of trying to change the land to make it conform to present economic and political expectations, development should be adapted to exploit the potentialities of the environment as it exists. Such a scheme, profiting from the diversity of microenvironments that occur in desert regions, would encompass multiple land-use and the development of numerous small agricultural and other projects—rather than the large-scale schemes hitherto initiated in fragile environments, and which have so often led to large-scale disaster. By adopting it, the world would simultaneously be made both more stable and more productive for the benefit of all its inhabitants.

scholarly journals Pelatihan Kewirausahaan Bidang Pariwisata di Desa Cadas Ngampar Sentul

2022 ◽  
Vol 1 (1) ◽  
pp. 31-37
Author(s):  
Imam Ardiansyah ◽  
Sofiani Sofiani ◽  
Yudhiet Fajar Dewantara ◽  
Stephanie Rosanto ◽  
Vivian Octariana ◽  
...  
Keyword(s):  
Community Service ◽  
Economic Activity ◽  
Large Scale ◽  
Questions And Answers ◽  
Service Activity ◽  
Social Restriction ◽  
To Come ◽  
The Cost ◽  
The Village

ABSTRAK Penerapan kebijakan Pembatasan Sosial Berskala Besar (PSBB) oleh pemerintah  Indonesia berdampak besar terhadap penurunan kegiatan ekonomi di masyarakat.Hal tersebut memberikan pengaruh kepada sejumlah pengusaha terpaksa membuat keputusan dengan menutup usahanya dan sebagian karyawannya dirumahkan atau melakukan pemutusan hubungan kerja karena beban operasional yang tetap berjalan, seperti biaya sewa tempat, listrik, maupun gaji karyawan sementara tidak ada pemasukan. Bagi pengusaha yang memiliki modal yang besar, kemungkinan masih bisa bertahan untuk beberapa waktu ke depan. Namun lain halnya bila pengusaha yang memiliki modal yang relatif kecil atau pas-pasan. Tentu menjadi pekerjaan rumah yang tidak mudah untuk bertahan. UMKM merupakan salah satu sector yang terimbas dari adanya Pemabatasan tersebut. Oleh karena itu, Universitas Bunda Mulia melalui program Pengabdian kepada Masyarakat (PKM) ini, membantu para penggiat UMKM di Desa Cadas Ngampar untuk dapat bangkit dan berinovasi dalam menjalankan usahanya. Tujuan dari kegiatan pengabdian kepada masyarakat ini adalah untuk melatih kemampuan berwirausaha masyarakat di desa cadas ngampar.  Beberapa paparan materi yang disampaikan dalam PKM ini diharapkan dapat meningkatkan kualitas UMKM warga lokal dan meningkatkan lagi perekonomian di Desa Cadas Ngampar. Setelah melakukan penyuluhan dengan pemaparan materi dari masing-masing dosen maka hasil yang di dapatkan berdasarkan intensitas tanya jawab yang muncul, kegiatan pengabdian ini adalah adanya peningkatan pengetahuan dan pemahaman serta keterampilan peserta dalam kewirausahaan, dapat mengetahui manfaat-manfaat dari materi yang disampaikan, dan adanya tambahan motivasi dalam berwirausaha. Kata Kunci: Kewirausahaan, Pemasaran, Higiene dan Sanitasi ABSTRACTThe implementation of the Large-Scale Social Restriction (PSBB) policy by the Indonesian government has had a major impact on the decline in economic activity in the community. This has affected a number of entrepreneurs who were forced to make decisions by closing their businesses and some of their employees being laid off or terminating their employment due to ongoing operational expenses, such as the cost of renting a place, electricity, or employee salary while there is no income. For entrepreneurs who have a large capital, chances are they can survive for some time to come. However, it is different if the entrepreneur has a relatively small or mediocre capital. Of course, being homework that is not easy to survive. MSMEs are one of the sectors affected by these restrictions. Therefore, Universitas Bunda Mulia through this Community Service (PKM) program, helps MSME activists in Cadas Ngampar Village to be able to rise and innovate in running their business. The purpose of this community service activity is to train community entrepreneurship skills in the village of rock ngampar. Some of the material presentations presented in this PKM are expected to improve the quality of local MSMEs and improve the economy in Cadas Ngampar Village. After conducting counseling with material presentation from each lecturer, the results obtained were based on the intensity of the questions and answers that emerged, this service activity was an increase in the knowledge and understanding, and skills of participants in entrepreneurship, being able to find out the benefits of the material presented, and additional motivation in entrepreneurship. Keywords: Entrepreneurship, Marketing, Hygiene and SanitationABSTRAK Penerapan kebijakan Pembatasan Sosial Berskala Besar (PSBB) oleh pemerintah  Indonesia berdampak besar terhadap penurunan kegiatan ekonomi di masyarakat.Hal tersebut memberikan pengaruh kepada sejumlah pengusaha terpaksa membuat keputusan dengan menutup usahanya dan sebagian karyawannya dirumahkan atau melakukan pemutusan hubungan kerja karena beban operasional yang tetap berjalan, seperti biaya sewa tempat, listrik, maupun gaji karyawan sementara tidak ada pemasukan. Bagi pengusaha yang memiliki modal yang besar, kemungkinan masih bisa bertahan untuk beberapa waktu ke depan. Namun lain halnya bila pengusaha yang memiliki modal yang relatif kecil atau pas-pasan. Tentu menjadi pekerjaan rumah yang tidak mudah untuk bertahan. UMKM merupakan salah satu sector yang terimbas dari adanya Pemabatasan tersebut. Oleh karena itu, Universitas Bunda Mulia melalui program Pengabdian kepada Masyarakat (PKM) ini, membantu para penggiat UMKM di Desa Cadas Ngampar untuk dapat bangkit dan berinovasi dalam menjalankan usahanya. Tujuan dari kegiatan pengabdian kepada masyarakat ini adalah untuk melatih kemampuan berwirausaha masyarakat di desa cadas ngampar.  Beberapa paparan materi yang disampaikan dalam PKM ini diharapkan dapat meningkatkan kualitas UMKM warga lokal dan meningkatkan lagi perekonomian di Desa Cadas Ngampar. Setelah melakukan penyuluhan dengan pemaparan materi dari masing-masing dosen maka hasil yang di dapatkan berdasarkan intensitas tanya jawab yang muncul, kegiatan pengabdian ini adalah adanya peningkatan pengetahuan dan pemahaman serta keterampilan peserta dalam kewirausahaan, dapat mengetahui manfaat-manfaat dari materi yang disampaikan, dan adanya tambahan motivasi dalam berwirausaha. Kata Kunci: Kewirausahaan, Pemasaran, Higiene dan Sanitasi ABSTRACTThe implementation of the Large-Scale Social Restriction (PSBB) policy by the Indonesian government has had a major impact on the decline in economic activity in the community. This has affected a number of entrepreneurs who were forced to make decisions by closing their businesses and some of their employees being laid off or terminating their employment due to ongoing operational expenses, such as the cost of renting a place, electricity, or employee salary while there is no income. For entrepreneurs who have large capital, chances are they can survive for some time to come. However, it is different if the entrepreneur has a relatively small or mediocre capital. Of course, being a homework that is not easy to survive. MSMEs are one of the sectors affected by these restrictions. Therefore, Universitas Bunda Mulia through this Community Service (PKM) program, helps MSME activists in Cadas Ngampar Village to be able to rise and innovate in running their business. The purpose of this community service activity is to train community entrepreneurship skills in the village of rock ngampar. Some of the material presentations presented in this PKM are expected to improve the quality of local MSMEs and improve the economy in Cadas Ngampar Village. After conducting counseling with material presentation from each lecturer, the results obtained were based on the intensity of the questions and answers that emerged, this service activity was an increase in the knowledge and understanding and skills of participants in entrepreneurship, being able to find out the benefits of the material presented, and additional motivation in entrepreneurship. Keywords: Entrepreneurship, Marketing, Hygiene and Sanitation

scholarly journals BACKGROUND TO DEVELOPMENT OF TRANSPORT INFRASTRUCTURE OF KYIV CITY AGGLOMERATION

2019 ◽  
pp. 42-47
Author(s):  
I. Savchuk
Keyword(s):  
Significant Role ◽  
Large Scale ◽  
Urban Agglomeration ◽  
Transport Infrastructure ◽  
Residential Areas ◽  
Development Plans ◽  
Ownership Of Land ◽  
The Cost

The role of prerequisites in the development of the transport infrastructure of the capital of Ukraine is revealed. The author formulated methodological approaches to them. A comprehensive geographical description of the prerequisites for the development of the transport infrastructure of the Kyiv city agglomeration was carried out. It has been established that the main limitations are economic factors, which is caused by the highest cost of land resources in Ukraine precisely within this urban agglomeration. Natural factors continue to play a significant role only when carrying out specific prospecting for laying various types of infrastructure objects within it. There are new factors in the functioning and development of transport infrastructure. These include, first of all, the formation of united territorial communities. Their boundaries should be brought to life and their socio-economic development plans and spatial schemes should be developed. Thus, it is necessary to take into account local needs in the development of transport infrastructure with the general needs of the entire Kyiv city agglomeration. A significant role is played by the ownership of land. The concentration of land ownership in the hands of speculators and large developers leads to a sharp rise in the cost of the robot to acquire the necessary land for the construction of a new infrastructure. As a result, many new large residential areas do not have the necessary access roads and they are not connected to the citywide communications system. This leads to significant new problems for the solution of which it is necessary to coordinate new large-scale housing construction with the laying infrastructure. The main problem remains transport accessibility. Laying of highways to new buildings should be carried out at the expense of local budgets. However, there is often a conflict of interest between developers and local authorities. The latter do not want to invest substantial funds in the construction of roads and other types of infrastructure due to the fact that the cost of new relevant construction is much higher than the cost of housing built at the expense of borrowed funds. Thus, the existing suburban transport infrastructure takes on an ever-increasing stream of new daily commuter migrants. As a result, the quality of services provided drops sharply. This leads to a deterioration in the quality of life throughout the urban agglomeration.

An Efficient Algorithm for Measurement and Comparison of Large-Scale Hull Pieces in the Line-Heating Process

2004 ◽  
Vol 20 (01) ◽  
pp. 60-67
Author(s):  
Jong Gye Shin ◽  
Jong-Moo Lee ◽  
Jong-Ho Nam
Keyword(s):  
Manufacturing Process ◽  
Efficient Algorithm ◽  
Large Scale ◽  
Full Scale ◽  
Heating Process ◽  
Control Software ◽  
Comparison System ◽  
Human Errors ◽  
New Approach

When a curved plate is subject to deformation during the forming operation in the shipbuilding process, the deformed shape is repeatedly measured and compared to the designed shape. Because there are a number of large curved plates of different sizes and shapes, efficient measuring and comparison processes are essential to examine the quality of deformed plates rapidly and accurately, and consequently to enhance productivity in the whole manufacturing process. Currently, deformed plates are measured and examined using traditional templates. This practice is not only time-consuming but prone to human errors. Therefore, a new approach to streamlining the measurement and comparison processes needs to be proposed. In this paper, an efficient algorithm for the measurement and comparison of curved plates is introduced. A full-scale measurement machine with its control software is constructed, and an algorithm for the comparison system is implemented. The integrated algorithm is verified with many curved pieces of different sizes and shapes.

Sign in / Sign up

Export Citation Format

Share Document