scholarly journals ACCURACY OF EXPERT FRAUD DETECTION TECHNOLOGY IN REMOTE TEST EXAMS (PROCTORING)

2020 ◽  
pp. 44-66
Author(s):  
Alexander G. Shmelev
Keyword(s):  
Video Recording ◽  
Assessment Method ◽  
Expert Assessment ◽  
Multiple Choice Questions ◽  
Face To Face ◽  
Online Test ◽  
Detection Technology ◽  
Task Conditions ◽  
Offline Testing ◽  
Chronometric Analysis

The purpose (objective) of the empirical study is the measurement of the accuracy of expert-proctors in detecting cheating in online testing. Sample of the study. 35 test takers passed an online test of general knowledge on the basis of 30 multiple choice questions. Half of the subjects (18 persons) were “artificial cheaters” — they used cheat sheets with correct answers. Methods. The video recording of the testing process included a “screen capture” so that expert-proctors could observe all cursor movements, see a recording of the subject’s facial expressions and a visual focus of attention in a separate window (recording from the front camera), and could listen to the subject pronouncing the task conditions and answers (“oral decision”). 14 experts took part in rating of video recordings, of which 8 experts showed satisfactory results in terms of the level of accuracy in detecting cheating (their accuracy that was measured using the Kappa coefficient was higher than 0.5). Conclusions. A high asymmetric validity of expert assessments is revealed. More accurate experts allowed a negligible (about 5 percent) number of errors of the “false alarm” type, but a relatively large number of errors of the “skip” type. Recommendations are made for the practical use of the expert assessment method in combination with automatic chronometric analysis of the degree of atypical protocols and subsequent control of face-to-face offline testing of all suspected subjects (examinees).

scholarly journals E-learning Platform and Pedagogical Monitoring in the Context of Digital Transformation

2021 ◽  
Vol 30 (4) ◽  
pp. 131-138
Author(s):  
A. V. Khaperskaya ◽  
М. G. Minin
Keyword(s):  
Template Matching ◽  
Online Courses ◽  
Assessment Method ◽  
Project Work ◽  
Expert Assessment ◽  
Diagnostic Systems ◽  
Face To Face ◽  
Learning Platform ◽  
Automated Tools ◽  
Traditional Pedagogy

Upholding the quality of education in the absence of face-to-face contact requires an environmental approach and the creation of the unified online space and eLearning platform. The article makes the case for the relevance of creating automated tools for assessing the existing competencies of a listener necessary to form an individual learning route. The authors have developed methods for providing an automated pedagogical monitoring, described the principles of work of the automated diagnostic systems, and also gave the examples of its implementation. The suggested method combining key words and Template matching enables to optimize the eLearning platform. The article considers the possibilities of the system of automated pedagogical monitoring application when using the case technologies and students’ project work remotely in an electronic environment. In particular, the implementation of an expert assessment method using image theory and machine learning is presented. The article argues that electronic didactics makes it possible to expand the functionalities of pedagogical monitoring in conditions of digitalization, while maintaining the principles of traditional pedagogy. Taking into account the fact that there is a huge variety of different foreign and domestic aggregators of online courses it is necessary to develop a technology providing a selection of on-demand courses to reduce the time expenditure.

Improving the financial investment system as an object of business economics

2020 ◽  
Vol 26 (3) ◽  
pp. 508-526
Author(s):  
O.T. Astanakulov ◽  
E.G. Sheina
Keyword(s):  
Deductive Reasoning ◽  
Methodological Approach ◽  
Investment Project ◽  
Assessment Method ◽  
Expert Assessment ◽  
Business Economics ◽  
Financial Investment ◽  
Economic Relations ◽  
Investment Projects ◽  
Investment Control

Subject. This article explores the economic relations of economic entities concerning effective investment activities, combining elements of investment control and assessment of related risk. Objectives. The article aims to analyze and logically substantiate the stages and types of investment activities of enterprises and investment projects in-progress, as well as define a methodological approach to assessing project risks. Methods. For the study, we used a structural and logical analysis, and deductive reasoning. The methodological base of the study is based on the principles of the theory of finance, investment and risk management. Results. The article defines stages of assessing the financial condition of enterprises and proposes a methodological approach to assessing certain risks of an investment project based on the risk ranking by degree of probability and significance of an event through applying the expert assessment method. The article also presents a practice-oriented risk map for investment projects and clarifies the concept of Investment Control. Conclusions. The results of the study can help address the significant for the Russian economy issue of stimulating and developing investment activities at enterprises, as well as implementing and evaluating the effectiveness of investment projects at the micro-and macro-levels of the country's economy.

Developing the basis of the matrix model of the regional innovation subsystem

2020 ◽  
Vol 18 (11) ◽  
pp. 2183-2204
Author(s):  
E.I. Moskvitina
Keyword(s):  
Russian Federation ◽  
Matrix Model ◽  
Federal District ◽  
Assessment Method ◽  
Expert Assessment ◽  
Regional Innovation ◽  
Regional Strategies ◽  
Analysis And Synthesis ◽  
The Matrix ◽  
The Russian Federation

Subject. This article deals with the issues related to the formation and implementation of the innovation capacity of the Russian Federation subjects. Objectives. The article aims to develop the organizational and methodological foundations for the formation of a model of the regional innovation subsystem. Methods. For the study, I used the methods of analysis and synthesis, economics and statistics analysis, and the expert assessment method. Results. The article presents a developed basis of the regional innovation subsystem matrix model. It helps determine the relationship between the subjects and the parameters of the regional innovation subsystem. To evaluate the indicators characterizing the selected parameters, the Volga Federal District regions are considered as a case study. The article defines the process of reconciliation of interests between the subjects of regional innovation. Conclusions. The results obtained can be used by regional executive bodies when developing regional strategies for the socio-economic advancement of the Russian Federation subjects.

Evaluation software for effects produced by MOOC in mediums with different linguistically levels

2018 ◽  
Vol 34 (3) ◽  
pp. 633-645
Author(s):  
Cornel Samoilă ◽  
Doru Ursuţiu ◽  
Vlad Jinga
Keyword(s):  
Statistical Analysis ◽  
Statistical Methods ◽  
Rapid Assessment ◽  
Assessment Method ◽  
Behavioral Changes ◽  
Strong Negation ◽  
Face To Face ◽  
Made In ◽  
The Way

Abstract MOOC appearance has produced, in a first phase, more discussions than contributions. Despite pessimistic opinions or those catastrophic foreseeing the end of the classic education by accepting MOOC, the authors consider that, as it is happening in all situations when a field is reformed, instead of criticism or catastrophic predictions, an assessment should be simply made. MOOC will not be better or worse if it is discussed and dissected but can be tested in action, perfected by results, or abandoned if it has no prospects. Without testing, no decision is valid. A similarity between the MOOC appearance and the appearance of the idea of flying machines heavier than air can be made. In the flight case, the first reaction was a strong negation (including at Academies level) and only performing the first independent flight with an apparatus heavier than air has shifted orientation from denial to contributions. So, practical tests clarified the battle between ideas. The authors of this article encourage the idea of testing–assessment and, therefore, imagined and proposed one software for quickly assess whether MOOC produces changes in knowledge, by simply transferring courses from ‘face-to-face’ environment into the virtual one. Among the methods of statistical analysis for student behavioral changes was chosen the Keppel method. It underpins the assessment method of this work being approached using both the version with one variable and also with three variables. It is intended that this attempts to pave the way for other series of rapid assessment regarding MOOC effects (using other statistical methods). We believe, that this is the only approach that can lead either to improve the system or to renunciation.

Pagdihon: The Art and Language of Pottery Making in Bari, Sibalom, Antique

2020 ◽  
Author(s):  
Edbert Jay M. Cabrillos ◽  
◽  
Rowena S. Cabrillos ◽  
Keyword(s):  
Participant Observation ◽  
Video Recording ◽  
Ethnographic Study ◽  
The Other ◽  
Educational Institutions ◽  
Face To Face ◽  
Factors Influencing ◽  
Photo Documentation ◽  
Language Pattern ◽  
Art And Language

Pottery is seen as creation of ornamentals, cooking and storing materials. Yet, while economic gains are often considered from producing these materials, the artistic and linguistic aspects have been ignored. This study discusses the factors influencing the culture of pottery, the processes of pottery making, and seeks to uncover the language used in processes of pottery making in Bari, Sibalom, Antique. A qualitative research employing ethnographic study with participant observation and face to face interviews using photo documentation, video recording and open-ended questions in gathering the data was employed. There were five manugdihon, or potters, purposively selected as key informants of the study. The study revealed that environmental factors influenced the culture of pottery making in the barangay. There were seven main processes in pottery making. These included gathering and preparing of materials, mixing the needed materials, cleaning the mixed clay, forming of desired shape, detaching, drying, and polishing and varnishing. Further findings indicate that, together the other processes, the language used in poterry making was archaic Kinaray-a, the language of the province. This language pattern suggests a specialized pottery making. Ultimately, the study suggest that the manugdihon should continue their artistic talents so that the language may be preserved. The educational institutions of the province may provide ways to include pottery making in the curriculum so that the art and language of pottery making will be preserved and promoted.

Expert methods of developing of innovative technologies for the production of cast tools. Part 1. Formation of a complex of functional indicators of technology

2021 ◽  
pp. 57-61
Author(s):  
Keyword(s):  
High Speed ◽  
High Reliability ◽  
Assessment Method ◽  
Innovative Technology ◽  
Expert Assessment ◽  
Innovative Technologies ◽  
Design Expert ◽  
Effective Technology ◽  
Casting Design

A method for the development an effective technology for casting of billets of insert cutters with specified properties from high-speed steels for milling cutters of rotors of mining combines is proposed, including the identification of a set of goals, the choice of priority technology and the determination of the specified characteristics of the technology. An alternative method of expert assessment is proposed, which ensures high reliability of the results. Keywords: innovative technology, casting, design, expert assessment method. [email protected], [email protected]

PERFORMANCE ANALYSIS OF ARTISTIC GYMNASTICS FINALISTS AT THE WORLD CHAMPIONSHIP UNEVEN BARS 2019

2020 ◽  
Vol 8 (2) ◽  
pp. 52-57
Author(s):  
Larisa Saveleva ◽  
Botova
Keyword(s):  
Performance Analysis ◽  
Olympic Games ◽  
Assessment Method ◽  
Expert Assessment ◽  
World Championship ◽  
Research Outcomes ◽  
The World ◽  
Competition Rules ◽  
Instructional Literature ◽  
Quantitative Indicators

Experts in artistic gymnastics are constantly analyzing the outcomes of the gymnasts' performance at world and continental championships. However, the analyses cover only the assessment of the final scores of athletes and their ranks. There is a lack of research focused on the structure of routines and components of the scores obtained for the performance of combinations. The purpose of this study was to determine the content of competitive programs performed by the finalists of the World Championship Uneven Bars 2019 and to identify areas for the exercise development in this kind of all-around events on the eve of the Olympic Games. Methods and organization of the research: we carried out the analysis of video materials of the International Gymnastics Federation (FIG), the analysis of the competition rules for the current Olympic cycle, additional newsletters, and scientific instructional literature. We used an expert assessment method to identify the components of competitive combinations. Research results. The study determined quantitative indicators of the content of gymnast combinations on uneven bars (the number and difficulty groups of elements, including jumps and dismounts, modal and frequently performed elements, connection value bonus). We have revealed the trend for reduction of the total number of elements of competitive routines. It occurs due to reduction of the number of binders (“dilution”) elements, reduction of the number of elements of difficulty groups below 0.4 points, and increasing number of flight elements performed in a “cascade” way. We have revealed the trend for the use of elements of F (0.6 points) and G (0.7 points) difficulty groups in competitive combinations of the strongest gymnasts, which characterizes a significant increase in the coordination complexity of the programs and increases the requirements for the training of gymnasts. Conclusion. The research outcomes can provide the basis for predicting competitive programs on uneven bars at the upcoming Olympic Games, making amendments to the system of training gymnasts and the content of combinations to increase competitiveness at major international competitions, as well as making competition rules proposals for the next Olympic cycle.

TOOLS FOR ASSESSING THE COMPETITIVENESS OF A COMMERCIAL ENTERPRISE

2020 ◽  
Vol 10 (9) ◽  
pp. 2047-2061
Author(s):  
I.V. Sibiryatkina ◽  
Keyword(s):  
Weighted Average ◽  
Assessment Method ◽  
Practical Significance ◽  
Expert Assessment ◽  
Complex Coefficient ◽  
Advantages And Disadvantages ◽  
Proposed Model ◽  
Commercial Enterprise ◽  
Business Entities ◽  
Adaptation Model

The article presents the systematization of approaches to assess the enterprises' level of competitiveness. The advantages and disadvantages of the most famous models for assessing the competitiveness of business entities are considered. The identified shortcomings made it possible to form a hypothesis for studying the enterprises' competitiveness, taking into account the industry factor, financial criteria and quality indicators of the enterprise. For the formation of an objective adaptation model for assessing the competitiveness of an enterprise, taking into account its industry specificity, the author's approach to assessing the competitiveness of an enterprise, taking into account industry specifics, based on the relative and qualitative indicators of the enterprise's activities, selected by the expert assessment method, is considered. For trade enterprises, groups of the most significant indicators have been formed that characterize the competitiveness in the areas of observation of the sales of a trade enterprise, its costs, financial position and financial results, for the market share of the trade enterprise, the level of prices for goods, for the level of service of the trade enterprise. The indicators characterizing the level of competitiveness of a trading enterprise are divided into relative critical indicators and a group of qualitative critical indicators, which are included in the calculation of the complex coefficient of enterprise competitiveness model based on the theory of effective competition according to the weighted average arithmetic formula. The article presents the results of approbation of the proposed methodology on the example of the “PAO Magnit” trading enterprise and its trade competitors operating in Voronezh. The obtained results of the author's methodology for assessing the competitiveness of a trading enterprise have practical significance; the proposed model can be adapted according to the criteria for selecting indicators and their quantitative indicator, which contributes to the use of this toolkit in future studies of the competitiveness of trading enterprises.

Single-choice or multiple true false questions (Kprime):Direct comparison of online tests in pharmacology over one year (Preprint)

2021 ◽  
Author(s):  
Joachim Neumann ◽  
Stephanie Simmrodt ◽  
Beatrice Bader ◽  
Bertram Opitz ◽  
Ulrich Gergs
Keyword(s):  
Medical Students ◽  
Multiple Choice ◽  
Test Group ◽  
Learning Objectives ◽  
Multiple Choice Questions ◽  
Online Test ◽  
True Answer ◽  
Group A ◽  
One Year ◽  
Group B

BACKGROUND There remain doubts about whether multiple choice answer formats (single choice) offer the best option to encourage deep learning or whether SC formats simply lead to superficial learning or cramming. Moreover, cueing is always a drawback in the SC format. Another way to assess knowledge is true multiple-choice questions in which one or more answers can be true and the student is not aware of how many true answers are to be anticipated (K´ or Kprime question format). OBJECTIVE Here, we compared both single-choice answers (one true answer, SC) with Kprime answers (one to four true answers out of four answers, Kprime) for the very same learning objectives in a study of pharmacology in medical students. METHODS Two groups of medical students were randomly subjected to a formative online test: group A) was first given 15 SC (#1-15) followed by 15 different Kprime questions (#16-30). The opposite design was used for group B. RESULTS The mean number of right answers was higher for SC than for Kprime questions in group A (10.02 vs. 8.63, p < 0.05) and group B (9.98 vs. 6.66, p < 0.05). The number of right answers was higher for nine questions of SC compared to Kprime in group A and for eight questions in group B (pairwise T-Test, p < 0.05). Thus, SC is easier to answer than the same learning objectives in pharmacology given as Kprime questions. One year later, four groups were formed from the previous two groups and were again given the same online test but in a different order: the main result was that all students fared better in the second test than in the initial test; however, the gain in points was highest if initially mode B was given. CONCLUSIONS Kprime is less popular with students being more demanding, but could improve memory of subject matter and thus might be more often used by meidcal educators.

Low intensity CBT assessment: in person or by phone

2010 ◽  
pp. 89-96 ◽  
Author(s):  
Paul Farrand ◽  
Chris Williams
Keyword(s):  
Assessment Method ◽  
Shared Decision ◽  
Face To Face ◽  
Common Features ◽  
Low Intensity ◽  
Psychological Therapies ◽  
The Many

Chapter 6 reviews an approach to undertaking a LI face-to-face or telephone assessment that forms the basis of the Improving Access to Psychological Therapies (IAPT) programme in England and the Five Areas approach in Scotland. Interestingly, whilst the assessment method in IAPT and Five Areas differs in several respects (e.g. the formulation model), the chapter establishes the many common features that form the basis of a standard LI approach to face-to-face and telephone assessment. In particular, the chapter presents LI assessment as a structured, and in many ways prescribed, process that aims to help the LI practitioner and the patient reach a shared decision regarding next steps.

Sign in / Sign up

Export Citation Format

Share Document