scholarly journals Designing Standards-Setting for Levels of Mathematical Proficiency in Measurement and Geometry: Multidimensional Item Response Model

2021 ◽  
Vol 10 (6) ◽  
pp. 103
Author(s):  
Sudarat Phaniew ◽  
Putcharee Junpeng ◽  
Keow Ngang Tang
Keyword(s):  
Assessment Tool ◽  
Multinomial Logit Model ◽  
Measurement Model ◽  
Two Dimensions ◽  
Item Response Model ◽  
Multidimensional Item Response ◽  
Item Fit ◽  
Mathematical Proficiency ◽  
Mathematical Process

This study intends to design and verify the quality of a model that measures mathematical proficiency and aims to set the standards in measuring levels of proficiency in the subjects of measurement and geometry. Construct modeling was employed to design a mathematical proficiency measurement model which consists of the mathematical process and the dimensions of a conceptual structure. A total of 517 Secondary Year 1 students were selected from the big data to participate as test-takers. Design-based research encompassing four phases was used to verify the quality of the mathematical proficiency measurement model. A Multidimensional Random Coefficient Multinomial Logit model was used to examine the standards-setting of the mathematical proficiency measurement model. The results indicated that the two dimensions of mathematical proficiency can be further divided into five levels, from non-response/irrelevance to strategic/extended thinking and extended abstract structure for mathematical process and conceptual structural dimensions, respectively. The assessment tool covers 18 items with 15 multiple-choice items and three subjective items in measurement and geometry. Moreover, the results also demonstrated that the validity evidence associated with the internal structure of the multidimensional model is fit. Besides, reliability evidence, as well as item fit, is compliance with the quality of the mathematical proficiency measurement model as illustrated in analysis of the standard error of measurement and infit and outfit of the items. Finally, the researchers managed to set standards for the mathematical proficiency measurement model based on the assessment criterion results from the Wright Map. In conclusion, the standards-setting of the mathematical proficiency measurement model provides substantial information, particularly for measuring those students who are above the lowest level of mathematical proficiency because the error for estimating proficiency was low.

scholarly journals Development of an assessment tool for mathematical reading, analytical thinking and mathematical writing

2020 ◽  
Vol 9 (4) ◽  
pp. 955
Author(s):  
Nuttida Kesorn ◽  
Putcharee Junpeng ◽  
Metta Marwiang ◽  
Kissadapan Pongboriboon ◽  
Keow Ngang Tang ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Fourth Grade ◽  
Two Dimensions ◽  
Random Coefficients ◽  
Ratio Test ◽  
Item Response Model ◽  
Mathematical Writing ◽  
Analytical Thinking ◽  
Fourth Grade Students

<p>The main objective of this research was to develop and validate the quality of an assessment tool for evaluating the mathematical reading, analytical thinking, and mathematical writing skills of fourth-grade students. We randomly selected 222 fourth grade students across multiple schools of varying sizes to take the assessment. Multidimensional Random Coefficients Multinomial Item Response Model was applied to validate the quality of the developed assessment tool. A design-based research methodology was adopted to develop the assessment tool encompassing four phases as follows: 1) analyze how students solve mathematical problems; 2) develop the assessment tool; 3) validation of the tool; and 4) reflection. The results of this research indicate that the assessment tool consisting of 19 items and two dimensions is a reliable and valid metric to measure mathematical reading, mathematical writing and analytical ability of fourth graders. The Likelihood-Ratio test showed that the multidimensional model fits better in comparison to the unidimensional model. It can be concluded that each item is qualified to assess the students and relevant to the developed dimensional examination structure.</p>

scholarly journals Designing and verifying a tool for diagnosing scientific misconceptions in genetics topic

2020 ◽  
Vol 9 (3) ◽  
pp. 564
Author(s):  
Sasithorn Kantahan ◽  
Putcharee Junpeng ◽  
Sompong Punturat ◽  
Keow Ngang Tang ◽  
Perman Gochyyev ◽  
...  
Keyword(s):  
Assessment Tool ◽  
Item Analysis ◽  
Multinomial Logit Model ◽  
Two Dimensions ◽  
Sufficient Evidence ◽  
Evidence Based ◽  
Multidimensional Model ◽  
Outcome Space ◽  
Best Fit

The main purpose of this study was to design and verify the quality of an assessment aimed at diagnosing scientific misconceptions among students enrolled in 10th-grade biology subjects. A sample consisted of N=200 students from schools under the administration of the Office of Secondary Educational Service 31, Nakhon Ratchasima province. We employed the design-based approach, which consists of four phases, namely, construct map, item design, outcome space, and Wright map. Multidimensional Random Coefficient Multinomial Logit Model (MRCMLM) was used to evaluate the quality of the assessment tool. The assessment tool consists of two dimensions, namely, knowledge and reasoning. The assessment tool is comprised of 40 items, with 20 items tapping each of the dimensions. Findings form item analysis and modeling revealed sufficient evidence on the internal structure and validity of the instrument. It can be concluded that the unidimensional model is more appropriate than the multidimensional model for diagnosing scientific misconceptions in the genetics topic for dichotomously scored with four options in each item. The polytomous scored type should be further investigated to determine the best fit model in the items relating to evidence-based reasoning for supporting students’ answers.

scholarly journals Constructing Progress Maps of Digital Technology for Diagnosing Mathematical Proficiency

2019 ◽  
Vol 8 (6) ◽  
pp. 90
Author(s):  
Putcharee Junpeng ◽  
Jenrop Krotha ◽  
Kanokphon Chanayota ◽  
KeowNgang Tang ◽  
Mark Wilson
Keyword(s):  
Digital Technology ◽  
Multinomial Logit Model ◽  
Building Blocks ◽  
Total Sample ◽  
Two Dimensions ◽  
Random Coefficients ◽  
Learning Goals ◽  
Validity And Reliability ◽  
Mathematical Proficiency ◽  
And Algebra

This research aims to construct and validate progress maps of digital technology for diagnosing the multidimensional mathematical proficiency (MP) in Number and Algebra for Grade 7 students utilizing the Construct Modeling Approach. Researchers employed four building blocks as follows. Firstly, researchers developed the progress maps as an assessment framework of multidimensional MP. This is followed by creating the test for diagnosing MP. Next, researchers assigned scoring criteria and created the transition points of students&rsquo; MP levels. Finally, researchers validated the quality of the progress maps through empirical evidence. A total sample 1,500 Grade 7 students was used to support the validity and reliability evidence of the progress maps through the Wright Map using Multidimensional Random Coefficients Multinomial Logit Model. Results revealed that there were two dimensions of progress maps, namely mathematical procedures (MAP) and structure of learning outcome (SLO), and the researchers investigated three strands of validity evidence, namely test content, response processes, and internal structure. The reliability values in the MAP and SLO were 0.84 and 0.80 respectively. Finally, the Grade 7 students were mainly found to be at level-2 in the MAP dimension (44.95%) and the SLO dimension (61.57%). The experts&rsquo; evaluation results showed that the digital technology that was developed at the &ldquo;most appropriate&rdquo; quality levels in terms of usefulness, suitability, and accuracy, and at the &ldquo;very appropriate&rdquo; for the feasibility aspect, and hence is successfully contributing to the clarification of learning goals, to support for student-centered instruction, and that it is helpful in improving in teacher professional development.

scholarly journals Developing an assessment framework of multidimensional scientific competencies

2020 ◽  
Vol 9 (4) ◽  
pp. 963
Author(s):  
Sasima Intasoi ◽  
Putcharee Junpeng ◽  
Keow Ngang Tang ◽  
Jatuphum Ketchatturat ◽  
Yidan Zhang ◽  
...  
Keyword(s):  
Multinomial Logit Model ◽  
Three Dimensions ◽  
Assessment Framework ◽  
Seventh Grade ◽  
Item Fit ◽  
Construct Maps ◽  
Four Levels ◽  
Standard Error Of Measurement ◽  
Scientific Competencies

The study aimed to develop and validate an assessment framework of multidimensional scientific competencies for seventh-grade students in the northeastern region of Thailand. A total of 289 samples with three different scientific competency levels were randomly selected to participate as testtakers. The design-based research encompassing four phases of the construct modelling approach, namely construct maps, item design, outcome space, and Wright map. Multidimensional Random Coefficient Multinomial Logit model was employed to examine the quality of the created assessment framework of multidimensional scientific competencies. The results showed that scientific competence is comprised of three dimensions, namely explain phenomena scientifically, evaluate and design scientific inquiry, and interpret data and evidence scientifically. Each dimension can be further categorized into four levels. The assessment framework consists of 16 items. The results revealed that there is validity evidence regarding internal structure based on the comparison of the model fit and Wright map. Moreover, results also indicated that the reliability evidence and item fit are compliance with the quality of the assessment framework as revealed in the analysis of standard error of measurement and infit and outfit of the items. It can be concluded that the assessment framework is currently prevalent to assess the scientific competencies of seventh-grade students.

scholarly journals Evaluating Instrument Quality: Rasch Model – Analyses of Post Test of Curriculum 2013 Training

2018 ◽  
Vol 9 (1) ◽  
pp. 67-86
Author(s):  
Komalasari
Keyword(s):  
Rasch Model ◽  
Rasch Analysis ◽  
Item Difficulty ◽  
Measurement Model ◽  
Test Items ◽  
Item Fit ◽  
Ability Levels ◽  
Post Test ◽  
Instrument Quality

The main purpose of this study was to evaluate the quality of post test utilized by LPMP Central Kalimantan Indonesia in curriculum 2013 training for X grade teachers. It uses Rasch analysis to explore the item fit, the reliability ( item and person), item difficulty, and the Wrigh map of post test. This study also applies Classical Test Teory (CTT) to determine item discrimination and distracters. Following a series of iterative Rasch analyses that adopted the “data should fit the model” approach, 30 items post test of curriculum 2013 training was analyzed using Acer Conquest 4 software, software based on Rasch measurement model. All items of post test of curriculum 2013 training are sufficient fit to the Rasch model. The difficulty levels (i.e. item measures) for the 30 items range from –1.746 logits to +1.861 logits. The item separation reliability is acceptable at 0.990 and person separation reliability is low at 0.485. The wright map indicates that the test is difficult for the teachers or the teachers have low ability in knowledge of curriculum 2013. The post test items cannot cover all the ranges of the teachers’ ability levels. Items discrimination of post test of curriculum 2013 training grouped into fair discrimination (item 2, 4, 5, 8, 11, 18) and poor discrimination (1, 3, 6, 7, 9, 10,12, 13, 14, 15, 16, 17, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30). Some distracters from item 1, 2, 6, 7, 8, 9, 11, 13, 16, 17, 18, 19, 20, 22, 24, 25, 27, 28, 29 and 30 are problematic. These distracters require further investigation or revision.   Key words: Rasch analysis, training, curriculum 2013, post test

Instrumental and Ideological Union Commitment: Longitudinal Assessment of Construct Validity

2001 ◽  
Vol 17 (2) ◽  
pp. 98-111 ◽  
Author(s):  
Anders Sjöberg ◽  
Magnus Sverke
Keyword(s):  
Construct Validity ◽  
Temporal Stability ◽  
Strong Support ◽  
Internal Consistency Reliability ◽  
Measurement Model ◽  
Two Dimensions ◽  
Model Parameters ◽  
Longitudinal Assessment ◽  
Union Commitment ◽  
Union Participation

Summary: Previous research has identified instrumentality and ideology as important aspects of member attachment to labor unions. The present study evaluated the construct validity of a scale designed to reflect the two dimensions of instrumental and ideological union commitment using a sample of 1170 Swedish blue-collar union members. Longitudinal data were used to test seven propositions referring to the dimensionality, internal consistency reliability, and temporal stability of the scale as well as postulated group differences in union participation to which the scale should be sensitive. Support for the hypothesized factor structure of the scale and for adequate reliabilities of the dimensions was obtained and was also replicated 18 months later. Tests for equality of measurement model parameters and test-retest correlations indicated support for the temporal stability of the scale. In addition, the results were consistent with most of the predicted differences between groups characterized by different patterns of change/stability in union participation status. The study provides strong support for the construct validity of the scale and indicates that it can be used in future theory testing on instrumental and ideological union commitment.

Family Influence on Business: Application of A Modified F-PEC Scale to Private Small Business In Vietnam

2013 ◽  
pp. 38-53
Author(s):  
Nam Vu Hoang ◽  
Anh Truong Tuan ◽  
Nghia Nguyen Ke
Keyword(s):  
Small Business ◽  
Factor Structure ◽  
Measurement Model ◽  
Two Dimensions ◽  
Family Influence ◽  
Cultural Aspect ◽  
Culture Dimensions ◽  
Business Application ◽  
Original Scale ◽  
Asian Context

This paper uncovers dimensions of family influence on private small business in Vietnam. Although the F-PEC scale, which comprises three subscales for power, experience and culture dimensions of family influence, has been validated in the literature, application of the scale in an Asian context, like Vietnam, may face challenges due to context differences. The study modified the original scale based on qualitative findings from five interviews with entrepreneurs and comments on the scale from business scholars. Data from a survey of 143 entrepreneurs were used for EFA, resulting in four factors. And CFA proves fitness of the measurement model of the four-factor structure to the data, in which two dimensions regarding the cultural aspect were confirmed.

Quality of life in Hungarian polio survivors

2021 ◽  
Author(s):  
Erika Viktória Miszory ◽  
Melinda Járomi ◽  
Annamária Pakai
Keyword(s):  
Quality Of Life ◽  
Mental Health ◽  
Sample Selection ◽  
Cross Sectional Study ◽  
Two Dimensions ◽  
Cross Sectional ◽  
Emotional Role ◽  
The Difference ◽  
Polio Survivors

Abstract Aim The number of Hungarian polio patients can be estimated at approximately 3000. Polio infection is currently affecting people 56–65 years of age. The aim of the study was to reveal the quality of life of patients living with polio virus in Hungary. Subject and methods The quantitative cross-sectional study was conducted in January–April 2017 among polyomyelitis patients living in Hungary. In the non-random, targeted, expert sample selection, the target group was composed of patients infected with poliovirus (N = 268). We have excluded those who refused to sign the consent statement. Our data collection method was an SF-36 questionnaire. Using the IBM SPSS Statistics Version 22 program, descriptive and mathematical statistics (χ2-test) were calculated (p < 0.05). Results The mean age of the members of the examined population is 63.5 years; 68.1% were women and 31.90% were men. The majority of the respondents were infected by the polyovirus in 1956 (11.9%), 1957 (24.3%), and 1959 (19.5%). Polio patients, with the exception of two dimensions (mental health, social operation), on the scale of 100 do not reach the “average” quality of life (physical functioning 23 points, functional role 36 points, emotional role 47 points, body pain 48 points, general health 42 points, vitality 50 points, health change 31 points). Conclusion The quality of life of polio patients is far below the dimensions of physical function, while the difference in mental health compared to healthy people is minimal. It would be important to educate health professionals about the existing disease, to develop an effective rehabilitation method.

scholarly journals A Systematic Review of Healthcare Professionals’ Knowledge, Self-Efficacy and Attitudes Towards Working with Autistic People

2021 ◽  
Author(s):  
Kirsten Corden ◽  
Rebecca Brewer ◽  
Eilidh Cage
Keyword(s):  
Health Professionals ◽  
Self Efficacy ◽  
Healthcare Professionals ◽  
Assessment Tool ◽  
Vital Role ◽  
Narrative Synthesis ◽  
Quality Assessment Tool ◽  
Professional Background ◽  
Autistic People

AbstractHealthcare professionals play a vital role in identifying and supporting autistic people. This study systematically reviewed empirical research examining healthcare professionals’ knowledge, self-efficacy and attitudes towards working with autistic people. Thirty-five studies were included. The included studies sampled a range of countries and professional backgrounds. A modified quality assessment tool found the quality of the included studies was moderately good. Narrative synthesis indicated that healthcare professionals report only moderate levels of autism knowledge and self-efficacy, and often lack training. Variation within and between countries and professional background was not explained by demographic factors. The reviewed evidence suggests health professionals’ limited knowledge and self-efficacy in working with autistic people is a challenge to the provision of healthcare for autistic individuals.

scholarly journals The formation of patient trust and its transference to online health services: the case of a Dutch online patient portal for rehabilitation care

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Lex van Velsen ◽  
Ina Flierman ◽  
Monique Tabak
Keyword(s):  
Health Services ◽  
Structural Equation ◽  
Assessment Tool ◽  
Measurement Model ◽  
Care Team ◽  
Care Organization ◽  
Patient Portal ◽  
Patient Trust ◽  
Related Factors ◽  
Ehealth Service

Abstract Background Trust is widely recognized as a crucial factor in successful physician–patient communication and patient engagement in treatment. However, with the rise of eHealth technologies, such as online patient portals, the role of trust and the factors that influence it need to be reconsidered. In this study, we aim to identify the factors that contribute to trust in an eHealth service and we aim to identify the consequences of trust in an eHealth service in terms of use. Methods The Patient Trust Assessment Tool was provided to new outpatients of a rehabilitation center in the Netherlands, that were expected to use the center’s online patient portal. Via this tool, we assessed five trust-related factors. This data was supplemented by questions about demographics (age, gender, rehabilitation treatment) and data about use (number of sessions, total time spent in sessions), derived from data logs. Data was analyzed via Partial Least Squares Structural Equation Modelling. Results In total, 93 patients participated in the study. Out of these participants, 61 used the portal at least once. The measurement model was considered good. Trust in the organization was found to affect trust in the care team (β = .63), trust in the care team affected trust in the treatment (β = .60). Both, trust in the care team and trust in the treatment influenced trust in the technology (β = .42 and .30, respectively). Trust in the technology affected the holistic concept trust in the service (β = .78). This holistic trust in the service finally, did not affect use. Conclusions This study shows that the formation of this trust is not unidimensional, but consists of different, separate factors (trust in the care organization, trust in the care team and trust in the treatment). Trust transfer does take place from offline to online health services. However, trust in the service does not directly affect the use of the eHealth technology.

Sign in / Sign up

Export Citation Format

Share Document