scholarly journals Towards a science inquiry test in primary education: development of items and scales

2021 ◽  
Vol 8 (1) ◽  
Author(s):  
Margus Pedaste ◽  
Aleksandar Baucal ◽  
Elle Reisenbuk

Abstract Background Inquiry-based learning is widely applied in science education; however, so far, the outcomes of learning process have been systematically assessed mainly at the secondary school level. For primary school students, there is no valid instrument for assessing the outcomes of their science inquiry. The aim of the current study was to develop a test for assessing science learning outcomes (analytical skills, planning skills, interpretation skills, and science knowledge) related to the five phases of inquiry-based learning (Orientation, Conceptualization, Investigation, Conclusion, and Discussion) at primary education level (ISCED 1). Results A set of contextualized science tasks was created to assess each of the learning outcomes at three levels. The Science Inquiry Test for Primary Education (SIT-PE test) was developed through several phases, including pilot studies with large groups of fourth-grade students (10 to 11 years of age). The 1 PL Item Response Theory model was used to analyze the quality of the test and items based on the test’s reliability score, item difficulty measure, infit and outfit indices, estimation of item discrimination, item-scale correlation, and the quality of the scoring key. The final test, consisting of 24 items, was used with a sample of 1868 students. The analysis showed the SIT-PE test to be of good quality on test level and item level and to also have good predictive validity. Confirmatory factor analysis revealed that the correlated factors model and second-order factor model of the science learning outcomes both had a good fit to data collected with the SIT-PE test. Confirmatory factor analysis confirmed the multidimensionality of science learning outcomes and validated four dimensions of the model: analytical skills, planning skills, interpretation skills, and science knowledge. Conclusions In conclusion, the SIT-PE test could be further used for assessing students’ inquiry competence in primary education. However, it could be even further improved in several ways and this study provides guidelines on how to do that. In addition, the SIT-PE provides test developers with information on how to design derivations of the SIT-PE test for assessing particular science inquiry outcomes or the same outcomes in older age groups as well.

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Annette Keuning-Plantinga ◽  
Evelyn J. Finnema ◽  
Wim Krijnen ◽  
David Edvardsson ◽  
Petrie F. Roodbol

Abstract Background Person-centred care is the preferred model for caring for people with dementia. Knowledge of the level of person-centred care is essential for improving the quality of care for patients with dementia. The person-centred care of older people with cognitive impairment in acute care (POPAC) scale is a tool to determine the level of person-centred care. This study aimed to translate and validate the Dutch POPAC scale and evaluate its psychometric properties to enable international comparison of data and outcomes. Methods After double-blinded forward and backward translations, a total of 159 nurses recruited from six hospitals (n=114) and via social media (n=45) completed the POPAC scale. By performing confirmatory factor analysis, construct validity was tested. Cronbach’s alpha scale was utilized to establish internal consistency. Results The confirmatory factor analysis showed that the comparative fit index (0.89) was slightly lower than 0.9. The root mean square error of approximation (0.075, p=0.012, CI 0.057–0.092) and the standardized root mean square residual (0.063) were acceptable, with values less than 0.08. The findings revealed a three-dimensional structure. The factor loadings (0.69–0.77) indicated the items to be strongly associated with their respective factors. The results also indicated that deleting Item 5 improved the Cronbach’s alpha of the instrument as well as of the subscale ‘using cognitive assessments and care interventions’. Instead of deleting this item, we suggest rephrasing it into a positively worded item. Conclusions Our findings suggest that the Dutch POPAC scale is sufficiently valid and reliable and can be utilized for assessing person-centred care in acute care hospitals. The study enables nurses to interpret and compare person-centred care levels in wards and hospital levels nationally and internationally. The results form an important basis for improving the quality of care and nurse-sensitive outcomes, such as preventing complications and hospital stay length.


2020 ◽  
Vol 32 (1) ◽  
pp. 3-34
Author(s):  
Ka Hing Lau ◽  
Robin Stanley Snell

Service-learning was introduced into Hong Kong over a decade ago, yet there is a research gap about the self-perceived student learning outcomes, partly due to the lack of a reliable measurement instrument across disciplines and service-learning types. This study evaluated a recently created Service-Learning Outcomes Measurement Scale (S-LOMS) through confirmatory factor analysis with 629 students. S-LOMS measures self-perceived student learning outcomes with 56 items covering various learning outcome domains under four higher-order categories: knowledge application; personal and professional skills; civic orientation and engagement; and self-awareness. Alternative measurement models were compared, with the results indicating that although a model with 11 domains and without higher-order categories was preferred, there was also support for a model with 10 domains subsumed under the four higher-order categories. Multi-sample analyses indicated that both models were stable across gender.


2019 ◽  
Vol 14 (4) ◽  
Author(s):  
R. Trafford Crump ◽  
Alex Peterson ◽  
Camille Charbonneau ◽  
Kevin V. Carlson ◽  
Jason M. Sutherland ◽  
...  

Introduction: We aimed to evaluate the psychometric properties of the 26-item Expanded Prostate Cancer Index Composite (EPIC-26) for measuring the quality of life in patients treated for localized prostate cancer. The EPIC-26 is a patient-reported outcome instrument recommended for use with patients treated for localized prostate cancer. Methods: This study is based on data collected prospectively between September 2014 and February 2017 in Alberta, Canada. Men were treated with either radical prostatectomy or radiation therapy and administered the EPIC-26. Responses to the EPIC-26 were the primary outcome. Construct validity was measured using confirmatory factor analysis. Reliability was measured using Chronbach’s alpha and item-total correlation. Ceiling and floor effects were also investigated. Results: EPIC-26 response data from 205 participants (prostatectomy =138; radiation=60; both=7) were used in this analysis. The EPIC-26 was administered an average of 33.8 weeks after treatment. The confirmatory factor analysis model did not meet the threshold for adequate fit. Several items had near-zero factor loadings and were non-significant. Four out of the EPIC- 26’s five domains met the acceptable reliability threshold based on Cronbach’s alpha. Ceiling effects were observed in four out of five domains. Conclusions: The EPIC-26 demonstrated poor construct validity, adequate reliability, and large ceiling effects. Several issues were observed, suggesting that the instrument’s five domains were not well-defined by their respective items. The original EPIC’s conceptual framework should be reviewed and the shortened instrument revised to improve its performance for measuring post-treatment quality of life.


2017 ◽  
Vol 36 (8) ◽  
pp. 1789-1795 ◽  
Author(s):  
Ana-Belén Meseguer-Henarejos ◽  
Juan-José Gascón-Cánovas ◽  
José-Antonio López-Pina

2009 ◽  
Vol 28 (1) ◽  
pp. 56-70 ◽  
Author(s):  
Ahmet Ekici ◽  
Mark Peterson

This study focuses on how relationships among constructs representing (1) consumer trust in market-related institutions (CTMRI), (2) distrust for individuals (DFI), and (3) subjective quality of life (QOL) differ across groups separated by the poverty line in a developing country (Turkey). A comparison of models across the two groups using multisample confirmatory factor analysis indicates that there is a correlation only between CTMRI and QOL for consumers below the poverty line (r = .43); there are no correlations between any of the three constructs for consumers above the poverty line. Accordingly, there is a unique relationship between QOL and CTMRI among financially constrained consumers in a developing country. Below the poverty line, consumers with lower trust in market-related institutions tend to report lower QOL, while those with higher trust in market-related institutions tend to report higher QOL.


2019 ◽  
Vol 10 (4) ◽  
pp. 11-19
Author(s):  
Pornthep Jewpairojkit ◽  
Thanin Rattanolarn ◽  
Songwut Ekwuttiwongsa

Abstract Nowadays, the standard of professional education, interior architecture and interior design at higher education in Thailand must meet the certification criteria from the Professional Council. However, the expected learning outcomes results in the past studies has not studied the components of expected learning outcomes that are explicit and consistent with the 20-Year National Strategy. The researchers therefore aim to study such components to lead to the development of a standard measurement model to further expected learning outcomes. The researchers synthesized the initial components through the document to create and develop a questionnaire to evaluate the level of performance by estimating 5 levels and collect data with the senior students in the curriculum that has been approved by the Professional Council. Divided into 362 samples in the analysis of survey elements and 364 samples in Confirmatory Factor Analysis by Cluster Random Sampling from state and private universities. The survey component analysis resulted in 6 components along with confirmatory factor analysis of empirical component. The results of the sequence analysis of weight components from descending order as follows: Cognitive for profession skill (CP)=.96 Interpersonal relationship and responsibility skill (IR)=.89 In numerical communication and information technology skill(NC)=.87 Profession future of Thailand skill (PF)=.85 Knowledge for Professional practice skill (KPP)=.73 Moral and ethical skill (ME) =.67.


2018 ◽  
Vol 34 (1) ◽  
pp. 147-157
Author(s):  
Asep Kurniawan ◽  
Yun Yun

SMEs (Small and Medium-size Enterprise) in Indonesian are only growing in terms of quantity and undeveloped in terms of quality, which causing a decrease in competitiveness. The solution is not through the provision of financial approach but can be in a form of an agency that knows about the market or those who can provide knowledge about the quality of the product. The objective of this study is to analyze the competence of small businesses and business survival of SMEs in culinary field of Bandung. The analytical method used in this research is Confirmatory Factor Analysis (CFA). CFA method is used to measuring the relationship between each indicator to explain the competence of small business and business sustainability. Indicator of entrepreneur competence and business survival can be explained by all indicator researcher has been used. Small businesses of culinary in Bandung have a high category for the dimension of opportunity competency, organizing competency, strategy competency, social competency, and commitment competency. Nevertheless, there is still category of sufficient dimension, that is conceptual competency.


2017 ◽  
Author(s):  
Akbar Iskandar

Abstrak Tujuan dari tulisan ini adalah untuk menganalisis tingkat kualitas butir instrument tes dan non tes berdasarkan tingkat validitas konstruk dan reliabilitas. Jenis penelitian ini masuk dalam kategori pengembangan instrument yang biasa disebut dengan R & D. Penelitian ini merupakan bentuk simulasi terhadap instrument yang telah dikembangkan sebelumnya yaitu tahun 2016 dan 2017 yang berjalan selama 4 bulan. Teknik analisis data yang digunakan adalah teknik analisis kuantitatif dimana yang dimaksud adalah Confirmatory Faktor Analisys (CFA) dengan bantuan software LISREL. Hasil analisis dalam simulasi ini ditemukan bahwa butir instrument yang dikembangkan memenuhi criteria valid secara konstruk dan reliabel baik untuk instrument tes maupun non tes.Kata kunci: lisrel, amos, SEM, instrument, tes, non tes, pengukuran, penilaian, evaluasi, spssAbstractThe purpose of this paper is to analyze the level of grain quality of test and non test instruments based on the level of construct validity and reliability. This type of research belongs to the category of instrument development commonly referred to as R & D. This research is a form of simulation of the instrument that has been developed previously ie 2016 and 2017 which runs for 4 months. Data analysis technique used is quantitative analysis technique which is Confirmatory Factor Analysis (CFA) with the help of LISREL software. The results of the analysis in this simulation found that the developed instrument items meet the criteria valid construct and reliability for instrument test and non test instruments.Keywords: lisrel, amos, SEM, instrument, test, non test, measurement, assessment, evaluation, spss


Sign in / Sign up

Export Citation Format

Share Document