scholarly journals Reliability of crowdsourcing as a method for collecting emotions labels on pictures

2019 ◽  
Vol 12 (1) ◽  
Author(s):  
Olga Korovina ◽  
Marcos Baez ◽  
Fabio Casati

Abstract Objective In this paper we study if and under what conditions crowdsourcing can be used as a reliable method for collecting high-quality emotion labels on pictures. To this end, we run a set of crowdsourcing experiments on the widely used IAPS dataset, using the Self-Assessment Manikin (SAM) emotion collection instrument, in order to rate pictures on valence, arousal and dominance, and explore the consistency of crowdsourced results across multiple runs (reliability) and the level of agreement with the gold labels (quality). In doing so, we explored the impact of targeting populations of different level of reputation (and cost) and collecting varying numbers of ratings per picture. Results The results tell us that crowdsourcing can be a reliable method, reaching excellent levels of reliability and agreement with only 3 ratings per picture for valence and 8 per arousal, with only marginal difference between target populations. Results for dominance were very poor, echoing previous studies on the data collection instrument used. We also observed that specific types of content generate diverging opinions in participants (leading to higher variability or multimodal distributions), which remain consistent across pictures of the same theme. These can inform the data collection and exploitation of crowdsourced emotion datasets.

2021 ◽  
Vol 5 (2) ◽  
Author(s):  
Sujatmi Sujatmi

This research is motivated by the discovery of teachers who do not compile test instruments according to the indicators and learning objectives, teachers have not been able to arrange instruments according to the level of difficulty, and the use of language according to the level of understanding of students. This study aims to improve the ability of teachers to compile test instruments through integrated self-assessment training activities. This research is in the form of school action research conducted on teachers of SDN 007 Pematang Ibul. The research subjects were 17 teachers. The data collection instrument used an observation sheet. The results showed that in the first cycle the teacher's ability to compile the test instrument was 71.78 which was a good criterion, then increased in the second cycle to 87.14 which reached very good criteria. Based on the results of the study it can be concluded that through integrated self-assessment training can improve the ability of SDN 007 Pematang Ibul teachers in preparing test instruments.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
David Prah ◽  
Hagan Sibiri

Purpose As the impact of COVID-19 on businesses was impossible to predict, so is the future of migrant entrepreneurs – some of whom, before the outbreak, had to deal with immigrant status associated challenges. Against this backdrop, this paper aims to focus on African migrant entrepreneurs in China, much less studied ethnic migrants who have always lived on the margins of Chinese society, to examine their entrepreneurial resilience under COVID-19 in China. Design/methodology/approach The study used a qualitative design using a survey and semi-structured follow-up interviews as the primary data collection instrument. The questions in the questionnaire guide were adapted from the Center for Global Development survey instrument designed to gauge the resilience of SMEs under COVID-19. Findings Although most business operations in China are impacted, African migrant businesses were very hit due to existing social challenges coupled with their informality (i.e. operating at a low level of organization), lack of contingency plans and lack of stimulus support. COVID-19 is thus not only a force majeure that threatens the growth expectation of African owned-business but also presents a threat to their very existence in an already challenging society for Africans. Research limitations/implications Although the study has achieved its intended purpose, the sample was relatively small due to the low return rate of questionnaires and the difficulties in reaching out to target respondents due to the restrictive measures on movements during the data collection period. Originality/value This paper draws attention to the entrepreneurship-related challenges faced by ethnic migrants in China during a crisis. The social challenges of Africans living in China became a global topical issue during the COVID-19 outbreak in China. However, little is known about their entrepreneurship endeavors and the associated difficulties. This paper helps our understanding of African businesses’ resilience in China during uncertain times, such as the one created by COVID-19.


2017 ◽  
Vol 9 (3) ◽  
pp. 88
Author(s):  
Debasis Bharadwaj ◽  
Ayesha Farooq ◽  
Biranchi N Jena

Purpose: Recent studies highlighted the increase of competiveness and fluctuation in pharmaceutical market share, the industry facing tremendous pressure. Hence the sector has the necessity to embrace the goal of delivering their products and services with value. Specifically, diabetes care in the pharmaceutical industry has been an important agenda for providing high quality services and products to the customers in past few decades. Therefore, the present paper critically views the impact of value discipline dimensions on organizational performance and competitive advantage of diabetes care in both developed and developing countries.Design/ methodology/ Approach: This research involves in secondary data collection due to achieving the objectives framed. Moreover, it perceives the association between the variables is not possible, conducting interviews with respondents in both developed and developing countries are also difficultFindings: The finding shows that there is animpact of value discipline dimensions on organizational performance and competitive advantage of diabetes care in both developed and developing countries via secondary data collection method. Research Limitations/ Implications: This study is limited to secondary research and all the findings inferred are from the information available from secondary sources.Practical implications: The impact of value discipline dimensionson organizational performance and competitive advantage of diabetes care is effective in the context of both developed and developing countries.Originality/ Value: Understanding the value discipline dimensions impact on organizational performance and competitive advantage of diabetes care is anew one. Hence this paper proposes this concept in both developed and developing countries perspective. 


2021 ◽  
Vol 8 ◽  
pp. 205435812110037
Author(s):  
Robert R. Quinn ◽  
Farah Mohamed ◽  
Robert Pauly ◽  
Tracy Schwartz ◽  
Nairne Scott-Douglas ◽  
...  

Background: Most of the patients with end-stage kidney failure are treated with dialysis. Jurisdictions around the world are actively promoting peritoneal dialysis (PD) because it is equivalent to hemodialysis in terms of clinical outcomes, but is less costly. Unfortunately, PD penetration remains low. Objectives: The Starting dialysis on Time, At Home, on the Right Therapy (START) Project had 2 overarching goals: (1) to provide information that would help programs increase the safe and effective use of PD, and (2) to reduce inappropriate, early initiation of dialysis in patients with kidney failure. In this article, we focus on the first objective and describe the rationale for START and the methods employed. Design: The START Project was a comprehensive, province-wide quality improvement intervention. Setting: The START project was implemented in both Alberta Kidney Care (AKC)-South and AKC-North, including all 7 renal programs in the province. Patients: The project included all patients who commenced maintenance dialysis between October 1, 2015, and March 31, 2018, in Alberta, Canada who met our inclusion criteria. Measurements: We reported baseline characteristics of incident dialysis patients overall, and by site. Our key performance indicator was the proportion of patients who received PD for any period of time within 180 days of the first dialysis treatment. Reports also included detailed metrics pertaining to the 6 steps in the process of modality selection and we had the capacity to provide more granular data on an as-needed basis. To understand loss of PD patients, we reported the numbers of incident patients who recovered kidney function, experienced technique failure, received a transplant, were lost to follow-up, transferred to another program, or died. Methods: START provided dialysis programs with a conceptual framework for understanding the drivers of PD utilization. High-quality, detailed data were collected using a tool that was custom-built for this purpose, and were mapped to steps in the process of care that drove the outcomes of interest. This allowed sites to identify gaps in care, develop action plans, and implement local interventions to address them. The process was supported by an Innovation Learning Collaborative consisting of 3 learning sessions that brought frontline staff together from across the province to share strategies and learnings. Ongoing data collection allowed teams to determine whether their interventions were effective at each subsequent learning session, and to revisit their interventions if required (the “Plan-Do-Study-Act Cycle”). Results: Future work will report on the impact of the START project on incident PD utilization at a provincial and regional level. Limitations: The time required to design and implement interventions in practice, as well as the need for multiple PDSA (Plan-Do-Study-Act) cycles to see results, meant that the true potential may not be realized during a relatively short intervention period. Change required buy-in and support from local and provincial leadership and frontline staff. In the absence of accountability for local performance, we relied on the goodwill of participating programs to use the information and resources provided to effect change. Finally, the burden of documentation and data collection for frontline staff was high at baseline. We anticipated that adding supplemental data collection would be difficult. Conclusions: The START project was a comprehensive, province-wide initiative to maximize the safe and effective use of PD in Alberta, Canada. It standardized the management of incident dialysis patients, leveraged high-quality data to facilitate the reporting of metrics mapped to steps in the process of care that drove incident PD utilization, and helped programs to identify gaps in care and target them for improvement. Future work will report on the impact of the program on incident utilization at the provincial and regional level.


2020 ◽  
Vol 21 (02) ◽  
pp. 51-57
Author(s):  
Shoimatul Jahra ◽  
Mukrromah Norjannah ◽  
Ahmad Fauzan Hidayatullah

The results show that Indonesia is in the second position as the largest country in the world that contributes waste to the sea. This plastic waste is one of the biggest polluters in the sea which can be a serious threat to marine ecosystems. One of the right treatments is the plastic bag diet. This certainly raises various perceptions among the community as an effort to save the environment. This study aims to determine the perceptions of UIN Walisongo Semarang students on the plastic diet program as an effort to save marine ecosystems. This study used a qualitative descriptive research method, with a data collection instrument in the form of a questionnaire. Based on the research that has been done, the 193 samples obtained indicate that the perception of UIN Walisongo students towards the plastic diet as an effort to save marine ecosystems is very positive and supports this movement. This is evidenced by the knowledge of students about the use of plastics and its dangers, the impact of plastic on marine ecosystems and about the plastic diet program.


Author(s):  
Kamaludin, Joko Widodo, Eko Handoyo, Ali Masyhar

This research aims to find a theoretical concept of assessment for students during the Covid-19 pandemic as a follow-up step for assessment activities in obtaining the validity of assessment results. The research method used is qualitative research methods and conducted on ten Public Elementary School Principals with at least 5 years of teaching experience. The purposive sampling method was used to determine the informants. Here focuses on Analyzing the assessment process and the student learning outcomes process through online learning process during the Covid-19 pandemic. Data collection techniques, in this study, are observation, interviews, and documentation. To obtain data validity, this study uses triangulation of data collection techniques. The result of this study is an integrated assessment theory concept towards the students during the Covid-19 pandemic. The impact of this study provides a new breakthrough, because it provides a different perspective of assessment by integrating 3 perspectives in assessing student academic performance as well as collaborating their own function, namely the teacher's as an assessor of student cognitive competence, the student's as assessors of their own affective competence (self assessment), and the parents’ as assessors of students' psychomotor competencies. The further research can be carried out when the Covid-19 pandemic has ended so that it can provide a different view of the effectiveness of using integrated assessment as an assessment method which can be used sustainably in the future.


2019 ◽  
Vol 16 (1) ◽  
pp. 41
Author(s):  
Alya Karamina Alven ◽  
Lidwina Mutia Sadasri

The activity of crowdfunding through the internet-based platform is becoming a usual thing in Indonesia. Some celebrities do this kind of activity in the context of birthday crowdfunding. The objective of this research is to analyze the relations between celebrity’s philantrophy through crowdfunding and its implication to the celebrity. This is a quantitative research with questionnaire as the data collection instrument to analyze the impact of crowdfunding to the value of Indonesian celebrity, Luna Maya. The findings of this research show the impact that arise from internet-based platform that enabling celebrity to build her visibilities on public’s opinion through crowdfunding.Keywords: celebrity, crowdfunding, philantrophy


2014 ◽  
Vol 67 (3) ◽  
Author(s):  
Nasuha Lee Abdullah ◽  
Khairur Rijal Jamaludin ◽  
Hayati Habibah Abdul Talib

Scientific research requires data collection instrument that is valid and reliable. This paper describes the framework and operationalization of the variables before outlining the process of developing the instrument to assess the impact of operational complexity (OC) on quality management (QM) practices and operational performance (OP) relationships in Malaysia’s Electrical and Electronics (E&E) manufacturing industry. It also highlights issues of common method bias, reliability and validity of the instrument, pretest method and response rate. The pretest result is then discussed. The paper concludes that personal interviews are especially effective in detecting ambiguity in the instrument. Pilot run provides insights to the challenges ahead such as low response rate, tedious data analysis procedures and enables informed decision to be made in preparation for full-scale data collection.


Author(s):  
Siti Mariana Ulfa

AbstractHumans on earth need social interaction with others. Humans can use more than one language in communication. Thus, the impact that arises when the use of one or more languages is the contact between languages. One obvious form of contact between languages is interference. Interference can occur at all levels of life. As in this study, namely Indonesian Language Interference in Learning PPL Basic Thailand Unhasy Students. This study contains the form of interference that occurs in Thai students who are conducting teaching practices in the classroom. This type of research is descriptive qualitative research that seeks to describe any interference that occurs in the speech of Thai students when teaching practice. Data collection methods in this study are (1) observation techniques, (2) audio-visual recording techniques using CCTV and (3) recording techniques, by recording all data that has been obtained. Whereas the data wetness uses, (1) data triangulation, (2) improvement in perseverance and (3) peer review through discussion. Data analysis techniques in this study are (1) data collection, (2) data reduction, (3) data presentation and (4) conclusions. It can be seen that the interference that occurs includes (1) interference in phonological systems, (2) interference in morphological systems and (3) interference in syntactic systems. 


2018 ◽  
Vol 2 (3) ◽  
pp. 429
Author(s):  
Abd. Mulud

This research is motivated by the low ability of basic technique of playing the students' grate V.A SDN 002Pantai Cermin Kabupaten Kampar. This study aims to improve the basic techniques of playing kasti throughcooperative learning methods paired type students class V.A SDN 002 Pantai Cermin Kampar District. Thesubjects of this study are students of class V.A SDN 002 Pantai Cermin Kabupaten Kampar with the number ofstudents as many as 28 people. The form of research is classroom action research. The instrument of thisresearch consisted of performance instrument and data collection instrument in the form of observation sheet ofteacher activity and student activity. The basic technique ability to play with cooperative method of paired typelearning in VA VAN 002 Pantai Cermin Kabupaten Kabupaten Kampar average of basic technique ability toplay the students' census on the initial test is categorized less with percentage 48,9%, in cycle I increase to68,4% with sufficient category whereas in cycle II the average ability of students is categorized very high with90.8% percentage. The cassical completeness specified in this study that 80% of students have been declaredthoroughly achieved. The conclusion of this research is the application of cooperative learning method pair typecan improve basic technique of playing kasti.


Sign in / Sign up

Export Citation Format

Share Document