scholarly journals Empirical Study on Effects of Self-Correction in Crowdsourced Microtasks

2021 ◽  
Vol 8 ◽  
Author(s):  
Masaki Kobayashi ◽  
Hiromi Morita ◽  
Masaki Matsubara ◽  
Nobuyuki Shimizu ◽  
Atsuyuki Morishima
Keyword(s):  
Perceptual Learning ◽  
Learning Effect ◽  
The Self ◽  
Long Term Effects ◽  
Learning Potential ◽  
Second Stage ◽  
Complementary Approach ◽  
Additional Costs ◽  
Statistical Algorithms

Self-correction for crowdsourced tasks is a two-stage setting that allows a crowd worker to review the task results of other workers; the worker is then given a chance to update their results according to the review.Self-correction was proposed as a complementary approach to statistical algorithms, in which workers independently perform the same task.It can provide higher-quality results with low additional costs. However, thus far, the effects have only been demonstrated in simulations, and empirical evaluations are required.In addition, as self-correction provides feedback to workers, an interesting question arises: whether perceptual learning is observed in self-correction tasks.This paper reports our experimental results on self-corrections with a real-world crowdsourcing service.We found that:(1) Self-correction is effective for making workers reconsider their judgments.(2) Self-correction is effective more if workers are shown the task results of higher-quality workers during the second stage.(3) A perceptual learning effect is observed in some cases. Self-correction can provide feedback that shows workers how to provide high-quality answers in future tasks.(4) A Perceptual learning effect is observed, particularly with workers who moderately change answers in the second stage. This suggests that we can measure the learning potential of workers.These findings imply that requesters/crowdsourcing services can construct a positive loop for improved task results by the self-correction approach.However, (5) no long-term effects of the self-correction task were transferred to other similar tasks in two different settings.

scholarly journals Empirical Study on Effects of Self-Correction in Crowdsourced Microtasks

2021 ◽  
Vol 8 ◽  
Author(s):  
Masaki Kobayashi ◽  
Hiromi Morita ◽  
Masaki Matsubara ◽  
Nobuyuki Shimizu ◽  
Atsuyuki Morishima
Keyword(s):  
Perceptual Learning ◽  
Learning Effect ◽  
The Self ◽  
Long Term Effects ◽  
Learning Potential ◽  
Second Stage ◽  
Complementary Approach ◽  
Additional Costs ◽  
Statistical Algorithms

Self-correction for crowdsourced tasks is a two-stage setting that allows a crowd worker to review the task results of other workers; the worker is then given a chance to update their results according to the review.Self-correction was proposed as a complementary approach to statistical algorithms, in which workers independently perform the same task.It can provide higher-quality results with low additional costs. However, thus far, the effects have only been demonstrated in simulations, and empirical evaluations are required.In addition, as self-correction provides feedback to workers, an interesting question arises: whether perceptual learning is observed in self-correction tasks.This paper reports our experimental results on self-corrections with a real-world crowdsourcing service.We found that:(1) Self-correction is effective for making workers reconsider their judgments.(2) Self-correction is effective more if workers are shown the task results of higher-quality workers during the second stage.(3) A perceptual learning effect is observed in some cases. Self-correction can provide feedback that shows workers how to provide high-quality answers in future tasks.(4) A Perceptual learning effect is observed, particularly with workers who moderately change answers in the second stage. This suggests that we can measure the learning potential of workers.These findings imply that requesters/crowdsourcing services can construct a positive loop for improved task results by the self-correction approach.However, (5) no long-term effects of the self-correction task were transferred to other similar tasks in two different settings.

scholarly journals Empirical Study on Effects of Self-Correction in Crowdsourced Microtasks

2021 ◽  
Vol 8 ◽  
Author(s):  
Masaki Kobayashi ◽  
Hiromi Morita ◽  
Masaki Matsubara ◽  
Nobuyuki Shimizu ◽  
Atsuyuki Morishima
Keyword(s):  
Perceptual Learning ◽  
Learning Effect ◽  
The Self ◽  
Long Term Effects ◽  
Learning Potential ◽  
Second Stage ◽  
Complementary Approach ◽  
Additional Costs ◽  
Statistical Algorithms

Self-correction for crowdsourced tasks is a two-stage setting that allows a crowd worker to review the task results of other workers; the worker is then given a chance to update their results according to the review.Self-correction was proposed as a complementary approach to statistical algorithms, in which workers independently perform the same task.It can provide higher-quality results with low additional costs. However, thus far, the effects have only been demonstrated in simulations, and empirical evaluations are required.In addition, as self-correction provides feedback to workers, an interesting question arises: whether perceptual learning is observed in self-correction tasks.This paper reports our experimental results on self-corrections with a real-world crowdsourcing service.We found that:(1) Self-correction is effective for making workers reconsider their judgments.(2) Self-correction is effective more if workers are shown the task results of higher-quality workers during the second stage.(3) A perceptual learning effect is observed in some cases. Self-correction can provide feedback that shows workers how to provide high-quality answers in future tasks.(4) A Perceptual learning effect is observed, particularly with workers who moderately change answers in the second stage. This suggests that we can measure the learning potential of workers.These findings imply that requesters/crowdsourcing services can construct a positive loop for improved task results by the self-correction approach.However, (5) no long-term effects of the self-correction task were transferred to other similar tasks in two different settings.

Effects of Self-Recording for On-Task and Academic Responding: A Long Term Analysis

1983 ◽  
Vol 6 (3) ◽  
pp. 5-12 ◽  
Author(s):  
T. F. McLaughlin
Keyword(s):  
Academic Performance ◽  
The Self ◽  
Long Term Effects ◽  
School Students ◽  
Behaviorally Disordered ◽  
Baseline Design ◽  
Task Behavior ◽  
On Task Behavior ◽  
Academic Responding

The purpose of the present study was to examine the immediate and long term effects of self-recording for on-task responding. Data were taken for both on-task and accuracy of performance in handwriting, spelling, and math with three behaviorally disordered elementary school students. The effects of self-recording were evaluated in a multiple-baseline design across subject-matter areas. The overall results revealed an increase in both on-task and academic performance when the students self-recorded their own on-task behavior. Only one pupil decreased his academic performance over that noted in baseline. Follow-up data taken during the first, second, and third school years yielded rates of on-task behavior over that of baseline, but not at the levels found in the self-recording condition. The practical aspects of the self-recording procedure were discussed.

Stage Two of the Crisis and the Long-term Changes

2006 ◽  
pp. 85-106
Author(s):  
Stig Tenold
Keyword(s):  
Economic Impact ◽  
National Level ◽  
Oil Price ◽  
Shipping Industry ◽  
Long Term Effects ◽  
International Shipping ◽  
Second Stage ◽  
Long Term Changes ◽  
Price Hike

This chapter discusses the second stage of the shipping crisis and the long-term effects that it evoked. It traces the crisis from the mid-seventies low, through a brief flourish in 1978, to the plummet in shipping trade in the early 1980s, ten years after the first oil price hike. It analyses the response within the industry to the depression, noting in particular the emergence of Asian flags of convenience (FOCs). It also analyses the situation in 1970s Norway, considering the heavy presence of Norway in the international shipping industry and their deadweight tonnage numbers to demonstrate the economic impact of the crisis on a national level.

scholarly journals ‘It’s the economy, stupid’: Lessons of a longitudinal study of depression in Argentina

2021 ◽  
pp. 002076402199968
Author(s):  
Héctor Badellino ◽  
María Emilia Gobbo ◽  
Eduardo Torres ◽  
María Emilia Aschieri ◽  
Martín Biotti ◽  
...  
Keyword(s):  
Risk Factors ◽  
Longitudinal Study ◽  
Severe Depression ◽  
Poor Sleep ◽  
Long Term Effects ◽  
Poor Sleep Quality ◽  
Second Stage ◽  
Prevalence Of Depression ◽  
Primary And Secondary School

Background: On March 20, 2020, the Argentine Ministry of Health imposed a mandatory quarantine, which still persists. Aim: The aim of this study is to determine the variation in the prevalence of depression since the beginning of the quarantine and the evolution of risk factors, with special emphasis on the population’s concerns. Methods: A longitudinal study was carried out using a digital questionnaire disseminated in social networks. The first stage (T1) was carried out from March 29 to April 12 and the second stage (T2) from May 23 to June 12, 2020. The prevalence of depression was measured using the 9-item Patients Health Questionnaire (PHQ-9). Results: The prevalence of moderate/severe depression increased from 24.3% in T1 to 47.8% in T2 (p: 0.000). Risk factors increased significantly: age 18–27, female, primary and secondary school, smoking and having a poor sleep quality (p: 0.000). The concerns about ‘a family member getting sick’ (OR: 1.28; CI: 1.04–1.58; p: 0.016), ‘changes at work’ (OR: 2.24; CI: 1.79–2.81; p: 0.000), ‘running out of money’ (OR: 1.43; CI: 1.20–1.71; p: 0.000) and ‘being unemployed’ (OR: 2.99; CI: 2.55–3.52; p: 0.000) were risk factors for depression. On the other hand, the concern about ‘getting the virus’ (OR: 0.73; CI: 0.61–0.87; p: 0.001) was not a risk factor. Conclusions: The extended quarantine in Argentina is associated with an increase in the prevalence of depression; the high impact of economic and social concerns on mental health must be considered in order to avoid long-term effects.

Ovarian Dysfunction in Fetally Irradiated Beagles

1977 ◽  
Vol 35 ◽  
pp. 658-659
Author(s):  
T. M. Seed ◽  
M. H. Sanderson ◽  
D. L. Gutzeit ◽  
T. E. Fritz ◽  
D. V. Tolle ◽  
...  
Keyword(s):  
Gamma Rays ◽  
Low Dose ◽  
Long Term Effects ◽  
Ovarian Dysfunction ◽  
Dose Rates ◽  
Highly Sensitive ◽  
Microscopic Evaluation ◽  
Ovarian Pathology ◽  
Normal Offspring

The developing mammalian fetus is thought to be highly sensitive to ionizing radiation. However, dose, dose-rate relationships are not well established, especially the long term effects of protracted, low-dose exposure. A previous report (1) has indicated that bred beagle bitches exposed to daily doses of 5 to 35 R 60Co gamma rays throughout gestation can produce viable, seemingly normal offspring. Puppies irradiated in utero are distinguishable from controls only by their smaller size, dental abnormalities, and, in adulthood, by their inability to bear young.We report here our preliminary microscopic evaluation of ovarian pathology in young pups continuously irradiated throughout gestation at daily (22 h/day) dose rates of either 0.4, 1.0, 2.5, or 5.0 R/day of gamma rays from an attenuated 60Co source. Pups from non-irradiated bitches served as controls. Experimental animals were evaluated clinically and hematologically (control + 5.0 R/day pups) at regular intervals.

Ultrastructural investigations of MDL 19,660-induced effects on the canine platelet and megakaryocyte

1990 ◽  
Vol 48 (3) ◽  
pp. 374-375
Author(s):  
D.E. Loudy ◽  
J. Sprinkle-Cavallo ◽  
J.T. Yarrington ◽  
F.Y. Thompson ◽  
J.P. Gibson
Keyword(s):  
Antidepressant Drug ◽  
Beagle Dogs ◽  
Long Term Effects ◽  
Short Term ◽  
Platelet Counts ◽  
Toxicological Studies ◽  
Induced Aggregation ◽  
Internal Architecture

Previous short term toxicological studies of one to two weeks duration have demonstrated that MDL 19,660 (5-(4-chlorophenyl)-2,4-dihydro-2,4-dimethyl-3Hl, 2,4-triazole-3-thione), an antidepressant drug, causes a dose-related thrombocytopenia in dogs. Platelet counts started to decline after two days of dosing with 30 mg/kg/day and continued to decrease to their lowest levels by 5-7 days. The loss in platelets was primarily of the small discoid subpopulation. In vitro studies have also indicated that MDL 19,660: does not spontaneously aggregate canine platelets and has moderate antiaggregating properties by inhibiting ADP-induced aggregation. The objectives of the present investigation of MDL 19,660 were to evaluate ultrastructurally long term effects on platelet internal architecture and changes in subpopulations of platelets and megakaryocytes.Nine male and nine female beagle dogs were divided equally into three groups and were administered orally 0, 15, or 30 mg/kg/day of MDL 19,660 for three months. Compared to a control platelet range of 353,000- 452,000/μl, a doserelated thrombocytopenia reached a maximum severity of an average of 135,000/μl for the 15 mg/kg/day dogs after two weeks and 81,000/μl for the 30 mg/kg/day dogs after one week.

Sign in / Sign up

Export Citation Format

Share Document