scholarly journals The Impact of Systematic Review Automation Tools on Methodological Quality and Time Taken to Complete Systematic Review Tasks: Case Study

10.2196/24418 ◽  
2021 ◽  
Vol 7 (2) ◽  
pp. e24418
Author(s):  
Justin Clark ◽  
Catherine McFarlane ◽  
Gina Cleo ◽  
Christiane Ishikawa Ramos ◽  
Skye Marshall

Background Systematic reviews (SRs) are considered the highest level of evidence to answer research questions; however, they are time and resource intensive. Objective When comparing SR tasks done manually, using standard methods, versus those same SR tasks done using automated tools, (1) what is the difference in time to complete the SR task and (2) what is the impact on the error rate of the SR task? Methods A case study compared specific tasks done during the conduct of an SR on prebiotic, probiotic, and synbiotic supplementation in chronic kidney disease. Two participants (manual team) conducted the SR using current methods, comprising a total of 16 tasks. Another two participants (automation team) conducted the tasks where a systematic review automation (SRA) tool was available, comprising of a total of six tasks. The time taken and error rate of the six tasks that were completed by both teams were compared. Results The approximate time for the manual team to produce a draft of the background, methods, and results sections of the SR was 126 hours. For the six tasks in which times were compared, the manual team spent 2493 minutes (42 hours) on the tasks, compared to 708 minutes (12 hours) spent by the automation team. The manual team had a higher error rate in two of the six tasks—regarding Task 5: Run the systematic search, the manual team made eight errors versus three errors made by the automation team; regarding Task 12: Assess the risk of bias, 25 assessments differed from a reference standard for the manual team compared to 20 differences for the automation team. The manual team had a lower error rate in one of the six tasks—regarding Task 6: Deduplicate search results, the manual team removed one unique study and missed zero duplicates versus the automation team who removed two unique studies and missed seven duplicates. Error rates were similar for the two remaining compared tasks—regarding Task 7: Screen the titles and abstracts and Task 9: Screen the full text, zero relevant studies were excluded by both teams. One task could not be compared between groups—Task 8: Find the full text. Conclusions For the majority of SR tasks where an SRA tool was used, the time required to complete that task was reduced for novice researchers while methodological quality was maintained.

2020 ◽  
Author(s):  
Justin Clark ◽  
Catherine McFarlane ◽  
Gina Cleo ◽  
Christiane Ishikawa Ramos ◽  
Skye Marshall

BACKGROUND Systematic reviews (SRs) are considered the highest level of evidence to answer research questions; however, they are time and resource intensive. OBJECTIVE When comparing SR tasks done manually, using standard methods, versus those same SR tasks done using automated tools, (1) what is the difference in time to complete the SR task and (2) what is the impact on the error rate of the SR task? METHODS A case study compared specific tasks done during the conduct of an SR on prebiotic, probiotic, and synbiotic supplementation in chronic kidney disease. Two participants (manual team) conducted the SR using current methods, comprising a total of 16 tasks. Another two participants (automation team) conducted the tasks where a systematic review automation (SRA) tool was available, comprising of a total of six tasks. The time taken and error rate of the six tasks that were completed by both teams were compared. RESULTS The approximate time for the manual team to produce a draft of the background, methods, and results sections of the SR was 126 hours. For the six tasks in which times were compared, the manual team spent 2493 minutes (42 hours) on the tasks, compared to 708 minutes (12 hours) spent by the automation team. The manual team had a higher error rate in two of the six tasks—regarding <i>Task 5: Run the systematic search</i>, the manual team made eight errors versus three errors made by the automation team; regarding <i>Task 12: Assess the risk of bias</i>, 25 assessments differed from a reference standard for the manual team compared to 20 differences for the automation team. The manual team had a lower error rate in one of the six tasks—regarding <i>Task 6: Deduplicate search results</i>, the manual team removed one unique study and missed zero duplicates versus the automation team who removed two unique studies and missed seven duplicates. Error rates were similar for the two remaining compared tasks—regarding <i>Task 7: Screen the titles and abstracts</i> and <i>Task 9: Screen the full text</i>, zero relevant studies were excluded by both teams. One task could not be compared between groups—<i>Task 8: Find the full text</i>. CONCLUSIONS For the majority of SR tasks where an SRA tool was used, the time required to complete that task was reduced for novice researchers while methodological quality was maintained.


2017 ◽  
Author(s):  
Hani Tuasikal

Latar belakang: Pelaksanaan handover di RS berkiatan erat dengan dengan peran perawat dalam menggunakan metode pada saat pergantian shift. Oleh karena itu, untuk meningkatkan komunikasi diantara perawat dibutuhkan metode-metode yang efektif dalam metode-melakukan handover. Adapun metode yang digunakan adalah verbal, dengan catatan, melalui telepon dan SBAR. Metode: Penelusuran literature data base dari EBSCO, sciendirect, google search dan PubMed dari tahun 2005-2015 dilakukan menggunakan advanced search keyword yang dipilih dalam pencarian adalah handover communication, patien savety. Pencarian dibatasi pada tahun 2005-2015, full text, dan harus yang berbahasa inggris. Setelah dilakukan search ditemukan 171 artikel pada sciendirect, 23 artikel pada PubMed, dan 32 artikel pada ebscho dan yang sesuai dengan kriteria inklusi adalah 6 artikel. 6 artikel tersebut sesuai dengan kriteria study yaitu RCTs, Cohor, Case Study dan Systematic Review. Responden dalam artikel ini adalah perawat yang melakukan handover. Intervensi yang dilakukan adalah metode-metode handover. Outcome meningkatkan komunikasi antar perawat. Hasil: temuan berupa 6 artikel hasil pembahasan menunjukan bahwa metode handover dengan SBAR sangat efektif untuk meningkatkan komunikasi antar perawat. Kesimpulan: Metode SBAR sangat efektif digunakan dalam handover. Dengan metode ini, dapat mengoptimalkan komunikasi antar perawat dalam melakukan handover di setiap pergantian shif.


Jurnal NERS ◽  
2019 ◽  
Vol 14 (3) ◽  
pp. 71
Author(s):  
Rizki Agustin Purwaningtyas ◽  
Ardila Lailatul Barik ◽  
Dwi Astuti

Introduction: Obesity and stunting in childhood has become one of the greatest global health challenges. The impact of this issue is serious and lasting for individuals, their families, communities and countries. Most of the studies on child weight status have only focused on the mother as the primary caregiver, whereas the role and influence of the grandparents has received less attention. Grandparent-provided child care has become a trend in many countries, with reported rates of approximately 40% to 58%. The objective of this systematic review was to analyze whether children become stunted or obese when they are cared for by their grandparents.Methods: The methodological search of the literature was conducted using Scopus, Science Direct, PubMed, Pro Quest and ResearchGate, and it was undertaken using PRISMA guidelines. The search identified 1803 papers and 135 full-text articles were screened for eligibility. Finally, 15 met the inclusion criteria. The keyword chain was as follows: ("obesity" OR "stunting") AND (“children”) AND (“grandparents”).Results: As grandparents take on increasingly responsible roles in the lives of their grandchildren, there is an influence on the higher risk of child obesity rather than stunting.Conclusion: In future, nurses should target not only the mother but also the grandparents to control their child’s health, especially when related to their weight status.


Author(s):  
Michael Getzner

-National parks and other categories of protected areas are often assumed to enhance regional economic development due to park tourism. The current study attempts to estimate the impact of the Hohe Tauern national park (Austria) on tourism by exploring whether and to what extent the national park may have had an influence on tourism development. For most national park communities, the results suggest that the establishment of the national park had some impact by enforcing an already positive trend or by weakening or reversing a negative trend of tourism. However, breakpoint tests exhibit turning points up to several years after the establishment of the park, indicating that taking a national park as the basis for tourism development is a medium to long term development strategy. In the short term, the impact of a national park on tourism is not measurable. Tourism increased by 1 to 3% annually after the breakpoint, indicating that the establishment of a national park has to be incorporated into the tourism and development strategy of a region right from the start. The causal relationship between the establishment of the national park and tourism development may be weak, in particular in communities where the difference between the actual and the forecast numbers of overnight stays is small. Marketing national park tourism and building up a brand or distinctive label may therefore contribute to regional development particularly in the long term.Key words: Tourism, national park, protected area, time series, stationarity, breakpoint test, ARIMA.JEL classifications: R110, L830, C220.Parole chiave: Turismo, parco nazionale, area protetta, serie temporale, stazionarietŕ, test di breakpoint, ARIMA.


2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Raul Santos Alves ◽  
Levy Bueno Alves ◽  
Luciana Schulthais Altoé ◽  
Mariáurea Matias Sarandy ◽  
Mariella Bontempo Freitas ◽  
...  

Background. Skin wounds are closely correlated with opportunistic infections and sepsis risk. Due to the need of more efficient healing drugs, animal peptides are emerging as new molecular platforms to accelerate skin wound closure and to prevent and control bacterial infection. Aim. The aim of this study was to evaluate the preclinical evidence on the impact of animal peptides on skin wound healing. In addition, we carried out a critical analysis of the studies’ methodological quality. Main Methods. This systematic review was performed according to the PRISMA guidelines, using a structured search on the PubMed-Medline, Scopus, and Web of Science platforms to retrieve studies published until August 25, 2020 at 3 : 00 pm. The studies included were limited to those that used animal models, investigated the effect of animal peptides with no association with other compounds on wound healing, and that were published in English. Bias analysis and methodological quality assessments were examined through the SYRCLE’s RoB tool. Results. Thirty studies were identified using the PRISMA workflow. In general, animal peptides were effective in accelerating skin wound healing, especially by increasing cellular proliferation, neoangiogenesis, colagenogenesis, and reepithelialization. Considering standardized methodological quality indicators, we identified a marked heterogeneity in research protocols and a high risk of bias associated with limited characterization of the experimental designs. Conclusion. Animal peptides show a remarkable healing potential with biotechnological relevance for regenerative medicine. However, rigorous experimental approaches are still required to clearly delimit the mechanisms underlying the healing effects and the risk-benefit ratio attributed to peptide-based treatments.


Hydrology ◽  
2019 ◽  
Vol 6 (1) ◽  
pp. 12 ◽  
Author(s):  
Zheng N. Fang ◽  
Michael J. Shultz ◽  
Kevin J. Wienhold ◽  
Jiaqi Zhang ◽  
Shang Gao

The goal of this investigation is to compare the hydrologic simulations caused by the areal-averaging of dynamic moving rainfall. Two types of synthetic rainfall are developed: spatially varied rainfall (SVR) is the typical input to a distributed model while temporally varied rainfall (TVR) emulates SVR but is spread uniformly over the entire watershed as in the case of a lumped model. This study demonstrates a direct comparison of peak discharge and peak timing generated by synthetic moving storms over idealized rectangular basins and a real watershed. It is found that the difference between the hydrologic responses from SVR and TVR reflects the impact from the areal-averaging of rainfall; the areal-averaging of rainfall for the movement from upstream to downstream over a lumped model can result in underestimated and delayed peak values in comparison to those from a distributed model; the flood peaks from SVR and TVR are found similar when the storm moves from downstream to upstream. The findings of the study suggest that extra cautions are needed for practitioners when evaluating simulated results from distributed and lumped modeling approaches even using the same rainfall information.


2017 ◽  
Vol 38 (11) ◽  
pp. 1319-1328 ◽  
Author(s):  
Philipp P. Kohler ◽  
Cheryl Volling ◽  
Karen Green ◽  
Elizabeth M. Uleryk ◽  
Prakesh S. Shah ◽  
...  

BACKGROUNDMortality associated with infections caused by carbapenem-resistantEnterobacteriaceae(CRE) is higher than mortality due to carbapenem-sensitive pathogens.OBJECTIVETo examine the association between mortality from bacteremia caused by carbapenem-resistant (CRKP) and carbapenem-sensitiveKlebsiella pneumoniae(CSKP) and to assess the impact of appropriate initial antibiotic therapy (IAT) on mortality.DESIGNSystematic review and meta-analysisMETHODSWe searched MEDLINE, EMBASE, CINAHL, and Wiley Cochrane databases through August 31, 2016, for observational studies reporting mortality among adult patients with CRKP and CSKP bacteremia. Search terms were related toKlebsiella, carbapenem-resistance, and infection. Studies including fewer than 10 patients per group were excluded. A random-effects model and meta-regression were used to assess the relationship between carbapenem-resistance, appropriateness of IAT, and mortality.RESULTSMortality was higher in patients who had CRKP bacteremia than in patients with CSKP bacteremia (15 studies; 1,019 CRKP and 1,148 CSKP patients; unadjusted odds ratio [OR], 2.2; 95% confidence interval [CI], 1.8–2.6; I2=0). Mortality was lower in patients with appropriate IAT than in those without appropriate IAT (7 studies; 658 patients; unadjusted OR, 0.5; 95% CI, 0.3–0.8; I2=36%). CRKP patients (11 studies; 1,326 patients; 8-year period) were consistently less likely to receive appropriate IAT (unadjusted OR, 0.5; 95% CI, 0.3–0.7; I2=43%). Our meta-regression analysis identified a significant association between the difference in appropriate IAT and mortality (OR per 10% difference in IAT, 1.3; 95% CI, 1.0–1.6).CONCLUSIONSAppropriateness of IAT is an important contributor to the observed difference in mortality between patients with CRKP bacteremia and patients with CSKP bacteremia.Infect Control Hosp Epidemiol2017;38:1319–1328


Author(s):  
Malika Kouti

This chapter discusses the impact of knowing the English rhetorical pattern of organisation on BA Accounting and Finance students' academic writing. More specifically, it focuses on the knowledge of how to structure a letter of application for job hunting purposes. This case study involved the analysis of 40 letters of application written by 40 Accounting and Finance students in the Department of Accounting and Finance at the University of Ghardaïa, Algeria after they had been trained to structure this type of letter. The training lasted for two sessions in the Department of Accounting and Finance at Ghardaia University, Algeria. The training was a direct instruction in which students were shown activities that assisted them in mastering the rhetorical pattern of organisation that concerns letters of application. They were also shown the difference between formal and informal letters of application. The obtained results demonstrated the efficiency of the direct instruction in teaching Accounting and Finance students how to write a letter of application.


2018 ◽  
Vol 7 (4) ◽  
pp. e000193 ◽  
Author(s):  
Patrick J Campbell ◽  
Mira Patel ◽  
Jennifer R Martin ◽  
Ana L Hincapie ◽  
David Rhys Axon ◽  
...  

ImportanceWhile much is known about hospital pharmacy error rates in the USA, comparatively little is known about community pharmacy dispensing error rates.ObjectiveThe aim of this study was to determine the rate of community pharmacy dispensing errors in the USA.MethodsEnglish language, peer-reviewed observational and interventional studies that reported community pharmacy dispensing error rates in the USA from January 1993 to December 2015 were identified in 10 bibliographic databases and topic-relevant grey literature. Studies with a denominator reflecting the total number of prescriptions in the sample were necessary for inclusion in the meta-analysis. A random effects meta-analysis was conducted to estimate an aggregate community pharmacy dispensing error rate. Heterogeneity was assessed using the I2 statistic prior to analysis.ResultsThe search yielded a total of 8490 records, of which 11 articles were included in the systematic review. Two articles did not have adequate data components to be included in the meta-analysis. Dispensing error rates ranged from 0.00003% (43/1 420 091) to 55% (55/100). The meta-analysis included 1 461 128 prescriptions. The overall community pharmacy dispensing error rate was estimated to be 0.015 (95% CI 0.014 to 0.018); however, significant heterogeneity was observed across studies (I2=99.6). Stratification by study error identification methodology was found to have a significant impact on dispensing error rate (p<0.001).Conclusion and relevanceThere are few published articles that describe community pharmacy dispensing error rates in the USA. Thus, there is limited information about the current rate of community pharmacy dispensing errors. A robust investigation is needed to assess dispensing error rates in the USA to assess the nature and magnitude of the problem and establish prevention strategies.


2020 ◽  
pp. 026921552096669 ◽  
Author(s):  
Robson Massi Bastos ◽  
Jorge Geraldo de Carvalho Júnior ◽  
Suellen Aline Martinez da Silva ◽  
Shirley Ferreira Campos ◽  
Matheus Vieira Rosa ◽  
...  

Objective: To summarize the effects of surgical treatment compared to conservative treatment in femoroacetabular impingement syndrome in the short, medium, and long term. Study Design: Systematic review Methods: The following databases were searched on 14/09/2020: MEDLINE, EMBASE, CENTRAL, Web of Science, and PEDro. There were no date or language limits. The methodological quality assessment was performed using the PEDro scale and the quality of the evidence followed the GRADE recommendation. The outcomes pain, disability, and adverse effects were extracted. Results: Of 6264 initial studies, three met the full-text inclusion criteria. All studies were of good methodological quality. Follow up ranged from six months to two years, with 650 participants in total. The meta-analyses found no difference in disability between surgical versus conservative treatment, with a mean difference (MD) between groups of 3.91 points (95% CI –2.19 to 10.01) at six months, MD of 5.53 points (95% CI –3.11 to 14.16) at 12 months and 3.8 points (95% CI –6.0 to 13.6) at 24 months. The quality of the evidence (GRADE) varied from moderate to low across all comparisons. Conclusion: There is moderate-quality evidence that surgical treatment is not superior to conservative treatment for femoroacetabular impingement syndrome in the short term, and there is low-quality evidence that it is not superior in the medium term. Level of evidence: Therapy, level 1a. Registration number: PROSPERO CRD42019134118


Sign in / Sign up

Export Citation Format

Share Document