Evaluation Research Designs and Methods

1994 ◽  
pp. 27-68
Author(s):  
Ceri Phillips ◽  
Colin Palfrey ◽  
Paul Thomas
Keyword(s):  
Evaluation Research ◽  
Research Designs

Meta-Analysis in Single-Subject Evaluation Research

2021 ◽  
pp. 143-154
Author(s):  
Charles Auerbach
Keyword(s):  
Meta Analysis ◽  
Evaluation Research ◽  
Effect Sizes ◽  
Single Subject ◽  
Building Research ◽  
Single Subject Research ◽  
Research Designs ◽  
The Individual ◽  
Meta Analyses ◽  
Intervening Variables

Meta-analytic techniques can be used to aggregate evaluation results across studies. In the case of single-subject research designs, we could combine findings from evaluations with 5, 10 or 20 clients to determine, on average, how effective an intervention is. This is a more complex and sophisticated way of understanding differences across studies than reporting those changes qualitatively or simply reporting the individual effect sizes for each study. In this chapter, the authors discuss why meta-analysis is important to consider in single-subject research, particularly in the context of building research evidence. They then demonstrate how to do this using SSD for R functions. Building upon effect sizes, introduced in Chapter 4, the authors illustrate the conditions under which it is appropriate to use traditional effect sizes to conduct meta-analyses, how to introduce intervening variables, and how to evaluate statistical output. Additionally, the authors discuss and illustrate the computation and interpretation of a mean Non-Overlap of All Pairs in situations which traditional effect sizes cannot be used.

scholarly journals Guarantee Industries Credit Evaluation Research of Risk Management Perspective

2013 ◽  
Vol 380-384 ◽  
pp. 4426-4430
Author(s):  
Yi Fang ◽  
Hui Jun Ren ◽  
Long Xing Li
Keyword(s):  
Risk Management ◽  
Bp Neural Network ◽  
Evaluation Model ◽  
Evaluation Research ◽  
Evaluation Index ◽  
Credit Evaluation ◽  
Evaluation Indexes ◽  
Demonstration Analysis ◽  
Research Designs ◽  
Management Perspective

In order to evaluate the credit status of the insured enterprise, from the perspective of guarantee companys risk management, according the evaluation indexes of the evaluation agencies both at home and abroad, this research constructs the credit guarantee evaluation index institutions used by themselves, and determines the weights of evaluation indexes by using FAHP. At last, this research designs the enterprise credit evaluation model based on the BP neural network and verifies the feasibility of the model through the demonstration analysis.

Triangulated Research Designs — A Justification?

2005 ◽  
Vol os-22 (1) ◽  
pp. 56-66 ◽  
Author(s):  
Gayle M. Rhineberger ◽  
David J. Hartmann ◽  
Thomas L. Van Valey
Keyword(s):  
Research Methods ◽  
Social Research ◽  
Evaluation Research ◽  
Sociological Research ◽  
Applied Sociology ◽  
Multiple Methods ◽  
Quality Of Work ◽  
Research Designs ◽  
Applied Researcher

The use of triangulated research designs is becoming increasingly popular, particularly in applied sociology and evaluation research. There is a substantial amount of literature on triangulated research methods, particularly in the fields of social research methods and nursing. This paper examines the uses of the concept of triangulation in applied sociological research. It does so first by reviewing uses of the term in various applied contexts. We then turn to whether and how the information derived from multiple methods is actually integrated by the applied researcher. Finally, we discuss the importance of triangulation for the quality of work in the field of applied sociology.

scholarly journals Evaluation and Analysis of Baitul Arqam on the Morals and Performance of Lecturers and Employees of the University of Muhammadiyah Kotabumi

2020 ◽  
Vol 4 (2) ◽  
pp. 133-153
Author(s):  
Junaidi Junaidi ◽  
Karsoni Berta Dinata ◽  
Darwanto Darwanto
Keyword(s):  
Research Design ◽  
High Performance ◽  
Evaluation Research ◽  
Qualitative Research Design ◽  
Research Designs ◽  
Post Test ◽  
And Performance ◽  
Interesting Learning ◽  
The University

The aims of this study is as basis for making policies and strategies that need to be taken to improve the quality of  Baitul Arqam Program going forward. Baitul Arqam program that has been carried out so far has never been seen in measurable terms. There are three research designs in this study, namely 1) descriptive-qualitative research design, 2) survey research design and 3) CIPP evaluation research design. The result of this study are based on the result of the analysis of the questionnaire and interview, it can be concluded that the lecturers and employees who have participated in Baitul Arqam activities have good morals and high performance. Based on the result of the evaluation it can be concluded that, 1) Baitul arqam material should be made into one book and distributed to participants, 2) The material should also discuss matters related to prayer, organizing bodies, and other worship in accordance with the guidance of HPT, 3) The video interesting learning so that participants are more interested and focused, 4) Every lecturer and employee who has not yet followed the Baitul Arqam must participate in the activity, 5) There is a pre-test and post-test to measure the success of the participants, 6) the mandatory requirements of participants are declared to pass if they take Fathul Quthub and Tahajud Prayers, and follow the material for each session at a minimum 75%.

The Nonuse, Misuse, and Proper Use of Pilot Studies in Experimental Evaluation Research

2016 ◽  
Vol 38 (2) ◽  
pp. 246-261 ◽  
Author(s):  
Erik Westlund ◽  
Elizabeth A. Stuart
Keyword(s):  
Experimental Evaluation ◽  
Evaluation Research ◽  
Effect Sizes ◽  
Review Of The Literature ◽  
Pilot Studies ◽  
Power Calculations ◽  
Research Designs ◽  
Simulation Results ◽  
Full Trial

This article discusses the nonuse, misuse, and proper use of pilot studies in experimental evaluation research. The authors first show that there is little theoretical, practical, or empirical guidance available to researchers who seek to incorporate pilot studies into experimental evaluation research designs. The authors then discuss how pilot studies can be misused, using statistical simulations to illustrate the error that can result from using effect sizes from pilot studies to decide whether to conduct a full trial or using effect sizes from pilot studies as the basis of power calculations in a full trial. Informed by the review of the literature and these simulation results, the authors conclude by proposing practical suggestions to researchers and practitioners on how to properly use pilot studies in experimental evaluation research.

A Discussion of Early Intervention for Infants with Down Syndrome

PEDIATRICS ◽  
1981 ◽  
Vol 67 (1) ◽  
pp. 45-46
Author(s):  
Diane Bricker ◽  
Laurel Carlson ◽  
Robert Schwarz
Keyword(s):  
Down Syndrome ◽  
Early Intervention ◽  
Controlled Trial ◽  
Evaluation Research ◽  
Experimental Methodology ◽  
Federal Mandates ◽  
Handicapped Children ◽  
Research Designs ◽  
Program Effects ◽  
Quasi Experimental

Recently, a physician-colleague brought to our attention an article entitled, "Early Intervention for Infants with Down Syndrome: A Controlled Trial," by Piper and Pless.1 Although it is encouraging to find that these investigators are exploring the parameters of early intervention with handicapped infants, some of their conclusions are of concern and have prompted the formulation of a response. In particular, we would like to discuss this article's findings in relation to (1) existing efficacy data that suggest early intervention with young handicapped children may be effective; and (2) methodologic weaknesses in the research design employed by Piper and Pless. A critical problem currently confronting the field of early intervention is the evaluation of the effectiveness of early programming for handicapped infants and their families. Major impediments to the documentation of program effects include the unsuitability of existing instrumentation for assessing the progress of handicapped infants and the scarcity of feasible evaluation research designs.2,3 To complicate matters further, randomly assigned control or untreated groups for comparison are rarely possible. Ethical concerns surrounding the withholding of services from infants assigned to control groups, coupled with recent state and federal mandates calling for the provision of educatinal services for all handicapped children of school age and permissive programming for the preschool child, are collectively operating to reduce and eventually eliminate available handicapped infants and children who might serve as non-intervention control subjects.4 Despite the design limitations associated with research involving young handicapped children, efficacy findings based on descriptive and quasi-experimental methodology do exist.

Telepractice for Adult Speech-Language Pathology Services: A Systematic Review

2020 ◽  
Vol 5 (1) ◽  
pp. 326-338 ◽  
Author(s):  
Kristen Weidner ◽  
Joneen Lowman
Keyword(s):  
Systematic Review ◽  
Primary Progressive Aphasia ◽  
Future Research ◽  
Service Delivery Model ◽  
Speech Language Pathology ◽  
Review Of The Literature ◽  
Research Designs ◽  
Assessment And Treatment ◽  
Language Pathology ◽  
Screening Assessment

Purpose We conducted a systematic review of the literature regarding adult telepractice services (screening, assessment, and treatment) from approximately 2014 to 2019. Method Thirty-one relevant studies were identified from a literature search, assessed for quality, and reported. Results Included studies illustrated feasibility, efficacy, diagnostic accuracy, and noninferiority of various speech-language pathology services across adult populations, including chronic aphasia, Parkinson's disease, dysphagia, and primary progressive aphasia. Technical aspects of the equipment and software used to deliver services were discussed. Some general themes were noted as areas for future research. Conclusion Overall, results of the review continue to support the use of telepractice as an appropriate service delivery model in speech-language pathology for adults. Strong research designs, including experimental control, across multiple well-described settings are still needed to definitively determine effectiveness of telepractice services.

Behavioral Genetics: Concepts for Research and Practice in Language Development and Disorders

1995 ◽  
Vol 38 (5) ◽  
pp. 1126-1142 ◽  
Author(s):  
Jeffrey W. Gilger
Keyword(s):  
Language Development ◽  
Behavioral Genetics ◽  
State Of The Art ◽  
Genetic Research ◽  
Great Promise ◽  
Behavioral Genetic ◽  
Fine Grained ◽  
Future Goals ◽  
Current State ◽  
Research Designs

This paper is an introduction to behavioral genetics for researchers and practioners in language development and disorders. The specific aims are to illustrate some essential concepts and to show how behavioral genetic research can be applied to the language sciences. Past genetic research on language-related traits has tended to focus on simple etiology (i.e., the heritability or familiality of language skills). The current state of the art, however, suggests that great promise lies in addressing more complex questions through behavioral genetic paradigms. In terms of future goals it is suggested that: (a) more behavioral genetic work of all types should be done—including replications and expansions of preliminary studies already in print; (b) work should focus on fine-grained, theory-based phenotypes with research designs that can address complex questions in language development; and (c) work in this area should utilize a variety of samples and methods (e.g., twin and family samples, heritability and segregation analyses, linkage and association tests, etc.).

Sign in / Sign up

Export Citation Format

Share Document