Reflections on the Cognitive Interviewing Reporting Framework

Methodology ◽  
2013 ◽  
Vol 9 (3) ◽  
pp. 123-128 ◽  
Author(s):  
Gordon Willis ◽  
Hennie Boeije
Keyword(s):  
Research Design ◽  
Cognitive Testing ◽  
Level Of Detail ◽  
Cognitive Interviewing ◽  
Research Groups ◽  
Research Project ◽  
Reporting Framework ◽  
Full Explanation ◽  
Key Steps

Based on the experiences of three research groups using and evaluating the Cognitive Interviewing Reporting Framework (CIRF), we draw conclusions about the utility of the CIRF as a guide to creating cognitive testing reports. Authors generally found the CIRF checklist to be usable, and that it led to a more complete description of key steps involved. However, despite the explicit direction by the CIRF to include a full explanation of major steps and features (e.g., research objectives and research design), the three cognitive testing reports tended to simply state what was done, without further justification. Authors varied in their judgments concerning whether the CIRF requires the appropriate level of detail. Overall, we believe that current cognitive interviewing practice will benefit from including, within cognitive testing reports, the 10 categories of information specified by the CIRF. Future use of the CIRF may serve to direct the overall research project from the start, and to further the goal of evaluation of specific cognitive interviewing procedures.

The Cognitive Interviewing Reporting Framework (CIRF)

Methodology ◽  
2013 ◽  
Vol 9 (3) ◽  
pp. 87-95 ◽  
Author(s):  
Hennie Boeije ◽  
Gordon Willis
Keyword(s):  
Qualitative Research ◽  
Cognitive Testing ◽  
Cognitive Interviewing ◽  
Comprehensive Description ◽  
Widespread Adoption ◽  
Reporting Framework ◽  
Common Framework ◽  
Survey Questionnaires ◽  
Complete Reporting

Cognitive interviewing is an important qualitative tool for the testing, development, and evaluation of survey questionnaires. Despite the widespread adoption of cognitive testing, there remain large variations in the manner in which specific procedures are implemented, and it is not clear from reports and publications that have utilized cognitive interviewing exactly what procedures have been used, as critical details are often missing. Especially for establishing the effectiveness of procedural variants, it is essential that cognitive interviewing reports contain a comprehensive description of the methods used. One approach to working toward more complete reporting would be to develop and adhere to a common framework for reporting these results. In this article we introduce the Cognitive Interviewing Reporting Framework (CIRF), which applies a checklist approach, and which is based on several existing checklists for reviewing and reporting qualitative research. We propose that researchers apply the CIRF in order to test its usability and to suggest potential adjustments. Over the longer term, the CIRF can be evaluated with respect to its utility in improving the quality of cognitive interviewing reports.

Evaluating the Cognitive Interviewing Reporting Framework (CIRF) by Rewriting a Dutch Pretesting Report of a European Health Survey Questionnaire *The views expressed in this paper are those of the authors and do not necessarily reflect the policies of Statistics Netherlands.

Methodology ◽  
2013 ◽  
Vol 9 (3) ◽  
pp. 104-112 ◽  
Author(s):  
Rachel Vis-Visschers ◽  
Vivian Meertens
Keyword(s):  
Health Survey ◽  
Cognitive Interviewing ◽  
Survey Questionnaire ◽  
Reporting Framework ◽  
Research Designs ◽  
European Health ◽  
Original Report ◽  
Minimal Standard ◽  
Exhaustive List

We used the Cognitive Interviewing Reporting Framework (CIRF) to restructure the report of a pretest on a European health survey questionnaire. This pretest was conducted by the Questionnaire Laboratory of Statistics Netherlands, and the original report was written according to a standard Statistics Netherlands format for pretesting reports. This article contains the rewritten report with highlights from the case study. The authors reflect on the process of rewriting and the usefulness of the CIRF. We conclude that expanded use of the CIRF as a reporting format for articles on cognitive pretests would enhance international comparability, completeness, and uniformity of research designs, terminology, and reporting. A limitation of the CIRF is that it does not provide an exhaustive list of items that could be included in a report, but it is more a “minimal standard”: that is a report on how a cognitive pretest was conducted should at least contain a description of the CIRF items.

Qualitative longitudinal research: researching fatherhood and fathers’ experiences

2018 ◽  
Author(s):  
Tina Miller
Keyword(s):  
Longitudinal Study ◽  
Qualitative Study ◽  
Research Design ◽  
Longitudinal Research ◽  
Methodological Issues ◽  
Research Project ◽  
Transition To Motherhood ◽  
Transition To Fatherhood ◽  
Over Time ◽  
Made In

This chapter focuses on a qualitative longitudinal (QL) research project, Transition to Fatherhood, and later episodes of fathering and fatherhood experiences. It begins by exploring the research design of this study and considers the inherent gendered and other assumptions made in it, which mirrors an earlier research project on Transition to Motherhood. Following an examination of some of the methodological issues that arose during this qualitative longitudinal study, the chapter turns to reflect on the important question of what adding time into a qualitative study can do. It considers what happens when narratives collected in later interviews are incorporated into earlier analysis and findings as lives and fatherhood experiences change, as well as the benefits of researching individuals over time.

Commentary on ‘Opportunities and Challenges of Engaged Indigenous Scholarship’ (Van de Ven, Meyer, & Jing, 2018)

2018 ◽  
Vol 14 (3) ◽  
pp. 463-466 ◽  
Author(s):  
Anne S. Tsui
Keyword(s):  
Research Design ◽  
Research Question ◽  
Primary Factor ◽  
Local Context ◽  
Indigenous Research ◽  
Chinese Firms ◽  
Research Project ◽  
Chinese Management

The mission ofManagement and Organization Review, founded in 2005, is to publish research about Chinese management and organizations, foreign organizations operating in China, or Chinese firms operating globally. The aspiration is to develop knowledge that is unique to China as well as universal knowledge that may transcend China. Articulated in the first editorial published in the inaugural issue of MOR (2005) and further elaborated in a second editorial (Tsui, 2006), the question of contextualization is framed, discussing the role of context in the choices of the research question, theory, measurement, and research design. The idea of ‘engaged indigenous research’ by Van de Ven, Meyer, and Jing (2018) describes the highest level of contextualization, with the local context serving as the primary factor guiding all the decisions of a research project. Tsui (2007: 1353) refers to it as ‘deep contextualization’.

scholarly journals Developing Online Communities for Librarian Researchers: A Case Study

2017 ◽  
Vol 78 (4) ◽  
pp. 512
Author(s):  
Lili Luo ◽  
Marie Kennedy ◽  
Kristine Brancolini ◽  
Michael Stephens
Keyword(s):  
Content Analysis ◽  
Research Design ◽  
Online Communities ◽  
Online Community ◽  
Online Survey ◽  
Academic Librarians ◽  
Research Project ◽  
Conference Attendance

This study examines the role of online communities in connecting and supporting librarian researchers, through the analysis of member activities in the online community for academic librarians that attended the 2014 Institute for Research Design in Librarianship (IRDL). The 2014 IRDL cohort members participated in the online community via Twitter and a Facebook group page. A content analysis of their posts and an online survey among them identified different patterns of engagement and four primary types of content—posts related to completing the IRDL research project required for each cohort member, announcements about research-related resources and opportunities, posts reminiscing about the IRDL experience, and arrangements of conference attendance and meetups. Implications for successfully designing online communities for librarian researchers are discussed.

scholarly journals Elementos para elaboração de um desenho de pesquisa | Elements to formulate a research design

2019 ◽  
Vol 10 ◽  
pp. e38439
Author(s):  
Marcelino Teixeira Lisboa
Keyword(s):  
International Relations ◽  
Research Design ◽  
Undergraduate Students ◽  
Research Project ◽  
Major Work ◽  
Object A ◽  
Basic Ideas

O texto tem o intuito de apresentar as ideias básicas para formulação de desenhos de pesquisa, com foco em estudantes em nível de graduação. Desenvolve-se a ideia de que um desenho de pesquisa deve ocupar-se inicialmente, de definir um objeto, uma pergunta, definir uma teoria a ser utilizada, elaborar uma hipótese, tratar das fontes e escolher o método adequado. Entende-se que esses sejam os passos iniciais fundamentais que devem ser seguidos pelos pesquisadores que realizam seu primeiro trabalho de maior envergadura, como uma monografia de conclusão de graduação.Palavras-chave: Projeto de Pesquisa; Relações Internacionais; Metodologia.ABSTRACTThe text intends to present the basic ideas for the formulation of research project, focusing on undergraduate students. The idea is developed that a research design should initially and interactively focus on defining an object, a question, defining a theory to be used, elaborating a hypothesis, dealing with the sources, and choosing the appropriate method. These are the fundamental initial steps that must be followed by the researchers who carry out their first major work, such as a graduate monograph.Keywords: Research Project; International Relations; Methodology.Recebido em 23 nov. 2018 | Aceito em 30 ago. 2019

scholarly journals Researching intimacy through social media: A cross-platform approach

2016 ◽  
Vol 32 (60) ◽  
pp. 19
Author(s):  
Cristina Miguel
Keyword(s):  
Social Media ◽  
Research Design ◽  
Participant Observation ◽  
Structured Interviews ◽  
Research Project ◽  
Different Types ◽  
Social Media Platforms ◽  
Cross Platform ◽  
Media Interaction

This paper aims to contribute to the understanding of how to study the way people build intimacy and manage privacy through social media interaction. It explores the research design and methodology of a research project based on a multi-sited case study composed of three different social media platforms: Badoo, CouchSurfing, and Facebook. This cross-platform approach is useful to observe how intimacy is often negotiated across different platforms. The research project focuses on the cities of Leeds (UK) and Barcelona (Spain). In particular, this article discusses the methods used to recruit participants and collect data for that study - namely, participant observation, semi-structured interviews, and user profiles analysis. This cross-platform approach and multi-method research design is helpful to investigate the nature of intimacy practices facilitated by social media at several levels: online/offline, across different platforms, among different types of relationships, within both new and existing relationships, and in different locations

Learning How to Do Research: An Exercise and Syllabus

1981 ◽  
Vol 31 ◽  
pp. 5-8
Author(s):  
Dean Schooler
Keyword(s):  
Political Science ◽  
Research Design ◽  
Science Research ◽  
Research Process ◽  
The Political ◽  
Research Project ◽  
Basic Assumptions ◽  
Basic Approaches ◽  
Traditional Approaches

“You learn how to do research by doing research.” “You learn about research by studying others’ research.” “You learn research by studying the elements and requirements of research.” We have taught students, both undergraduate and graduate, about the research process with those three traditional approaches and sets of basic assumptions. However, the idea of a Research Process Vision provides a fourth alternative blending elements of the three basic approaches.The Research Process Vision is an exercise for students in studying and experiencing the political science research process. Basically, the project/ exercise serves as a vehicle for students to sense the varied elements and issues in research and research design through a hypothetical “envisioning” process. Specifically, they develop a paper or document which sketches out and discusses a potential research project, envisions what might exist or be done, and what might occur.

Sign in / Sign up

Export Citation Format

Share Document