scholarly journals 5/7-POINT “LIKERT SCALES” AREN’T ALWAYS THE BEST OPTION Their validity is undermined by lack of reliability, response style bias, long completion times and limitations to permissible statistical procedures

2021 ◽  
Author(s):  
Sara Dolnicar
Keyword(s):  
Data Quality ◽  
Response Style ◽  
Cost Ratio ◽  
Scale Level ◽  
Likert Scales ◽  
Survey Question ◽  
Statistical Procedures ◽  
Respondent Burden ◽  
Low Costs ◽  
Completion Times

Some research methods are used by default. Even if they undermine the validity of conclusions, authors no longer justify the use of default approaches and reviewers no longer query them. One such default is the use of bipolar ordinal 5/7-point survey answer formats, often incorrectly referred to as 5/7-point “Likert scales”. This Viewpoint argues that default answer formats should be replaced by thorough assessments of the benefit-to-cost ratio of alternative answer formats for every survey question asked. Benefits of answer formats include enabling respondents to meaningfully express themselves, while keeping respondent burden low. Costs include reducing data quality by introducing bias or over-burdening respondents, or by collecting data at a scale level that limits permissible statistical procedures.

scholarly journals PENGARUH MODAL PSIKOLOGIS DAN PARTISIPASI ANGGARAN TERHADAP KEINGINAN UNTUK MEMBUAT SENJANGAN ANGGARAN

2020 ◽  
Vol 6 (2) ◽  
pp. 76-86
Author(s):  
Jengger Woro Hapsari ◽  
Alwi Alwi
Keyword(s):  
Data Quality ◽  
Psychological Capital ◽  
T Test ◽  
Quality Test ◽  
Likert Scales ◽  
Budgetary Slack ◽  
Budgetary Participation

The study aimed at finding out the effect of psychological capital dan budgetary participation on the budgetary slack. The population are all of Kopertis in the Indonesia. There were about 84 respondents are budgetary team in Kopertis. The data were collected by using five instrument of questionnaries based on Likert-scales. Data quality test was made by using validity and reability. The hypotesis is tested using hypotesis T-Test. From the results of hypotesis tests it is concluded that (1) there was affect of psychological capital on the budgetary slack (2) there was not affect of budgetary participation on the budgetary slack.

scholarly journals Measuring ego-centered social networks

2008 ◽  
Vol 5 (2) ◽  
Author(s):  
Tina Kogovšek ◽  
Valentina Hlebec
Keyword(s):  
Social Networks ◽  
Social Network ◽  
Second Step ◽  
Considerable Effort ◽  
Survey Question ◽  
Respondent Burden ◽  
Network Composition ◽  
The Stability ◽  
Complex Coordination

In measuring ego-centered social networks, two general approaches can be distinguished. A very simple way to evaluate membership in a social network is to ask an ordinary survey question where response categories are types of relationships (e.g., partner, parents, children, friends, etc.). This approach is very appealing as it saves time and money. However, information obtained by this approach is very limited. Most often, when evaluating ego-centered networks, the name generator approach is used. The list of egos (respondents) is obtained in the first step. In the second step, existing ties are identified - all alters with whom the focal ego has some sort of relationship. When all ties have been identified, the contents and the characteristics of ties are assessed. In most cases the characteristics of the alters are also measured. The name generator approach yields more data and is also of higher quality. However, it is very time and money consuming, and it requires either considerable effort from respondents, when it is applied in self-administered mode, or complex coordination between interviewer and respondent, when it is applied in personal interviews (e.g., Kogovšek et al., 2002). In a series of studies, network composition was estimated using both approaches. Test-retest and split-ballot experiments on convenience samples of respondents were used to assess the stability of network composition. Findings are discussed with regard to survey complexity, respondent burden, costs and quality of network composition estimates.

Web Surveys by Smartphones and Tablets

2017 ◽  
Vol 36 (5) ◽  
pp. 542-556 ◽  
Author(s):  
Roger Tourangeau ◽  
Hanyu Sun ◽  
Ting Yan ◽  
Aaron Maitland ◽  
Gonzalo Rivero ◽  
...  
Keyword(s):  
Data Quality ◽  
Mobile Devices ◽  
Unique Feature ◽  
Reliability And Validity ◽  
The United States ◽  
Web Surveys ◽  
Laptop Computer ◽  
First Time ◽  
Completion Times

Does completing a web survey on a smartphone or tablet computer reduce the quality of the data obtained compared to completing the survey on a laptop computer? This is an important question, since a growing proportion of web surveys are done on smartphones and tablets. Several earlier studies have attempted to gauge the effects of the switch from personal computers to mobile devices on data quality. We carried out a field experiment in eight counties around the United States that compared responses obtained by smartphones, tablets, and laptop computers. We examined a range of data quality measures including completion times, rates of missing data, straightlining, and the reliability and validity of scale responses. A unique feature of our study design is that it minimized selection effects; we provided the randomly determined device on which respondents completed the survey after they agreed to take part. As a result, respondents may have been using a device (e.g., a smartphone) for the first time. However, like many of the prior studies examining mobile devices, we find few effects of the type of device on data quality.

scholarly journals The Effects of Mismatches between Survey Question Stems and Response Options on Data Quality and Responses

2018 ◽  
Vol 7 (1) ◽  
pp. 34-65 ◽  
Author(s):  
Jolene D Smyth ◽  
Kristen Olson
Keyword(s):  
Data Quality ◽  
Telephone Survey ◽  
Mail Survey ◽  
Choice Response ◽  
Item Nonresponse ◽  
Survey Question ◽  
Response Options ◽  
Question Wording ◽  
Postal Mail

Abstract Several questionnaire design texts emphasize a dual role of question wording: the wording needs to express what is being measured and tell respondents how to answer. Researchers tend to focus heavily on the first of these goals, but sometimes overlook the second, resulting in question wording that does not match the response options provided (i.e., mismatches). Common examples are yes/no questions with ordinal or nominal response options, open-ended questions with closed-ended response options, and check-all-that apply questions with forced-choice response options. A slightly different type of mismatch utilizes a question stem that can be read as asking for two different types of answers with no indication of which type should be provided. In this paper, we report the results of twenty-two experimental comparisons of data quality indicators (i.e., item nonresponse and response time) and response distributions across matched and mismatched versions of questions from a postal mail survey and a telephone survey. We find that mismatched items generally have lower data quality than matched items and that substantive results differ significantly across matched and mismatched designs, especially in the telephone survey. The results suggest that researchers should be wary of mismatches and should strive for holistic design.

scholarly journals This other atmosphere: against human resources, emoji and devices

2019 ◽  
Vol 18 (1) ◽  
pp. 3-29 ◽  
Author(s):  
Esther Leslie
Keyword(s):  
Human Resources ◽  
Work Environment ◽  
Large Scale ◽  
Free Association ◽  
Quantified Self ◽  
Scale Level ◽  
Likert Scales ◽  
New Politics ◽  
New Form ◽  
Political Philosopher

Frequently humans are invited to engage with modern visual forms: emoji, emoticons, pictograms. Some of these forms are finding their way into the workplace, understood as augmentations to workplace atmospheres. What has been called the ‘quantified workplace’ requires its workers to log their rates of stress, wellbeing and subjective sense of productivity on a scale of 1–5 or by emoji, in a context in which Human Resources (HR) professionals develop a vocabulary of Workforce Analytics, People Analytics, Human Capital Analytics or Talent Analytics, and all this in the context of managing the work environment or its atmosphere. Atmosphere is mood, a compote of emotions. Emotions are a part of a human package characterized as ‘the quantified self’, a self intertwined with – subject to but also compliant with – tracking and archiving. The logical step for managing atmospheres is to track emotions at a granular and large-scale level. Through the concept of the digital crowd, rated and self-rating, as well as emotion-tracking strategies, the human resource (as worker and consumer) engages in a new politics of the crowd, organized around what political philosopher Jodi Dean calls, affirmatively, ‘secondary visuality’, high-circulation communication fusing speech, writing and image as a new form. This is the visuality of communicative, or social media, capitalism. But to the extent that it is captured by HR, is it an exposure less to crowd-sourced democracy, and more a stage in turning the employee into an on-the-shelf item in a digital economy warehouse, assessed by Likert scales? While HR works on new atmospheres of work, what other atmospheres pervade the context of labour, and can these be deployed in the generation of other types of affect, ones that work towards the free association of labour and life?

Do Japanese show the “neutral response style” on Likert scales?

2011 ◽  
Vol 75 (0) ◽  
pp. 3PM065-3PM065
Author(s):  
Yohtaro TAKANO ◽  
David MATSUMOTO ◽  
Takashi OKA ◽  
Midori TOYAMA ◽  
Kazuko TAKEO
Keyword(s):  
Response Style ◽  
Likert Scales

Relationships between hierarchical structure and properties in macromolecular systems

1987 ◽  
Vol 45 ◽  
pp. 440-443
Author(s):  
E. Baer
Keyword(s):  
Uniaxial Tension ◽  
Hierarchical Structure ◽  
Inorganic Material ◽  
Hierarchical Structures ◽  
Bone Collagen ◽  
Structure And Properties ◽  
Connective Tissues ◽  
Scale Level ◽  
Fibrous Protein ◽  
Macromolecular Systems

The most advanced macromolecular materials are found in plants and animals, and certainly the connective tissues in mammals are amongst the most advanced macromolecular composites known to mankind. The efficient use of collagen, a fibrous protein, in the design of both soft and hard connective tissues is worthy of comment. Very crudely, in bone collagen serves as a highly efficient binder for the inorganic hydroxyappatite which stiffens the structure. The interactions between the organic fiber of collagen and the inorganic material seem to occur at the nano (scale) level of organization. Epitatic crystallization of the inorganic phase on the fibers has been reported to give a highly anisotropic, stress responsive, structure. Soft connective tissues also have sophisticated oriented hierarchical structures. The collagen fibers are “glued” together by a highly hydrated gel-like proteoglycan matrix. One of the simplest structures of this type is tendon which functions primarily in uniaxial tension as a reinforced elastomeric cable between muscle and bone.

Rumination im Zusammenhang mit dem Erreichen selbst gesetzter Ziele bei leistungssportlich-orientierten Schwimmern

2017 ◽  
Vol 24 (4) ◽  
pp. 161-166 ◽  
Author(s):  
Alena Kröhler ◽  
Stefan Berti
Keyword(s):  
Response Style

Zusammenfassung. Die Studie untersucht den Zusammenhang zwischen Rumination und der persönlichen Zielerreichung bei Leistungssportlern. Im Rahmen einer Längsschnittuntersuchung, haben 44 Schwimmer_innen an einer Onlinebefragung mit vier Messzeitpunkten während der Wettkampfsaison 2014/15 teilgenommen. Der Online-Fragebogen enthielt neben der deutschen Version des Rumination Response Style Questionnaires (RSQ-D; Kühner, Huffziger & Nolen-Hoeksema, 2007 ), Fragen zu persönlichen Zielen und biographische sowie sportbezogene Fragen. Unter Berücksichtigung der individuellen Angaben zur Zielerreichung am Ende der Wettkampfsaison, wurden die Sportler_innen einer Realisierungsgruppe (n = 17) oder Vergleichsgruppe (n = 27) zugeordnet. Mittels multivarianter Varianzanalyse (MANOVA) wurde getestet, ob globale Unterschiede in der Rumination zu Beginn und am Ende der Wettkampfsaison zwischen den Gruppen bestehen. Sportler_innen, welche ihr individuelles Ziel erreicht haben, weisen im Vergleich zu denjenigen, die ihre Ziele nicht erreicht haben, niedrigere Ruminationswerte auf. Die Ergebnisse legen nahe, dass Rumination im Kontext der Zielerreichung auftritt und ein relevanter Faktor für den Leistungssport darstellen könnte.

The Measurement Invariance of the Short Dark Triad

2020 ◽  
Vol 41 (4) ◽  
pp. 207-218
Author(s):  
Mihaela Grigoraș ◽  
Andreea Butucescu ◽  
Amalia Miulescu ◽  
Cristian Opariuc-Dan ◽  
Dragoș Iliescu
Keyword(s):  
Structural Equation Modeling ◽  
Item Response ◽  
Structural Equation ◽  
Dark Triad ◽  
Theory And Practice ◽  
Equation Modeling ◽  
Scale Level ◽  
High Stake ◽  
Differential Functioning ◽  
Item Functioning

Abstract. Given the fact that most of the dark personality measures are developed based on data collected in low-stake settings, the present study addresses the appropriateness of their use in high-stake contexts. Specifically, we examined item- and scale-level differential functioning of the Short Dark Triad (SD3; Paulhus & Jones, 2011 ) measure across testing contexts. The Short Dark Triad was administered to applicant ( N = 457) and non-applicant ( N = 592) samples. Item- and scale-level invariances were tested using an Item Response Theory (IRT)-based approach and a Structural Equation Modeling (SEM) approach, respectively. Results show that more than half of the SD3 items were flagged for Differential Item Functioning (DIF), and Exploratory Structural Equation Modeling (ESEM) results supported configural, but not metric invariance. Implications for theory and practice are discussed.

Which Data to Meta-Analyze, and How?

2019 ◽  
Vol 227 (1) ◽  
pp. 64-82 ◽  
Author(s):  
Martin Voracek ◽  
Michael Kossmeier ◽  
Ulrich S. Tran
Keyword(s):  
Empirical Research ◽  
Meta Analysis ◽  
Curve Analysis ◽  
Research Progress ◽  
Primary Data ◽  
Statistical Procedures ◽  
Graphical Displays ◽  
Primary Data Analysis ◽  
Meta Analyses ◽  
Data Analytic

Abstract. Which data to analyze, and how, are fundamental questions of all empirical research. As there are always numerous flexibilities in data-analytic decisions (a “garden of forking paths”), this poses perennial problems to all empirical research. Specification-curve analysis and multiverse analysis have recently been proposed as solutions to these issues. Building on the structural analogies between primary data analysis and meta-analysis, we transform and adapt these approaches to the meta-analytic level, in tandem with combinatorial meta-analysis. We explain the rationale of this idea, suggest descriptive and inferential statistical procedures, as well as graphical displays, provide code for meta-analytic practitioners to generate and use these, and present a fully worked real example from digit ratio (2D:4D) research, totaling 1,592 meta-analytic specifications. Specification-curve and multiverse meta-analysis holds promise to resolve conflicting meta-analyses, contested evidence, controversial empirical literatures, and polarized research, and to mitigate the associated detrimental effects of these phenomena on research progress.

Sign in / Sign up

Export Citation Format

Share Document