scholarly journals Investigating the construct validity of an electronic in-basket exercise using bias-corrected bootstrapping and Monte Carlo re-sampling techniques

2019 ◽  
Vol 45 ◽  
Author(s):  
Jurgen Becker ◽  
Deon Meiring ◽  
Jan H. Van der Westhuizen

Orientation: Technology-based simulation exercises are popular assessment measures for the selection and development of human resources.Research purpose: The primary goal of this study was to investigate the construct validity of an electronic in-basket exercise using computer-based simulation technology. The secondary goal of the study was to investigate how re-sampling techniques can be used to recover model parameters using small samples.Motivation for the study: Although computer-based simulations are becoming more popular in the applied context, relatively little is known about the construct validity of these measures.Research approach/design and method: A quantitative ex post facto correlational design was used in the current study with a convenience sample (N = 89). The internal structure of the simulation exercise was assessed using a confirmatory factor analytical approach. In addition, bias-corrected bootstrapping and Monte Carlo simulation strategies were used to assess the confidence intervals around model parameters.Main findings: Support was not found for the entire model, but only for one of the dimensions, namely, the Interaction dimension. Multicollinearity was found between most of the dimensions that were problematic for factor analyses.Practical/managerial implications: This study holds important implications for assessment practitioners who hope to develop unproctored simulation exercises.Contribution/value-add: This study aims to contribute to the existing debate regarding the validity and utility of assessment centres (ACs), as well as to the literature concerning the use of technology-driven ACs. In addition, the study aims to make a methodological contribution by demonstrating how re-sampling techniques can be used in small AC samples.

2011 ◽  
Vol 37 (1) ◽  
Author(s):  
Fallen Mendes ◽  
Marius W. Stander

Orientation: The positive organisation creates a framework in which its elements can be investigated in relation to the retention of talent.Research purpose: The aim of this study was to investigate if leader empowering behaviour can positively impact on role clarity, psychological empowerment and work engagement, with the final outcome being the retention of talent.Motivation for the study: In the ever changing work environment organisations place great emphasis on their human capital. The positive organisation utilises specific elements to optimise human capital’s potential. It is therefore important to identify the elements contributing to a positive organisation as well as the elements which lead to the retention of talent.Research design, approach and method: A survey research design was used. A convenience sample (n = 179) was taken from a business unit in a chemical organisation. The Leader Empowering Behaviour Questionnaire, Measures of Role Clarity and Ambiguity Questionnaire, Measuring Empowerment Questionnaire, Utrecht Work Engagement Scale and the Intention to Leave Scale were administered.Main findings: Leader empowering behaviour, role clarity and psychological empowerment predicted work engagement. Role clarity interacted with competence to affect employees’ dedication and interacted with the development of employees to affect absorption. Work engagement predicted employees’ intention to leave.Practical/managerial implications: Organisations should foster the elements of a positive organisation if they want to retain their talent.Contribution/value-add: The results of this research contribute to scientific knowledge about the effects of a positive organisation on retention.


2013 ◽  
Vol 39 (1) ◽  
Author(s):  
Nadia M. Brits ◽  
Deon Meiring ◽  
Jürgen R. Becker

Orientation: The assessment centre (AC) is a prominent measurement tool for selection and development.Research purpose: The aim of this study was to determine the construct validity of a one-day development assessment centre (DAC) using a convenience sample of 202 managers in a large South African banking institution.Motivation for the study: Although the AC method is popular, it has been widely criticised as to whether it predominantly measures the dimensions it is designed to measure.Research design, approach and method: The fit of the measurement models implied by the dimensions measured was analysed in a quantitative study using an ex post facto correlation design and structural equation modelling.Main findings: Bi-factor confirmatory factor analysis was used to assess the relative contribution of higher-order exercise and dimension effects. Empirical under-identification stemming from the small number of exercises designed to reflect designated latent dimensions restricted the number of DAC dimensions that could be evaluated. Ultimately, only one global dimension had enough measurement points and was analysed. The results suggested that dimension effects explained the majority of variance in the post-exercise dimension ratings.Practical/managerial implications: Candidates’ proficiency on each dimension was used as the basis for development reports. The validity of inferences holds important implications for candidates’ career development and growth.Contribution/value-add: The authors found only one study on construct validity of AC dimensions in the South African context. The present study is the first use the bi-factor approach. This study will consequently contribute to the scarce AC literature in South Africa.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nhamo Mashavira ◽  
Crispen Chipunza ◽  
Dennis Y. Dzansi

Orientation: Research on managerial political competencies has progressed well in other organisational setups; but not so much in entrepreneurial ventures, yet literature documents the pivotal role played by political competencies in the performance of small and medium-sized enterprises (SMEs).Research Purpose: This study intended to find the impact of managerial political competencies on the performance of SMEs as measured by both innovation and return on investment (ROI) in SMEs in the Gauteng Province of South Africa.Motivation for the study: Regardless of the contribution done by SMEs in contemporary economies, and the fundamental role managerial political competencies play in sustaining these enterprises, no known study has been done among SMEs in South Africa.Research design, approach and method: The study employed an ex post facto correlational design that adopted a purely quantitative approach. The sample comprised of 211 owner/managers in Gauteng Province. Descriptive statistics and Spearman’s correlation were used for data analysis.Main findings: Owner/managers were found to be politically competent in the dimensions of social astuteness and networking abilities, but fared not so well on the apparent sincerity and interpersonal influence dimensions. It was also established that SMEs performed relatively better in terms of innovation compared to   ROI, although ROI had greater potential to respond to improvements in  the quality of managerial political competencies when compared to innovation . There was a statistically significant relationship between managerial political competencies and SME performance as measured by innovation and ROI.Practical/managerial implications: It is recommended that managerial political competencies be augmented internally through deliberate human resource development initiatives in order to leverage on them. It is also recommended that support structures and agencies that assist owner/managers in competency development be augmented at both provincial and government levels.Contribution/Value-add: The study attempts to fill the gap between research and practice regarding managerial political competencies in SMEs in South Africa.


2013 ◽  
Vol 39 (2) ◽  
Author(s):  
Chantal Olckers

Orientation: Psychological ownership emerged recently as a positive psychological resource that could be measured and developed and that could affect the performance of organisations.Purpose: The purpose of this study was to develop an instrument to measure psychological ownership in a South African context.Motivation for the study: It was found that previous instruments for the measurement of psychological ownership lacked the ability to grasp the extensive reach of psychological ownership.Research design, approach and method: A quantitative cross-sectional survey was conducted on a non-probability convenience sample of 713 skilled, highly-skilled and professional employees from various organisations in both the private and public sectors in South Africa.Main findings: Although a 69-item measurement instrument was developed in order to capture the proposed seven-dimensional psychological ownership construct, it became evident when analysing the data that a four-factor model comprising 35 items was suitable.Practical/managerial implications: If a sense of psychological ownership toward an organisation could be established amongst its employees by addressing the factors as measured by the South African Psychological Ownership Questionnaire, organisations could become enhanced workplaces and, as a result, sustainable performance could be promoted and staff could be retained.Contribution/value-add: The instrument for measuring psychological ownership in a South African context could serve as a diagnostic tool that would allow human resource professionals and managers to determine employees’ sense of psychological ownership regarding their organisation and to focus specifically on weak dimensional areas that could be improved.


2013 ◽  
Vol 39 (1) ◽  
Author(s):  
Katharina Vogt ◽  
Gregor J. Jenny ◽  
Georg F. Bauer

Orientation: Work-related sense of coherence (Work-SoC) is defined as the perceived comprehensibility, manageability and meaningfulness of an individual’s current work situation.Research purpose: The aim of the present study was to investigate the factorial invariance and the construct validity of a scale that measures Work-SoC.Motivation for the study: It might be useful to specifically apply the concept of sense of coherence to the work context.Research design, approach and method: Statistical analysis was performed on crosssectional (n = 3412) and longitudinal (n = 1286) questionnaire data collected in eight medium to large Swiss companies from diverse economic sectors (four industrialproduction companies, one food-processing company, one public-administration service and two hospitals). The dataset therefore covers a broad range of different occupational groups.Main findings: Multiple-group analyses indicated that the scale’s factor structure remains invariant across different employee groups and across time. High values in job resources were related to high values in Work-SoC whereas high values in job demands were related to low values in Work-SoC. Furthermore, Work-SoC acted as a partial mediator between job resources and work engagement.Practical/managerial implications: It can be concluded that Work-SoC might serve as a practical screening instrument for assessing an employee’s perception of the potential health-promoting qualities of his or her current work situation.Contribution/value-add: The study advances both the salutogenic theory and the field of positive occupational health psychology by redefining sense of coherence as an interactional and context-specific construct that is useful for intervention research.


2021 ◽  
Vol 14 (1) ◽  
Author(s):  
Albertus Hamman ◽  
Ines Nel ◽  
Merwe Oberholzer

Orientation: Within the conceptual paradigm that the institutional environment may influence investment criteria, this study argues that South Africa has a unique socio-economic environment and matters such as black economic empowerment, corruption, redistribution of land and other related matters pose unique challenges to private equity investors.Research purpose: The purpose was to determine the critical criteria that present a challenge to private equity investment professionals when considering an investment in business ventures in South Africa.Motivation for the study: As far as can be established, similar research to identify and prioritise the investment criteria used by private equity investors has not been done or published in South Africa.Research approach/design and method: A literature review was conducted to develop qualitatively a 51-component questionnaire, which was quantitatively tested by a convenience sample of 44 registered private equity investment professionals in South Africa.Main findings: Descriptive statistical analysis revealed that the most important individual criteria component is the intention of co-shareholders. From a factor analysis, the most important factors are the internal and the external abilities of the fund manager to identify investment opportunities.Practical/managerial implications: The new prioritised investment decision-making criteria may aid potential target companies, wanting to attract funding from private equity investors, to organise themselves to become attractive investment opportunities.Contribution/value-add: A new prioritised list was developed to better understand how South African private equity investment professionals make investment decisions.


2015 ◽  
Vol 41 (1) ◽  
Author(s):  
Marita Heyns ◽  
Sebastiaan Rothmann

Orientation: Research concerning trust relationships on the interpersonal level, particularly when studied in dyadic relationships from the follower’s point of view, is relatively scarce. Only a few researchers have attempted to link multiple dimensions of trust in the same study.Research purpose: This study examined the dynamic interplay between trust propensity, trustworthiness beliefs and the decision to trust, as perceived within dyadic workplace relationships. Motivation for the study: No studies, as far as the authors are aware, have ever attempted to use a combination of Mayer and Davis’s well-known assessment of trustworthiness and Gillespie’s measure of behavioural trust within the same study. By including measures of main antecedents and the actual decision to trust in the same study, the multidimensionality of trust can be established more concretely.Research approach, design and method: A cross-sectional survey design with a convenience sample (N = 539) was used. The Behavioural Trust Inventory and the Organisational Trust Instrument were administered.Main findings: Results confirmed the distinctness of propensity, trustworthiness and trust as separate main constructs. Trust was strongly associated with trustworthiness beliefs. Trustworthiness beliefs fully mediated the relationship between propensity and trust. The observed relations between propensity and trustworthiness suggest that individuals with a natural predisposition to trust others will be more inclined to perceive a specific trust referent as trustworthy.Practical/managerial implications: Leaders should realise that their attitudes and behaviour have a decisive impact on trust formation processes: if they are being perceived as trustworthy, followers will be likely to respond by engaging in trusting behaviours towards them. Tools to assess followers’ perceptions of the trustworthiness of the leader may provide useful feedback that can guide leaders.Contribution/value-add: This study contributes to scientific knowledge regarding the influence of propensity to trust and trustworthiness on trust of leaders.


2019 ◽  
Vol 45 ◽  
Author(s):  
Sean McCallaghan ◽  
Leon Jackson ◽  
Marita Heyns

Orientation: Organisations are consistently changing and diversifying; therefore, researchers and practitioners are viewing diversity as an essential part of organisational behaviour literature and practice.Research purpose: The purpose of this study was to investigate a simple mediation model, with the diversity climate as the proposed mediator, transformational leadership as the model antecedent and organisational commitment as the outcome.Motivation for the study: The South African diversity climate research is limited, including mediation investigations. Increased organisational diversification requires constant and relevant information with regard to diversity management.Research approach/design and method: A quantitative approach using a cross-sectional design collected 230 responses from a convenience sample. Transformational leadership was considered through six key behaviours associated with transformational leadership. Organisational commitment was considered as per the Psycones questionnaire and the organisational diversity climate was determined using a single-dimension diversity climate instrument. Statistical analysis included descriptive statistics, correlation analysis and a simple mediation model.Main findings: Correlation results revealed that both transformational leadership and a diversity climate demonstrated practical effects with organisational commitment. Results from a standardised regression coefficient confirmed that transformational leadership predicts the diversity climate significantly. Both transformational leadership and diversity climate predicted commitment. The simple mediation model revealed that the diversity climate can be considered a mediator in the relationship between transformational leadership and employee commitment.Practical/managerial implications: Organisations would benefit from leadership assessments for current and future employees, especially organisations that would like to prioritise a constructive diversity climate and employee commitment.Contribution/value-add: Contributions are made towards limited diversity climate investigations by providing empirical evidence of the mediating role of a diversity climate.


2018 ◽  
Vol 18 (1) ◽  
Author(s):  
Mpumelelo Longweni ◽  
Japie Kroon

Orientation: Active listening is the single most important contributor to effective communication by managers; however, this is the skill they seem to struggle with the most. Other important skills for effective communication include feedback and the ability to deal with interference.Research purpose: This study’s primary objective was to determine the effectiveness of managers’ listening and feedback skills and their ability to deal with interference during the listening and feedback phases of the communication process as perceived by subordinates with varying educational backgrounds.Motivation for the study: The aim was to improve managers’ communication with their subordinates.Research design, approach and method: The research followed a quantitative descriptive design. A self-administered questionnaire was compiled, a non-probability convenience sample was chosen and 931 usable responses were acquired.Main findings: The results showed that subordinates perceived their managers’ communication competencies to be marginally above average. Managers’ listening and feedback skills were perceived to be better by graduate-level subordinates than by those with only a Grade 12 qualification. Subordinates with a postgraduate degree also had better perceptions of these skills than those with a Grade 12 qualification, although this finding was not statistically significant.Practical and managerial implications: Managers need to be aware that their communication competencies are crucial to their business’s success. Additionally, their subordinates’ perception of the effectiveness of their communication varies according to varying educational levels. Therefore, managers are advised to consciously make greater efforts in their communication with subordinates with lower qualifications.Contribution or value-add: In conclusion, this article will make managers more knowledgeable about potential challenges they may encounter during the communication process regarding listening skills, feedback skills and propensity to deal with interference.


2010 ◽  
Vol 36 (2) ◽  
Author(s):  
Meryll L. Shein ◽  
Freddie Crous ◽  
Johann M. Schepers

Orientation: The main issue of this article concerns the construction and evaluation of an instrument measuring positive states and its relationship with entrepreneurship orientation.Research purpose: The principal objective of the study was the construction of a normative scale to measure the positive states associated with appreciative ability and to relate it to a scale of entrepreneurial orientation. A secondary objective was to determine whether there was a statistically significant relationship between the measures of the constructs and the biographical variables of gender and culture.Motivation: As appreciative ability is a relatively new construct and no instrument exists for measuring the positive states emanating from this construct, it was decided to develop such an instrument and to relate it to entrepreneurship orientation.Research design, approach and method: The primary data were obtained by means of the newly designed instrument, the Positive States Questionnaire and the Entrepreneurship Orientation Questionnaire. A convenience sample of 210 second year commerce students was drawn.Main findings: From a principal factor analysis applied to the two instruments, two factors each were obtained. A significantly high correlation was found, indicating a strong relationship between entrepreneurship orientation and the positive states. No significant differences were found between gender or population in the entrepreneurship orientation and positive states measures.Practical/managerial implications: The study produced an instrument with highly acceptable metrical properties which may be used in future studies and for entrepreneurship development.Contribution/value-add: The results of the study suggest that positive states are invaluable attributes for the entrepreneur and should be explored in the assessment and development of entrepreneurs.


Sign in / Sign up

Export Citation Format

Share Document