Document Actions

Science practitioner gap

Why do practitioners in personnel selection use different procedures than advised by science? Insights from organizational theory suggest that the reason for this is not plain ignorance, but that practitioners attempt to satisfy requirements issued by multiple stakeholders, many of whom have found insufficient consideration in the research literature on personnel selection. Science Practionar Gap Banner

 

 Previous publications in this line of study include:

  • Van Horst, A. C., Klehe, U.-C., & van Leeuwen, L. (in press).
    Doing it all at once: Multitasking as a predictor of call center agents’ performance and performance based dismissal.
    International Journal of Selection and Assessment.
Abstract
Multitasking has become an important skill in many jobs. Still, the predictive validity of job-applicants’ multitasking abilities has rarely been tested empirically. The current study focusses on the multitasking ability of call center applicants. Results from a Dutch call center show that applicants’ multitasking ability as assessed during personnel selection indeed predicts their later job performance as call center agents as well as their likelihood of losing their job for poor performance. While some of these relationships could be explained via applicants’ fluid intelligence, results also support the usefulness of including measures of multitasking ability in the current selection procedure.
Availability
Journal’s website:
Open access download: -
Further access: please contact  to receive a copy of the manuscript.

 

  • Klehe, U.-C. (2011).
    Scientific principles versus practical realities: Insights from organizational theory to individual psychological assessment.
    Industrial and Organizational Psychology, 4, 311-316.
Abstract
Individual psychological assessment (IPA) for executive and top management positions isn´t an easy job. Still, knowledge gained over decades of scientific study suggests that we rely on structured job and organizational analyses; the construction of appropriate high- and low-fidelity simulations, cognitive tests, and affective inventories suitable in content and difficulty (Ones & Dilchert, 2009; Rubenzer, Faschingbauer, & Ones, 2000); as well as a structured and mechanical combination of the resulting information (Aegisdottir et al.,2006; Grove, Zald, Lebow, Snitz, & Nelson, 2000). And we will likely still remain painfully aware of the poor ability of even our most refined assessments for predicting executives´ performance.
Silzer and Jeanneret (2011) "disagree with those who have a simplistic view of executive roles" and argue that they "do not think a job-sampling approach to establish job relatedness [...] is feasible, given the complexity of executive jobs and the significant influence of contextual factors" and that "test batteries would only evaluate individuals on very general factors (mostly cognitive factors) that are far too broad to differentiate specific executive success." Rather, they stress the expertise of the assessing psychologist and "the clinician´s genuine creative act of generating a structural-dynamic hypothesis," arguing for assessors´ proposed ability to sort and integrate observations in multiple ways, to identify "broken legs" and to adapt the focus of the testing to the information so far received. Many reasons may explain why even scientist–practitioners discard the advice of their own discipline, ranging from implicit beliefs (Highhouse, 2008), classic attribution errors, and decision-making biases (Phillips & Gully, 2008) to the evolutionary novelty of our statistical decision rules for a task (predicting others´ behavior) as old as man himself (Colarelli & Thompson, 2008). Klimoski and Jones (2008) argued to also consider the context of personnel selection. Already conceptualized (Klehe, 2004) and proven useful (König et al., 2010) for personnel selection in general, this commentary tries to apply this idea to IPA in particular.
Availability
Journal’s website: http://onlinelibrary.wiley.com/doi/10.1111/j.1754-9434.2011.01345.x/abstract
Open access download: http://nbn-resolving.de/urn:nbn:de:hebis:26-opus-85184

 

  • König, C.J., Klehe, U.-C., Berchtold, M. & Kleinmann, M. (2010).
    Reasons for being selective when choosing personnel selection procedures.
    International Journal of Selection and Assessment, 18, 17-27.
Abstract
The scientist–practitioner gap in personnel selection is large. Thus, it is important to gain a better understanding of the reasons that make organizations use or not use certain selection procedures. Based on institutional theory, we predicted that six variables should determine the use of selection procedures: the procedures' diffusion in the field, legal problems associated with the procedures, applicant reactions to the procedures, their usefulness for organizational self-promotion, their predictive validity, and the costs involved. To test these predictions, 506 HR professionals from the German-speaking part of Switzerland filled out an online survey on the selection procedures used in their organizations. Respondents also evaluated five procedures (semi-structured interviews, ability tests, personality tests, assessment centers, and graphology) on the six predictor variables. Multilevel logistic regression was used to analyze the data. The results revealed that the highest odd ratios belonged to the factors applicant reactions, costs, and diffusion. Lower (but significant) odds ratios belonged to the factors predictive validity, organizational self-promotion, and perceived legality.
Availability
Journal’s website: -
Open access download: http://nbn-resolving.de/urn:nbn:de:hebis:26-opus-85323

 

  • Klehe, U.-C. (2008).
    Die DIN 33430 – eine komplexe Norm für eine komplexe Welt [DIN 33430 – A complex norm for a complex world].
    Zeitschrift für Personalpsychologie, 7, 183-188.
Abstract
-
Availability
Journal’s website: http://psycontent.metapress.com/content/v2434j58347g73u2/?p=88ce538bacf0401daf56bf4747b04c2e&pi=4
Open access download: http://nbn-resolving.de/urn:nbn:de:hebis:26-opus-85268

  

  • Klehe, U.-C. (2004).
    Choosing how to choose: Institutional pressures affecting the adoption of personnel selection procedures.
    International Journal of Selection and Assessment, 12, 315-330.
Abstract
The gap between science and practice in personnel selection is an ongoing concern of human resource management. This paper takes Oliver’s framework of organizations’ strategic responses to institutional pressures as a basis for outlining the diverse economic and social demands that facilitate or inhibit the application of scientifically recommended selection procedures. Faced with a complex network of multiple requirements, practitioners make more diverse choices in response to any of these pressures than has previously been acknowledged in the scientific literature. Implications for the sciencepractitioner gap are discussed.
Availability
Journal’s website: http://papers.ssrn.com/sol3/papers.cfm?abstract_id=635705
Open access download: http://nbn-resolving.de/urn:nbn:de:hebis:26-opus-85307