Weekley, Jeff

Permanent URI for this collectionhttps://hdl.handle.net/10735.1/7170

Jeff Weekley is Clinical Professor of Organizations, Strategy and International Management. He also serves as Director of the Bachelor of Science program in Human Resource Management. His research interests include:

  • Job analysis
  • Situational judgment testing
  • Internal-external labor markets

Browse

Recent Submissions

Now showing 1 - 1 of 1
  • Thumbnail Image
    Item
    Job Analysis Ratings and Criterion-Related Validity: Are They Related and Can Validity Be Used as a Measure of Accuracy?
    (John Wiley and Sons Ltd., 2019-04-29) Weekley, Jeff A.; Labrador, J. R.; Campion, M. A.; Frye, K.; 0000-0002-1547-5469 (Weekley, JA); Weekley, Jeff A.
    Job analysis data are largely judgements from subject matter experts (SMEs), judgements with unknown accuracy. To date, accuracy has been inferred largely based on inter-rater reliability or agreement between SMEs and without reference to an external criterion. The current research examined job analysis rating accuracy by comparing SME importance ratings of knowledge, skills, abilities, and other requirements (KSAOs) with the validity of measures of these same KSAOs in predicting job performance. We tested hypotheses about whether SME judgement accuracy is moderated by SME job tenure, industry experience, role, self-reported knowledge of the job, and data scrubbing. Four independent tests involving 48 separate validation studies were conducted. In three of the four samples, there was a large (r =.50 range) relationship between trait importance and trait validity, showing that job analysis ratings can be directly related to test validities and serve as a measure of job analysis accuracy. Moderator analyses showed that the best results may come from supervisors, rather than incumbents, and those who know the job extremely well (there were no differences due to SME job tenure, industry experience, or deletion of outliers). Showing a direct relationship between SME judgements and actual criterion-related validity provides a new lens for operationalizing accuracy in job analysis research. Practitioner Points: This study demonstrates that test validities can serve as a measure of accuracy, providing a new avenue for job analysis research. The most accurate job analysis ratings came from supervisors and those who reported knowing the job extremely well. ©2019 The British Psychological Society

Works in Treasures @ UT Dallas are made available exclusively for educational purposes such as research or instruction. Literary rights, including copyright for published works held by the creator(s) or their heirs, or other third parties may apply. All rights are reserved unless otherwise indicated by the copyright owner(s).