In the discipline of Industrial and Organisational Psychology, there is a revolution going on. Critiques of old studies are as part of the replication crisis are becoming common. There are the callouts of pop-psychology often deliberately oversimplifying studies to make sensationalist headlines. New studies are being produced that address the
Phaf, R. H. (2020). Publish less, read more. Theory & Psychology, 30(2), 263-285. https://doi.org/10.1177/0959354319898250 Abstract A publication deluge has impeded rather than advanced theory in experimental psychology. Many researchers rely more on null-hypothesis significance testing than literature studies to determine whether results are worthwhile. Four problematic publication practices are symptomatic
Chivers, T. (2019). What's next for psychology's embattled field of social priming. Nature, 576(7786), 200-202. Three years ago, a team of psychologists challenged 180 students with a spatial puzzle. The students could ask for a hint if they got stuck. But before the test, the researchers introduced some subtle interventions
Janosov, M., Battiston, F., & Sinatra, R. (2019). Success and luck in creative careers. Physics and Society. arXiv:1909.07956 Lu, D. (2019, September 26). Around half of your chances of career success comes down to sheer luck. New Scientist. https://www.newscientist.com/article/2217628-around-half-of-your-chances-of-career-success-comes-down-to-sheer-luck/ How much of a person’s career success is the result of
One of the dirty little secrets in the assessment business is the way that assessments are validated. There are no formal systematic approaches for the validation of tests that are easy for tests users, not versed in statistics, to follow.
A recent study published in PLoS ONE conducted a reanalysis of a meta-analysis on Positive Psychology Interventions (PPI’s). A meta-analysis is, in simple terms, a statistical means of combining data from a lot of studies, and is an analysis of analysis. The results of a meta-analysis are often more robust than single studies as they combine data from multiple sources.
I think the claims to measurement in our discipline are on shaky ground to put in politely. As such, I often think that we should be focussed more on the evaluation of usefulness rather than infinitesimally small gains in measurement accuracy.
The International Journal of Selection and Assessment recently included a feature article on the gamification of assessment. While the research methodology in the article was sound, I could not help but think that the article in many ways symbolised what is wrong with much of the assessment literature that emphasises psychometric properties as opposed to practical utility.