Reliability and Validity

In order to ensure its reliability and validity, the first version of the PsychProfiler was subjected to a series of rigorous psychometric analyses over a number of years. This process involved validation against a large mainstream sample (n>1000) as well as clinical calibration against individuals with formal diagnoses. All analyses found the PsychProfiler to be a highly reliable and valid screening instrument.

Further more, as the PsychProfiler originated from Dr Langsford’s PhD thesis, its initial version has been critically reviewed by multiple well-regarded international experts and an indication of its psychometric prowess and differentiation from other instruments was provided by Associate Professor Stuart McNaughton, from the University of Auckland, who stated:
The careful development and testing of the self-report instrument provides the educational / clinical community with a very useful tool that can increase early sensitivity and overcomes previously existing problems in screening for morbidity.

Similarly, Dr Terry de Jong, University of Cape Town, South Africa, stated:
The validity and reliability checks were thorough, such as those pertaining to the readability of the CAPP and the triangulation method applied. What an invaluable contribution it is to the profession.

Subsequent versions of the PsychProfiler have continued to have their psychometric properties investigated both internally and by independent entities such as the Australian Council for Educational Research (ACER).

In 2009, ACER conducted a comprehensive investigation of the psychometric properties of the Child and Adolescent PsychProfiler (CAPP) using the Rasch model and reported:
Overall, the Rasch analysis has found the CAPP to be psychometrically sound with adequate internal consistency, reliability and construct validity.

Please click here if you would like to view the ACER Research Report.

Another large reliability and validity project investigating the psychometric properties of the current version of the PsychProfiler has been taking place over the course of 2019. This has involved the collection of PsychProfiler results as well as the results of other instruments (e.g., Conners, Beck-YI, DSM-5) from the same individual for the purpose of assessing its concurrent validity.

So far, data from 320 children and adolescents, and 270 adults have been collected with the analysis results to be published in early 2020.