In this study, the authors examined an established conventional written test and an adaptive online adult numeracy assessment. The usefulness of each assessment tool was analysed in terms of how it revealed the foundation content knowledge of pre-service teachers. The two assessment tools were administered to different cohorts of pre-service teachers. Both assessment tools provide information about the learning needs of each pre-service teacher. Crucially, the adaptive assessment tool gave immediate feedback directly to pre-service teachers.