opening page ornament

The Australian Centre for Student Equity and Success acknowledges Indigenous peoples across Australia as the Traditional Owners of the lands on which the nation’s campuses are situated. With a history spanning more than 60,000 years as the original educators, Indigenous peoples hold a unique place in our nation. We recognise the importance of their knowledge and culture, and reflect the principles of participation, equity, and cultural respect in our work. We pay our respects to Elders past, present, and future, and consider it an honour to learn from our Indigenous colleagues, partners, and friends.

You are reading: Post-trial review report: Management of academically at-risk Bachelor of Commerce students at Curtin University

Trial information

The trial was designed and delivered by: Associate Professor J-Han Ho, Mrs Hannah Carson, Dr Fabio Costa, Professor Subra Ananthram, and Mrs Hannah Wilkinson.

The trial was funded by the Australian Centre for Student Equity and Success (ACSES) and the Faculty of Business and Law, Curtin University.

Conflict of interest statement: We identify no relevant conflicts of interest.

This study received Curtin University Human Research Ethics approval (HRE2024-0078).

Read the Executive Summary below. The full report is available for download in PDF [358 KB] or Word [246 KB] format.

Executive summary

Brief overview of the trial

This study aimed to evaluate the impact of targeted academic support provided to academically at-risk students—or Academically At-Risk Student Management (AARSM) practice—through a parallel randomised controlled trial (RCT) in Semesters 1 and 2, 2024. This academic support included the identification of academically at-risk second- and third-year Bachelor of Commerce (B.Com) students, and varying levels of targeted academic support. Due to challenges with gaining access to data in Semester 1, 2024 (detailed in Section 5), this phase was treated as a feasibility study, with this report focusing exclusively on Semester 2, 2024 data.

In Semester 2, 2024, the trial encompassed a population of 1,800 B.Com students, with 901 identified as academically at-risk, forming the study sample. These students were allocated into four groups (approximately 225 per group) receiving different levels of intervention intensity. However, inconsistent availability of assessment result data and issues arising relating to the quality of available data compromised the validity of the trial.

Summary of outcomes

The trial revealed shortcomings in the reliability and timeliness of data, impeding the ability for the trial to be implemented as intended.

As such, the trial was unable to determine whether the AARSM initiative resulted in statistically significant improvements in student engagement with the Learning Management System (LMS). No statistically significant increases in pass rates were observed across the intervention intensity levels.

However, the control group’s fail rate (11%) was nearly double the faculty average (approximately 6%), suggesting the identification of students at elevated academic risk may be a useful indicator of later success. Consequently, the criteria employed for identifying at-risk students in this trial hold promise for future studies

Key lessons and recommendations

  • To enhance data integrity and operational feasibility, future trials should incorporate comprehensive pre-trial scoping and a pilot, lead-in phase that focuses specifically on validating data accuracy and reliability, and ultimately suitability for evaluation purposes.
  • Achieving an adequately powered trial necessitates suitable planning and consideration of appropriate contingency measures tailored to specific contextual requirements and challenges as they emerge. Continuous expert guidance is critical during both the design and implementation phases to ensure methodological rigor and effective execution.

 


The full report is available for download in PDF [358 KB] or Word [246 KB] format.

Featured publications
A case study documenting the transition of one Indigenous student, Robbie, from an underprivileged school located in the Western suburbs of Sydney to an urban Australian university.
The Critical Interventions Framework Part 3 (CIF 3) focuses on evaluative studies which provide details of the impacts of specific interventions on equity groups in relation to access to and success in higher education.
A Small Grants Research Program final report. The study identified and analysed the strategies used in three Group of Eight university pathway programs to support Indigenous students to successfully transition into and through university.
This report outlines policy options in relation to parity targets for four priority equity groups in Australian higher education – students from low SES backgrounds, First Nations Australian students, students with disability, and students from regional and remote Australia.
More publications