KPIs for Australian Public Mental Health Services: PI 01J – Change in mental health consumer's clinical outcomes, 2018
Identifying and definitional attributes
|Metadata item type:||Indicator|
|Short name:||MHS PI 01J: Change in mental health consumer's clinical outcomes, 2018|
|Registration status:||Health, Superseded 16/02/2021|
The proportion of mental health-related episodes of care where:
was identified between baseline and follow-up of completed outcome measures.
NOTE: This specification has been adapted from the indicator Change in mental health consumer's clinical outcomes, 2018 (Service level) using terminology consistent with the National Health Data Dictionary. There are technical differences in the consumer groups listed in the methodology section between the Service level version and the Jurisdictional level version of this indicator. Caution should be taken to ensure the correct methodology is followed.
State/territory specialised mental health services aim to reduce symptoms and improve functioning. Their effectiveness can be compared using routinely collected measures. This will assist in service benchmarking and quality improvement.
The implementation of routine mental health outcome measurement in Australia provides the opportunity to monitor the effectiveness of mental health services across jurisdictions.
|Indicator set:||Key Performance Indicators for Australian Public Mental Health Services (Jurisdictional level version) (2018) Health, Superseded 16/02/2021|
Collection and usage attributes
State/territory specialised mental health service.
The following episodes of care are excluded:
(Numerator ÷ Denominator) x 100
Calculated separately for each consumer group.
Number of completed or ongoing episodes of mental health care with completed outcome measures, partitioned by mental health setting, where significant improvement/significant deterioration/no significant change was identified between baseline and follow-up within the reference period.
|Numerator data elements:|
Number of completed or ongoing episodes of mental health care with completed outcome measures, partitioned by mental health setting within the reference period.
|Denominator data elements:|
Service variables: setting (Group A, B or C).
Consumer attributes: age (0-17, 18-64, 65+).
|Disaggregation data elements:|
Coverage estimates for this indicator—that is the proportion of mental health care episodes with completed clinical outcome measures at both baseline and follow-up—were previously published in MHS KPI 14: Outcomes readiness. Following a review of the indicator set, Outcomes readiness will no longer be reported as a separate indicator but coverage estimates for both service variables and consumer attributes will be included in the reporting of the Change in mental health consumer's clinical outcomes.
|Unit of measure:||Service event|
Indicator conceptual framework
|Framework and dimensions:||Effective|
|Further data development / collection required:|
The NOCC, maintained by the Australian Government Department of Health compiles all state and territory consumer outcomes data on an annual data submission basis. However, the NOCC does not allow linkage of episodes of care across financial years. This limitation does not exist for states and territories own data sets.
Compared to data constructed from state and territory data sets and using complete episodes, this limitation is likely to result in calculation of the indicator based on a significantly smaller pool of episodes. It may also have a systematic effect on apparent results on this indicator, but the direction and size of this effect has not been systematically tested.
|Other issues caveats:|
Change in consumers’ clinical outcomes is not presented for states and territories with less than 200 unique consumer outcomes identifiable within the reference period. States and territories excluded from individual publication are used to calculate the change in consumers’ clinical outcomes for Australia.
Greater variability in HoNOS scores can be expected, if effect sizes were calculated using ‘locally’ derived standard deviations. Statistically, fewer observations generally give rise to greater variability.
Source and reference attributes
Australian Institute of Health and Welfare on behalf of the National Mental Health Performance Subcommittee
National Mental Health Performance Subcommittee (NMHPSC) 2013. Key Performance Indicators for Australian Public Mental Health Services, 3rd edn. Canberra: NMHPSC.
|Related metadata references:|
See also Change in mental health consumer's clinical outcomes, 2018 Health, Candidate 09/08/2018
Supersedes KPIs for Australian Public Mental Health Services: PI 01J – Change in consumer's clinical outcomes, 2017 Health, Standard 14/06/2017
Has been superseded by KPIs for Australian Public Mental Health Services: PI 01J – Change in mental health consumer's clinical outcomes, 2019 Health, Superseded 16/02/2021