Alcohol and other drug treatment services NMDS, 2018–19; Quality Statement
Quality Statement Attributes
Identifying and definitional attributes | |
Metadata item type:![]() | Quality Statement |
---|---|
Synonymous names:![]() | AODTS NMDS 2018–19—Data Quality Statement |
METEOR identifier:![]() | 727501 |
Registration status:![]() |
|
Data quality | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Quality statement summary:![]() | Summary of key data quality issues The Alcohol and Other Drug Treatment Services National Minimum Dataset (AODTS NMDS) is based on closed episodes of treatment provided to clients by alcohol and other drug treatment services. The scope of the collection covers alcohol and other drug (AOD) agency services publicly funded through state, territory or Australian government programs. Key quality issues to consider for the collection include:
Description The AIHW collects AODTS NMDS data annually on closed episodes of treatment provided to clients of alcohol and other drug treatment agencies, including data on drugs of concern and the types of treatment received. The AODTS NMDS counts completed treatment episodes provided to clients by in-scope alcohol and other drug treatment agencies. This includes all clients who had completed 1 or more treatment episodes at an alcohol and other drug treatment service outlet, which was in scope during the period 1 July 2018 to 30 June 2019. An agency can have more than one service outlet. The AODTS NMDS is a collection of data from publicly funded treatment agencies in all states and territories, including those directly funded by DoH. Publicly funded alcohol and other drug treatment services collect the agreed data items from their service outlets and forward this information to the appropriate health authority such as the relevant state/territory departments, contracted AOD organisations and non-government AOD organisation peak bodies or the AIHW. Agencies are responsible for ensuring that the required information is accurately recorded. For each treatment episode in the AODTS NMDS, data are collected on:
For most states and territories, the data provided for the national collection are a subset of a more detailed jurisdictional data set used for planning at that level. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Institutional environment:![]() | The AIHW is a major national agency set up by the Australian Government under the Australian Institute of Health and Welfare Act 1987 (Cwlth) to provide reliable, regular and relevant information and statistics on Australia’s health and welfare. It is an independent corporate Commonwealth entity established in 1987, governed by a management board, and accountable to the Australian Parliament through the Health portfolio. The AIHW aims to improve the health and wellbeing of Australians through better health and welfare information and statistics. It collects and reports information on a wide range of topics and issues, from health and welfare expenditure, hospitals, disease and injury, and mental health, to ageing, homelessness, disability and child protection. The Australian Institute of Health and Welfare Act 1987, in conjunction with compliance to the Privacy Act 1988 (Cwlth), ensures that the data collections managed by the AIHW are kept securely and under the strictest conditions with respect to privacy and confidentiality. For further information see the AIHW website www.aihw.gov.au. Under a Memorandum of Understanding with DoH, the AIHW is responsible for the management of the AODTS NMDS. The AIHW maintains a coordinating role in the collection, including providing secretariat duties to the AODTS NMDS Working Group, undertaking data development and highlighting national and jurisdictional implementation and collection issues. The AIHW is also the data custodian of the national collection and is responsible for collating data from jurisdictions into a national data set and analysing and reporting on the data. AOD treatment service providers provide data to states and territories though a variety of administrative arrangements, contractual requirements or legislation. State and territory health authorities collate these data according to agreed specifications and report to the AIHW. Australian Government-funded providers submit data directly to the AIHW. In 2018–19, the AIHW collected data from services funded under the DAP—formerly NGOTGP—for the seventh consecutive year. Included under the DAP processing are agencies funded by their Primary Health Network (PHN). PHN-funded services provided data directly to the AIHW for the first time in 2016–17. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Timeliness:![]() | The AIHW collects AODTS NMDS data on closed episodes of treatment provided to clients of alcohol and other drug treatment services on an annual basis. The most recent collection is for the reference period 1 July 2018 to 30 June 2019. The 2018–19 AODTS national dataset was finalised by 14 January 2020, i.e. on the scheduled date. The first release of data for the 2018–19 reference period was published on 26 June 2020. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Accessibility:![]() | Reports incorporating AODTS NMDS data, including the annual Alcohol and other drug treatment services in Australia reports, are available on the AIHW website https://www.aihw.gov.au/reports-data/health-welfare-services/alcohol-other-drug-treatment-services/overview. Requests for unpublished data can be made by contacting the AIHW on (02) 6244 1000, by email to [email protected] or through the AIHW’s custom data request service at https://www.aihw.gov.au/our-services/data-on-request. A cost-recovery charge may apply to requests that require substantial resources. Depending on the nature of the request, requests for access to unpublished data may require additional approval from jurisdictional data custodians or the AIHW Ethics Committee. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interpretability:![]() | Contextual information on the alcohol and other drug treatment sector is available in the annual Alcohol and other drug treatment services in Australia reports. Supporting information about the data includes footnotes to tables and figures and details about the data items and methods used in reporting, as well as glossary items. Metadata for the AODTS NMDS is available from METeOR, the AIHW’s online metadata repository. METeOR specifications for the collection can be accessed from /content/index.phtml/itemId/686596 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Relevance:![]() | The AODTS NMDS contains information on treatment episodes provided by publicly funded alcohol and other drug treatment agencies. Data collected are for the financial year 2018–19. Data on agencies The AODTS NMDS collects information provided by publicly funded alcohol and other drug treatment agencies. Services are excluded from the AODTS NMDS if they:
The number of in-scope services reporting to the AODTS NMDS increased from 935 in 2017–18 to 1,283 in 2018–19. This increase is due to some jurisdiction changes in systems that split the reporting structure from organisation/agency level to service outlet (an agency can have more than one service outlet), reporting requirements and newly funded services. Jurisdictions were requested to provide information on the coverage of in–scope services in the data information document that accompanied their data submission. Based on the information supplied, approximately 97% of in–scope services nationally submitted data to the collection. Victoria reported an increase in the number of in-scope services in 2018–19 (248), due to new state-based collection migration, allowing more detailed reporting of consortia services (agency collaborations), newly funded services and further reporting at the service outlet location. For each agency in the AODTS NMDS, data are collected on the geographical location of the agency’s service outlet, each agency can have more than one service outlet location. Data on treatment episodes As a unit of measurement, the ‘closed treatment episode’ used in the AODTS NMDS contains information on all treatment episodes provided by in-scope agencies where the episode was closed in the relevant financial year. A treatment episode is considered closed where:
Data on clients The AODTS NMDS did not contain a unique identifier for clients until the 2012–13 collection, where an SLK (SLK-581) was introduced to enable the number of clients receiving treatment to be estimated. The SLK is constructed from information about the client's date of birth, sex and an alpha code based on selected letters of their name. Imputation for selected key AODTS NMDS data items is undertaken in instances where the response rate for the SLK falls below an agreed cut-off in any of the states and territories. Imputation was undertaken for the 2012–13, 2013–14 and 2015–16 collections, but was not necessary for the 2014–15, 2016–17 and 2017–18 collections (see the relevant data quality statements for previous collection years for more detail). Analysis of the 2018–19 SLK data showed that approximately 98.5% of national data contained a valid SLK, reflecting high response rates and improved SLK quality for all jurisdictions. While one jurisdiction reported under the agreed SLK response rate, due to the low number of records affected and improved overall response rates for SLK, imputation was not applied to the 2018–19 data. The number of estimated clients receiving AOD treatment services nationally in 2018–19 was 136,999. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Accuracy:![]() | Data for the AODTS NMDS are extracted each year from the administrative systems of the relevant state and territory departments or are provided by the treatment services directly to the state and territories. These data are then collated by the departments according to the definitions and technical specifications agreed to by the departments and the AIHW. Data are also directly provided to the AIHW by the DAP and PHN solely funded services. The number of closed treatment episodes increased from 208,935 in 2017–18 to 219,933 in 2018–19, predominantly due to system upgrades nearing completion in New South Wales and an increase in PHN-funded services reporting. An increase in closed treatment episodes was reported by New South Wales (2,863), Queensland (3,063), Western Australia (303), South Australia (687), Tasmania (17) and the Northern Territory (1,426); while the AIHW collected 8,677 more closed treatment episodes from solely DAP and PHN funded services. A decrease in closed treatment episodes was reported by Victoria (-5,807) and the Australia Capital territory (-231). Approximately 97% of in-scope treatment services submitted data to the AODTS NMDS in 2018–19. Six jurisdictions submitted 100% of in-scope treatment services, the exceptions being New South Wales (93.4%), Western Australia (98.1%) and solely DAP/PHN funded services (95.3%). In New South Wales, 27 in-scope services did not report due to agency staffing issues or the service were newly managed and still establishing reporting. Similarly, 7 solely DAP/PHN funded and 2 WA in-scope services did not report predominately due to nil activity. Each in-scope treatment service is required to provide information on each service delivery outlet. However, some only provide information for the service's main administrative centre and not each individual service outlet at which treatment is provided. As a result, the number of treatment services may be under-counted. Overall, the coverage of episode data in the AODTS NMDS for 2018–19 is good. For most data elements, fewer than 5% of records have missing data (including not stated or unknown responses) while 1.5% of records have an invalid SLK. National not stated or unknown responses are listed below. Not stated/unknown responses for data items, nationally, 2016–17 to 2018–19 (per cent)
. . not applicable (the data item does not apply) * Proportion calculated using the number of closed episodes where the client was receiving treatment for their own drug use. Not all jurisdictions code drug of concern using the full Australian Standard Classification of Drugs of Concern 2011 but rather use a short list of drug codes. As a result, some specific drugs may be under-reported. For example, oxycodone may be recorded as ‘opioid analgesics n.f.d.’ rather than the specific oxycodone code. Postcode of client was collected for the first time in 2013–14. In 2018–19, 2.5% of records had a missing postcode, ranging from zero in Western Australia to 5.1% in Victoria. Usual accommodation type of the client was introduced in the 2015–16 AODTS NMDS collection. However, Usual accommodation type of the client has not been reported due to a high number of not stated records for all collection years. In 2018–19, the variable contained not stated for 12.1% of records nationally. State and territory issues: New South Wales New South Wales Health collects data from all Australian Government/state government–funded agencies as part of requirements stipulated in a signed service agreement at the commencement or renewal of each funding agreement. Data are provided monthly by agencies to their respective Local Health Districts (LHDs). There are currently a number of data collection systems in use and development. The New South Wales Minimum Data Set is collected by these systems. This includes the data required for reporting for the AODTS NMDS. New South Wales has developed a Drug and Alcohol State Base Build Clinical Information System for use by government agencies. New South Wales LHDs finalised migration to this system in 2016–17 and are now reporting the New South Wales Minimum Data Set. Previous difficulty reporting data due to extract modifications and data quality issues have been largely rectified. The majority of non-government organisation data are collected via the NADA (Network of Alcohol and other Drug Agencies) online system. During the 2018–19 collection period all local health districts transitioned successfully to their current electronic health record and nearly all Non- Government services completed upgraded or migrating to their systems. In addition, agencies (both government and non-government) have been working on improving data completeness and quality for 2018–19. Victoria Victoria began the transition from its legacy Alcohol and Other Drug Information System (ADIS) to the new Victorian Alcohol and Drug Collection (VADC) from 1 October 2018. All agencies were reporting to the new collection by April 2019. The data set for 2018–19 includes a mix of ADIS and VADC data as a result of this transition. Implementation of the new collection has had an impact on data quality in 2018–19. These issues are being addressed and it is anticipated that data quality will improve in 2019–20 as the collection matures. The Victorian Department of Health & Human Services required agencies to submit data to ADIS each quarter and, once transitioned, to the VADC each month. This data was used to detail the provision of drug treatment services and achievement of episodes of care. A subset of this data is contributed to the AODTS NMDS annually. Adult community alcohol and other drug treatment services were re-commissioned in late 2014 and are now delivered through several treatment streams within catchment areas. These treatment streams include intake, counselling, withdrawal, rehabilitation and pharmacotherapy. The key deliverable for re-commissioned activity in Victoria is the drug treatment activity unit (DTAU), based on the number of closed courses. Non-recommissioned services were required to deliver episodes of care. Agencies funded to provide drug treatment services in Victoria have service provision targets, which are defined in terms of number of episodes of care or DTAUs to be provided, by service type and by target group (for example, youth). A reduction in Victorian alcohol and other drug treatment annual activity is evident in the AODTS NMDS during 2014–15 as a result of the service system re-commissioning. Caution should be used in comparing Victorian episodes with those of other states and territories. Victorian data are not directly comparable with data for other jurisdictions because every treatment type provided is reported as a separate episode; Victoria does not differentiate between main and other treatment types. Queensland Queensland Health collects data from all Queensland Government alcohol and other drug treatment service providers and from all Queensland Illicit Drug Diversion Initiatives – Police and Court Diversion clients. Queensland Health has a state-wide web-based clinical information management system supporting the collection of AODTS NMDS items for all Queensland Government alcohol and other drug treatment services. Since 2007, Queensland has funded the Queensland Network of Alcohol and Drug Agencies Ltd. (QNADA) to collate and deliver to Queensland Health aggregated AODTS NMDS data for the alcohol and other drug treatment non-government sector. Treatment provided to people diverted to services by police and the courts is recorded as information and education only. Actual treatment involves a 2-hour treatment session that included extensive alcohol and drug assessment to determine dependence, assessment of risk-taking behaviours, provision of advice and information on reducing/ceasing drug use and harm minimisation, motivational intervention, provision of resources and referral. For the purposes of the AODTS NMDS, Queensland report treatment episodes provided by specialised alcohol and other drug consultation liaison services. In Queensland, smoking cessation therapy is an endorsed treatment within the state-wide model of service that is delivered through public alcohol and other drug services. Western Australia Data are provided by both the government and non–government sectors. Services contracted by the Mental Health Commission (MHC) to provide alcohol and other drug treatment services have contractual obligations to incorporate the data elements of the AODTS NMDS in their collections. Services are also required to provide treatment episode data in a regular and timely manner to the MHC. These data items are collated and checked by the MHC regularly, including before annual submission to the AIHW. Western Australia does not differentiate between main and other treatment types. As such, Western Australia is not directly comparable with other jurisdictions because every treatment type provided is reported as a separate episode. Some contracted non-government treatment services located in the Perth metropolitan area are co-located with the MHC’s clinical service and operate as an integrated service. Time series data do not adequately illustrate these changes. South Australia Data are provided by government Drug and Alcohol Services South Australia (DASSA) and non-government alcohol and other drug treatment services. Non-government alcohol and other drug treatment services in South Australia are subject to service agreements with the South Australian Minister for Health and Wellbeing. As part of these service agreements, non-government organisations are required to provide timely client data in accordance with the AODTS NMDS guidelines. Data are forwarded to DASSA for collation and checking. DASSA then forwards cleaned data to the AIHW annually. DASSA does not collect information directly from those services funded by the DAP (formerly NGOTGP). These data are provided to DoH via AIHW. South Australia reported a high proportion of episodes of treatment where amphetamines are the principal drug of concern and assessment only is the main treatment type. This is related to assessments provided under the Police Drug Diversion Initiative. This program is legislated in South Australia, unlike other jurisdictions, and therefore results in a higher percentage of assessment only services with high rates of engagement with methamphetamine users. In addition, due to the Cannabis Expiation Notice legislation in South Australia, adult simple cannabis offences are not diverted to treatment and so are excluded from the data. Tasmania Non-government organisations funded by the Tasmanian Government provide AODTS NMDS and key performance indicator data under the provisions of a service agreement. AODTS NMDS data are submitted to Alcohol and Drug Service State Office on either a 6–monthly or yearly basis. Data quality reports are fed back to the non-government organisations and training/information on data capture practices are provided as required. Training in culturally sensitive practice has been provided for service providers across the Tasmanian alcohol and other drug service sector. Despite this, Tasmanian data reporting for Indigenous status still remains low. Australian Capital Territory Australian Capital Territory alcohol and other drug treatment service providers supply ACT Health with their complete data collection for the AODTS NMDS by 31 August each financial year. The services provide data via a standardised reporting system to enhance uniformity and reliability of data. Northern Territory Alcohol and other drug treatment services in the Northern Territory are provided by government and non-government agencies. The bulk of services provided through non-government agencies are funded via service-level agreements with the Northern Territory Department of Health. All funded agencies are required to provide AODTS NMDS data items to the department on a regular and timely basis as part of a larger data collection using an online data portal. All agencies in the Northern Territory are required to complete a separate assessment only episode prior to the commencement of treatment. This is related to a policy on monitoring the volume of assessment work performed by agencies, particularly in relation to certain alcohol-related legislatively-based programs. Australian Government Department of Health (DoH) DoH funds a number of alcohol and other drug treatment services under the Drug and Alcohol Program (DAP). Some agencies are funded by DoH directly, and some are funded via PHNs that commission the provision of services in their catchment areas. The DAP also includes former NGOTGP agencies. These agencies are required to collect data (according to the AODTS NMDS specifications) to facilitate the monitoring of their activities and to provide quantitative information to the Australian Government on their activities. Data from these agencies are generally submitted to the relevant state/territory health authority, except for a number of agencies in New South Wales, Victoria, Queensland, Western Australia, South Australia and Tasmania, which submit annual data directly to the AIHW. A portion of these services based in New South Wales and Queensland submit data via their state’s AOD non-government organisation peak body. Reported numbers for each state and territory in the AODTS NMDS annual report include services provided under the DAP. For the 2018–19 data collection period, selected DAP funded agencies and AOD non-government organisation peak bodies participated in a pilot trialling the use of Validata to clean and submit data. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Coherence:![]() | The AODTS NMDS was initially developed from 1996 to 2001 and the first report containing data from the data set was published in 2002. The data specifications were significantly altered for the 2003–04 collection and data from 2000–01 to 2002–03 are not comparable with data from later years. In 2011, the Australian Bureau of Statistics (ABS) phased out the Australian Standard Geographical Classification (ASGC) and replaced it with a new classification scheme: the Australian Statistical Geography Standard (ASGS). Also updated at this time were remoteness areas (RAs), based on the 2011 ABS Census of Population and Housing. From the 2012–13 AODTS NMDS collection onwards: the new Statistical Area level 2 (SA2) replaced the Statistical Local Area (SLA) for Geographical location of service delivery outlet. The geographical scheme (ASGS 2011) is collected using the element SA2. Data for previous years reported by remoteness are reported for RA 2006. Data for 2012–13 onwards are reported for RA 2011 using SA2. The AIHW considers the change from RA 2006 to RA 2011 to be a series break when applied to data supplied for this indicator; therefore, remoteness data for 2011–12 and previous years are not comparable to remoteness data for 2012–13 and subsequent years. For the 2018–19 collection, SA2 was updated to use the ASGS 2016 geographical scheme. This update was applied to reporting of RAs, with the RA 2016 scheme replacing RA 2011. For all remoteness area time series reported, the SA2 2011 of the service is converted to SA2 2016 and then converted to RA 2016. In 2011, the ABS updated the Australian Standard Classification of Drugs of Concern (ASCDC), which was first released in 2000. The updated version incorporates newer psychoactive substances; most notably there is a new category for ‘cannabinoid agonists’. In 2016, the ABS updated the Standard Australian Classification of Countries (SACC) and Australian Standard Classification of Languages (ASCL). Country of birth was updated for the 2012–13 collection period to use the Standard Australian Classification of Countries (SACC), 2011 and then again for the 2018–19 collection period to use the Standard Australian Classification of Countries (SACC), 2016 Preferred language was updated for the 2012–13 collection period to use the Australian Standard Classification of Languages (ASCL), 2011 and then again for the 2018–19 collection period to use the Australian Standard Classification of Languages (ASCL), 2016. In 2018–19, Sex was updated to include the value ‘3 – Other’ with the permissible format changed from ‘N’ to ‘X’. Accordingly, the SLK-581 Sex component format was updated from ‘N’ to ‘X’. The number of closed treatment episodes increased from 170,367 in 2014–15 to 206,635 in 2015–16, decreased to 200,751 in 2016–17 and increased from 208,935 in 2017–18 to 219,933 in 2018–19. Several factors can contribute to changes in the number of agencies reporting between years, as well as changes in the number of in-scope services. Some jurisdictions may change data collection approaches, e.g. by moving from collecting data at an administrative or management level to a service outlet level, an agency can have more than one service outlet operating in different locations. Data are also affected by variations in service structures and collection practices between states and territories. These differences need to be taken into consideration when making comparisons between jurisdictions. In addition, as the AODTS NMDS has been implemented in stages, some data are not directly comparable across all years, particularly the earlier years of the collection. Details on historical data element changes are found in Appendix A of the AODTS NMDS Data Collection Manual 2018–19. In 2018–19, the AOD treatment agency counting methodology was revised to better reflect the number of unique AOD treatment service outlets. There is a level of agency duplication, due to agencies splitting out episode data related to the funding source for that program/service. A small number of agencies split their data submission according to state funded service episodes, which are reported to relevant state or territory departments; and Commonwealth funded service episodes are reported to a peak body or directly to the AIHW. This has resulted in the double counting of some services over time. This revision has been applied to all time-series, the main changes in data related to AOD service counts are from 2014–15 to 2017–18. The AODTS NMDS reports on both main and additional treatment types. Data on treatment types from Victoria and Western Australia are not directly comparable with data from other jurisdictions. This should be taken into consideration when comparing episodes from these states with those of other states and territories. Victoria’s and Western Australia’s state alcohol and other drug collections do not differentiate between main and other treatment types. Tasmania’s illicit drug diversion treatment data are managed and extracted from the Drug Offence Reporting System (DORS), which resides with Tasmania Police. A high proportion of treatment episodes in Tasmania with the principal drug of cannabis can be attributed largely to the inclusion of this data. In 2018–19, the AIHW processed and aggregated data from agencies funded under the DAP—formerly the NGOTGP—on behalf of DoH for the seventh consecutive year. Included under the DAP processing are services funded by their PHN. PHN-funded services provided data to the AIHW for the first time in 2016–17. Under the new funding arrangements, funding was provided to existing AOD programs to boost their services and increase collaboration across agencies, as well as funding new treatment providers. In 2018–19, the AIHW processed data from 160 DAP/PHN funded services. Information comparable to the AODTS NMDS is collected, housed and used by each state and territory, as the AODTS NMDS is a subset of jurisdictional AOD treatment service collections. These jurisdicitonal based collections may be used for reporting and research. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Relational attributes | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Related metadata references:![]() | Supersedes Alcohol and other drug treatment services NMDS, 2017–18; Quality Statement
Has been superseded by Alcohol and other drug treatment services NMDS, 2019–20; Quality Statement
|