Alcohol and other drug treatment services NMDS, 2014–15; Quality Statement
Data Quality Statement Attributes
Identifying and definitional attributes | |
Metadata item type: | Data Quality Statement |
---|---|
Synonymous names: | AODTS NMDS 2014–15—Data Quality Statement |
METEOR identifier: | 637860 |
Registration status: | AIHW Data Quality Statements, Superseded 28/06/2017 |
Data quality | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Data quality statement summary: | Summary of key data quality issues The Alcohol and Other Drug Treatment Services National Minimum Dataset (AODTS NMDS) is based on closed episodes of treatment provided to clients by alcohol and other drug treatment services. All in-scope service agencies are publicly funded, including some funding through state, territory or Australian government programs. Key quality issues to consider for the collection include:
In 2012–13, the AODTS NMDS implemented a statistical linkage key (SLK) for the first time. This linkage key enables the number of clients receiving treatment to be counted. As SLKs may not be available for all treatment episodes imputation is used to estimate the number of individuals in 2012–13 and 2013–14. The rate of invalid SLKs decreased from 12% in 2012–13 to 4% in 2013–14; in 2014–15 no imputation was required. As less imputation is required to account for the missing SLKs, this may affect comparability. Description The Australian Institute of Health and Welfare (AIHW) collects AODTS NMDS data annually on closed episodes of treatment provided to clients of alcohol and other drug treatment services, drugs of concern and the types of treatment received. The AODTS NMDS counts completed treatment episodes provided to clients by in-scope alcohol and other drug treatment services. This includes all clients who had completed 1 or more treatment episodes at an alcohol and other drug treatment service that was in scope during the period 1 July 2014 to 30 June 2015. The AODTS NMDS is a collection of data from publicly-funded treatment services in all states and territories, including those directly funded by the Australian Government Department of Health (DoH). Publicly-funded alcohol and other drug treatment agencies collect the agreed data items and forward this information to the appropriate health authority such as state/territory health authority, contracted AOD organisation or the AIHW. Agencies are responsible for ensuring that the required information is accurately recorded. For most states and territories, the data provided for the national collection are a subset of a more detailed jurisdictional data set used for planning at that level. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Institutional environment: | The Australian Institute of Health and Welfare (AIHW) is a major national agency set up by the Australian Government under the Australian Institute of Health and Welfare Act 1987 to provide reliable, regular and relevant information and statistics on Australia’s health and welfare. It is an independent corporate Commonwealth entity established in 1987, governed by a management board, and accountable to the Australian Parliament through the Health portfolio. The AIHW aims to improve the health and wellbeing of Australians through better health and welfare information and statistics. It collects and reports information on a wide range of topics and issues, from health and welfare expenditure, hospitals, disease and injury, and mental health, to ageing, homelessness, disability and child protection. The AIHW also plays a role in developing and maintaining national metadata standards. This work contributes to improving the quality and consistency of national health and welfare statistics. The AIHW works closely with governments and non-government organisations to achieve greater adherence to these standards in administrative data collections to promote national consistency and comparability of data and reporting. One of the main functions of the AIHW is to work with the states and territories to improve the quality of administrative data and, where possible, to compile national data sets based on data from each jurisdiction, to analyse these data sets and disseminate information and statistics. The Australian Institute of Health and Welfare Act 1987, in conjunction with compliance to the Privacy Act 1988 (Cwlth), ensures that the data collections managed by the AIHW are kept securely and under the strictest conditions with respect to privacy and confidentiality. For further information see the AIHW website www.aihw.gov.au. Under a Memorandum of Understanding with the Department of Health, the Australian Institute of Health and Welfare (AIHW) is responsible for the management of the AODTS NMDS. The AIHW maintains a coordinating role in the collection, including providing secretariat duties to the AODTS NMDS Working Group, undertaking data development and highlighting national and jurisdictional implementation and collection issues. The AIHW is also the data custodian of the national collection and is responsible for collating data from jurisdictions into a national data set and analysing and reporting on the data. Alcohol and other drug treatment service providers may be required to provide data to states and territories though a variety of administrative arrangements, contractual requirements or legislation. State and territory health authorities collate these data according to agreed specifications and report to the AIHW. Australian Government-funded providers submit data directly to the AIHW. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Timeliness: | The AIHW collects AODTS NMDS data on closed episodes of treatment provided to clients by alcohol and other drug treatment services on an annual basis. The most recent collection is for the reference period 1 July 2014 to 30 June 2015. The state and territory health departments and Department of Health funded Non-Government Organisation Treatment Grant Program (NGOTGP) agencies, provide data to the AIHW using the AIHW’s online data validation tool (Validata). For the 2014–15 collection, data were due for submission through the Validata at the end of November 2015 with final approval of all data due at the end of December 2015. This was accomplished by 5 January 2015. The 2014–15 national dataset was finalised by 13 January 2016, two days before the due date. The first release of data for the 2014-–15 reference period was published on 20 April 2016. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Accessibility: | Reports incorporating AODTS NMDS data, including the annual Alcohol and other drug treatment services in Australia reports, are available on the AIHW website http://www.aihw.gov.au/alcohol-and-other-drugs-publications/. These reports are available for download free of charge. To enhance data availability, a series of supplementary tables accompanying the annual report is also available online. Requests for unpublished data can be made by contacting the AIHW on (02) 6244 1000, by email to [email protected] or through AIHW’s custom data request service at www.aihw.gov.au/custom-data-request-service. A cost-recovery charge may apply to requests that require substantial resources. Depending on the nature of the request, requests for access to unpublished data may require additional approval from jurisdictional data custodians or the AIHW Ethics Committee. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Interpretability: | Contextual information on the alcohol and other drug treatment sector is available in the annual Alcohol and other drug treatment services in Australia reports. Supporting information about the data includes footnotes to tables and figures and details about the data items and methods used in reporting, as well as glossary items. Metadata for the AODTS NMDS is available from METeOR, the AIHW’s online metadata repository. METeOR specifications for the collection can be accessed from /content/index.phtml/itemId/583090. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Relevance: | The AODTS NMDS contains information on treatment episodes provided by publicly-funded alcohol and other drug treatment services. Data are collected for the financial year 2014–15. Data on agencies The AODTS NMDS collects information provided by publicly-funded alcohol and other drug treatment services. Agencies are excluded from the AODTS NMDS if they:
Australian Government-funded primary health care services and substance-use services are in scope for the AODTS NMDS, but most of these agencies do not contribute to the collection as they currently provide data to other collections. The number of agencies reporting to the AODTS NMDS increased from 796 in 2013–14 to 843 in 2014–15. Jurisdictions were requested to provide information on the coverage of in–scope agencies in the data information document that accompanied their data submission. Based on the information supplied, approximately 96% of in–scope agencies nationally submitted data to the collection. There was a large decrease in the number of in–scope agencies reporting for New South Wales (–8%) and Tasmania (–14%). For each agency in the AODTS NMDS, data are collected on the geographical location of the agency. Data on treatment episodes As a unit of measurement, the ‘closed treatment episode’ used in the AODTS NMDS cannot provide information on the number of clients who access publicly funded alcohol and other drug treatment, nor can it provide information on the extent of concurrent, sequential or recurrent service use. This is because it is possible for a single individual to access more than 1 service at a time, for different treatments and for different substance-use problems. The AODTS NMDS contains information on all treatment episodes provided by in-scope agencies where the episode was closed in the relevant financial year. A treatment episode is considered closed where:
Treatment episodes are excluded from the AODTS NMDS if they:
For each treatment episode in the AODTS NMDS, data are collected on:
Data on clients The AODTS NMDS does not contain a unique identifier for clients and information about clients is collected at the episode level. For the 2012–13 collection, an SLK was introduced to enable the number of clients receiving treatment to be counted while continuing to ensure the privacy of these individuals receiving treatment. The SLK is constructed from information about the client's date of birth, sex and an alpha code based on selected letters of their name. In the 2012–13 and 2013–14 collection cycles, SLK data were not available for all clients; an imputation strategy was developed to adjust the data to account for this. Imputation was not required for the 2014–15 collection period, due to high rates of valid SLKs. Further information about the imputation methodology applied to these data can be found online as part of the release of the Alcohol and other drug treatment services in Australia 2014–15 report. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Accuracy: | Data for the AODTS NMDS are extracted each year from the administrative systems of the health departments or are provided by the treatment agencies directly to the health departments. These data are then collated by the health departments according to the definitions and technical specifications agreed to by the departments and the AIHW. Data for the AODTS NMDS are available from 2001–02; however, due to comparability issues, only data from 2005–06 are used in this report to present a 10 year trend series. The number of closed treatment episodes decreased from 180,783 in 2013–14 to 170,367 in 2014–15. Victoria reported an overall decrease of approximately 10,537 treatment episodes and New South Wales reported a decrease of 6,119 treatment episodes between 2013–14 and 2014–15. Approximately 96% of in-scope treatment services submitted data to the AODTS NMDS in 2014–15. Four jurisdictions submitted 100% of in-scope treatment services except for New South Wales (92%), Victoria (98.6%), Tasmania (86.4%) and Northern Territory (94.7%). In NSW, 25 in-scope agencies did not report in 2014–15, these agencies account for around one-third of the overall decrease of 6,119 episodes in 2014–15. Each in-scope treatment service is required to provide information on each agency related to the service (including delivery outlets). However, some services only provide information on the main administrative centre. As a result, the number of treatment agencies may be under counted (information on the number of agencies for which data are not provided is not available). Overall, the coverage of episode data in the AODTS NMDS for 2014–15 is good. For most data elements, less than 2% of records have missing data (including not stated or unknown responses) while less than 2% of records have an invalid SLK. Around 6% of records have an unknown Indigenous status. Of the records relating to episodes provided to clients receiving treatment for their own drug use, reason for cessation is not available for 4%, method of drug use is not available for 7% and injecting drug use status is not available for 15%.
. . not applicable (the data item does not apply) * Proportion calculated using the number of closed episodes where the client was receiving treatment for their own drug use.
For the 2012–13 and 2013–14 collection periods, SLK data was not available for all clients; an imputation strategy was developed to adjust the data to account for this. The resulting number of clients for these periods is reliant on the assumptions made in the imputation. In 2014–15 imputation was not required. Further information about the imputation methodology can be found online in the Alcohol and other drug treatment services in Australia 2014–15 report. Not all jurisdictions code drug of concern using the full Australian Standard Classification of Drugs of Concern 2011 but rather use a short list of drug codes. As a result, some specific drugs may be under-reported. For example, oxycodone may be recorded as ‘opioid analgesics n.f.d.’ rather than the specific oxycodone code. Postcode of client was collected for the first time in 2013–14. In 2014–15 approximately 6% of records had a missing postcode, ranging from zero in Western Australia to 19% in New South Wales. State and territory issues: New South Wales New South Wales Health collects data from all Australian Government–/state government–funded agencies as part of requirements stipulated in a signed service agreement at the commencement or renewal of each funding agreement. Data are provided monthly by agencies to their respective Local Health Districts (LHD).There are currently a number of data collection systems in use and development. The New South Wales Minimum Data Set is collected by these systems from which the collection of the AODTS NMDS is provided. New South Wales has developed a Drug and Alcohol State Baseline Build Information System for use by government agencies. During the 2014–15 collection cycle, a number of NSW Local Health Districts (LHDs) migrated to this system. This process began in 2014–15 and will continue until the first half of 2016–17 for most agencies. Agencies are moving from one or a number of legacy systems. There has been difficulty reporting data due to the ongoing development and testing of extracts. Therefore the data in NSW has been under reported for 2014–15 . It is expected that the problems will continue for the remainder of 2016 but the extracting and reporting of data will improve. Note that not all NSW government agencies (& LHDs) will migrate to the new system. The majority of NGO data are collected via the NADA (Network of Alcohol and other Drug Agencies) online system. NADA is the peak organisation for the non–government drug and alcohol sector in New South Wales. Victoria In September 2014, a range of reforms were introduced to the Victorian Alcohol and Other Drug Treatment Sector to establish a much more integrated and high-performing alcohol and drug system. Reform was achieved by recommissioning existing service providers; remodelling existing key service types; introducing new funding arrangements; and streamlining the configuration of current service delivery activities and responsibilities. The goals of Reform were to achieve:
To provide better operations in the reformed environment, a number of the larger service providers developed and implemented their own in-house Client Management Systems thus lessening their dependence on the legacy SWITCH or FULLADIS information systems. Hospitals and community health centres however continued to use the HealthSMART client management system to report on alcohol and other drug treatment activity. The key deliverable for reformed activity in Victoria is the Drug Treatment Activity Unit (DTAU), based on the number of closed Courses of Treatment. For unreformed services the deliverable is Episode of Care. Agencies funded to provide drug treatment services in Victoria have service provision targets, which are defined in terms of number of episodes of care or DTAUs to be provided, by service type and by target group (for example, youth or adult). As a requirement of their funding agreement with the Victorian Department of Health & Human Services, agencies are required to submit data quarterly detailing their provision of drug treatment services and achievement of episodes of care. A subset of this data is contributed to the AODTS NMDS annually. Note that the reduction in Victorian Alcohol and Other Drug Treatment activity is evident in the AODTS NMDS, when compared to 2013–14; this is associated with service system reform during 2014–15. Also caution should be used in comparing Victorian episodes with those of other states and territories. Victorian data are not directly comparable with data for other jurisdictions because every treatment type provided is reported as a separate episode; Victoria does not differentiate between main and other treatment types. Victoria only provides information about non–government agencies that receive public funding. Queensland Queensland Health collects data from all Queensland Government alcohol and other drug treatment service providers and from all Queensland Illicit Drug Diversion Initiatives—Police and Court Diversion clients. The Australian Government currently collects data from the Australian Government–funded agencies operating in Queensland. Queensland Health has a state-wide web-based clinical information management system supporting the collection of AODTS NMDS items for all Queensland Government alcohol and other drug treatment services. Since 2007, Queensland Health has funded the Queensland Network of Alcohol and Drug Agencies Ltd (QNADA) to collate and deliver to Queensland Health aggregated AODTS NMDS data for the alcohol and other drug treatment non-government sector. Treatment provided to people diverted to services by police and the courts is recorded as information and education only. Actual treatment involves a 2-hour treatment session that includes extensive alcohol and drug assessment to determine dependence, assessment of risk-taking behaviours, provision of advice and information on reducing/ceasing drug use and harm minimisation, motivational intervention, provision of resources and referral. Western Australia Data are provided by both government and non–government sectors. Non–government services were contracted by the Drug and Alcohol Office (DAO), now named the Mental Health Commission, to provide alcohol and other drug services. They have contractual obligations to incorporate the data elements of the AODTS NMDS in their collections. They are also obliged to provide data in a regular and timely manner to DAO. These data items are collated and checked by DAO before annual submission to the AIHW. Western Australia does not differentiate between main and other treatment types. As such, Western Australia is not directly comparable with other jurisdictions because every treatment type provided is reported as a separate episode. In Western Australia, a reform in the way non–residential treatment services are provided in the Perth metropolitan area has resulted in the co–location and integration of some government and non–government services. Time series data do not adequately illustrate these changes. South Australia Data are provided by government Drug and Alcohol Services South Australia (DASSA) and non-government alcohol and other drug treatment services. Non-government alcohol and other drug treatment services in South Australia are subject to service agreements with the South Australian Minister for Mental Health and Substance Abuse. As part of these service agreements, non-government organisations are required to provide timely client data in accordance with the AODTS NMDS guidelines. Data are forwarded to DASSA for collation and checking. DASSA then forwards cleaned data to the AIHW annually. DASSA does not collect information directly from those services funded by the NGOTGP. These data are provided to DoH via AIHW. Tasmania Tasmania’s illicit drug diversion treatment data are managed and extracted from the Drug Offence Reporting System (DORS). This system resides with Tasmania Police. A high proportion of treatment episodes in Tasmania with the principal drug of concern of cannabis can be attributed largely to the inclusion of this data. Training in culturally sensitive practice has been provided for service providers across the Tasmanian alcohol and other drug service sector. Despite this, Tasmanian data reporting for Indigenous status still remains low. NGOs funded by the Tasmanian Government provide AODTS NMDS and key performance indicator data under the provisions of a service agreement. AODTS NMDS data are submitted to Alcohol and Drug Service State Office on either a 6-monthly or yearly basis. Data quality reports are fed back to the NGOs and training/information on data capture practices are provided as required. Australian Capital Territory Australian Capital Territory alcohol and other drug treatment service providers supply ACT Health with their complete data collection for the AODTS NMDS by 31 August each financial year. The services use a standardised reporting system to enhance uniformity and reliability of data. Northern Territory Alcohol and other drug treatment services in the Northern Territory are provided by government and non-government agencies. The bulk of services provided through non‑government agencies are funded via service-level agreements with the Northern Territory Department of Health. All funded agencies are required to provide AODTS NMDS data items to the department on a regular and timely basis as part of a larger data collection. Summary statistical reports are sent to all agencies every 6 months detailing client activity for the previous 12 months. Australian Government Department of Health (DoH) DoH funds a number of alcohol and other drug treatment services under the National Illicit Drug Strategy Non-Government Organisation Treatment Grants Program (NGOTGP). These agencies are required to collect data (according to the AODTS NMDS specifications) to facilitate the monitoring of their activities and to provide quantitative information to the Australian Government on their activities. Data from these agencies are generally submitted to the relevant state/territory health authority, except for a number of agencies in New South Wales, Queensland, Western Australia and South Australia, which submit data annually to the Department of Health. Reported numbers for each state and territory in the AODTS NMDS annual report include services provided under the National Illicit Drug Strategy, NGOTGP. To ensure consistency with previous years’ data, where an organisation’s sub-agencies had been given more than 1 establishment identifier, those identifiers were used and so sub-agencies were counted as separate agencies. Where an organisation’s sub-agencies had been given 1 establishment identifier, only the single establishment identifier was used, and these sub-agencies were counted as 1 agency. From 2012–13 onwards, the AIHW collected the data on behalf of a number of state and territory NGOTGP agencies, that were funded directly by the Commonwealth, for collation and reporting to the AODTS NMDS. The 2012–13 collection period was the first year NGOTGP data were processed by the AIHW. In 2015, the agreed Schedule between the AIHW and the DoH required the AIHW to collect NGOTGP data on behalf of the DoH. The agreement stated that the AIHW would validate, aggregate and report on standardised data annually from Australian, state and territory NGOTGP, and finalise data from the NGOTGPs for inclusion in the national AODTS NMDS. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Coherence: | The AODTS NMDS was initially developed from 1996–2001 and the first report containing data from the data set was published in 2002. The data specifications were significantly altered for the 2003–04 collection and data from 2000–01 to 2002–03 are not comparable with data from later years. In 2011, the Australian Bureau of Statistics (ABS) phased out the Australian Standard Geographical Classification (ASGC) to be replaced by a new classification scheme: the Australian Statistical Geography Standard (ASGS). Also updated at this time were remoteness areas based on the 2011 ABS Census of Population and Housing. From the 2012–13 AODTS NMDS collection onwards: the new Statistical area level 2 (SA2) replaced the ASGC for Geographical location of service delivery outlet. The geographical scheme (ASGS 2011) is collected using the element Statistical area level 2 (SA2). Data for previous years reported by remoteness are reported for RA 2006. Data for 2012–13 onwards are reported for RA 2011 using SA2. The AIHW considers the change from RA 2006 to RA 2011 to be a series break when applied to data supplied for this indicator; therefore remoteness data for 2011–12 and previous years are not comparable to remoteness data for 2012–13 and subsequent years. In 2011, the ABS updated the Australian Standard Classification of Drug of concern, which was first released in 2000. The updated version incorporates newer psychoactive substances; most notably there is a new category for ‘cannabinoid agonists’. Country of birth was updated for the 2012–13 collection period to use the Standard Australian Classification of Countries (SACC), 2011. Preferred language was updated for the 2012–13 collection period to use Australian Standard Classification of Languages (ASCL), 2011. The number of closed treatment episodes decreased from 180,783 in 2013–14 to 170,367 in 2014–15. Victoria reported an overall decrease of approximately 10,537 treatment episodes and New South Wales reported a decrease of 6,119 treatment episodes between 2013–14 and 2014–15. The rate of invalid SLKs decreased from 12% in 2012–13 to 4% in 2013–14; in 2014–15 no imputation was required. As less imputation is required to account for the missing SLKs, this may affect comparability. Victoria does not differentiate between main and other treatment types. Caution should be used in comparing Victorian episodes with those of other states and territories. Data for Victoria are not directly comparable with data for other jurisdictions because every treatment type provided is reported as a separate episode. Services in Western Australia are not directly comparable with other states, or previous years, because of the growth of integrated services that include government and non-government service providers. Due to this growth in integrated services caution should be used in comparing services in Western Australia with those in other states and territories and/or across years. Western Australia does not differentiate between main and other treatment types. Data for Western Australia are therefore not directly comparable with data for other jurisdictions because every treatment type provided is reported as a separate episode. In Western Australia, a reform in the way non-residential treatment services are provided in the Perth metropolitan area has resulted in the co-location and integration of some government and non-government services. Time series data do not adequately illustrate these changes. Tasmania’s illicit drug diversion treatment data are managed and extracted from the Drug Offence Reporting System (DORS). This system resides with Tasmania Police. A high proportion of treatment episodes in Tasmania with the principal drug of cannabis can be attributed largely to the inclusion of this data.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Data products | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Implementation start date: | 01/07/2014 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Relational attributes | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Related metadata references: | Supersedes Alcohol and other drug treatment services NMDS, 2013–14; Quality Statement AIHW Data Quality Statements, Standard 25/05/2015 Has been superseded by Alcohol and other drug treatment services NMDS, 2015–16; Quality Statement AIHW Data Quality Statements, Superseded 20/04/2018 |