UCLA Evaluation Information
The University of California, Los Angeles, Integrated Substance Abuse Programs (UCLA ISAP) is conducting the evaluation to measure and monitor outcomes of the DMC-ODS demonstration project. The evaluation will focus on four areas: (1) access to care, (2) quality of care, (3) cost, and (4) the integration and coordination of SUD care, both within the SUD system and with medical and mental health services. UCLA will utilize data gathered from a number of existing state data sources as well as new data collected specifically for the evaluation.
The goal of the ODS waiver evaluation is to be as comprehensive and useful as possible within practical constraints by following several principles:
- Analyze existing state administrative datasets where possible.
- Align measures with existing or expected future data requirements.
- Where necessary, collect new data while minimizing the burden on stakeholders.
- Provide results to stakeholders quickly to inform ongoing implementation efforts.
Quantitative methods will be used to analyze trends and the degree of changes over time, while qualitative methods will be used to help interpret quantitative data within the broader context of stakeholder perceptions.
Evaluation Resources
- California's Drug Medi-Cal Organized Delivery System - 2018 Evaluation Report
- Evaluation Plan
- County Administrator Survey (survey, results)
- Managed Care Plan Survey (survey, results)
- Treatment Provider Survey
- Client Treatment Perceptions Survey (TPS)
- Creating an Organized Adult System of Care for Substance Use Disorder (SUD) Services: The Experience in Santa Clara County
- DMC ODS Evaluation Report (FY 2016-2017)
- DMC ODS Evaluation Report (FY 2015-2016)
Presentations
- DMC Waiver Evaluation Planning (January 5, 2015) (slides)
- County Administrator Survey Preliminary Results (CBHDA SAPT+ Committee Meeting; September 24, 2015) (slides)
- Managed Care Health Plan Survey Results (CBHDA SAPT+ Committee Meeting; March 23, 2016) (slides)
- Drug Medi-Cal Organized Delivery System Evaluation: Baseline (DHCS SUD Statewide Conference; August 24, 2016) (slides)
Evaluation Domains
Access
Hypothesis: Access to treatment will increase in counties that opt in to the waiver compared to access in the same counties prior to waiver implementation and access in comparison counties that have not opted in.
Quality
Hypothesis: Quality of care will improve in counties that have opted in to the waiver compared to quality in the same counties prior to waiver implementation, and quality in comparison counties that have not opted in.