Email updates

Keep up to date with the latest news and content from SATPP and BioMed Central.

Open Access Highly Accessed Research

Adoption of practice guidelines and assessment tools in substance abuse treatment

Traci Rieckmann1*, Bret E Fuller2, Goal Auzeen Saedi3 and Dennis McCarty1

Author Affiliations

1 Department of Public Health and Preventive Medicine, Oregon Health & Science University, 3181 SW Sam Jackson Park Rd, Mailcode CB669, Portland, OR 97239 USA

2 Portland VA Medical Center, 3710 SW U.S. Veterans Hospital Road, Mailcode P3MHDC, Portland, OR 97239 USA

3 Department of Psychology, University of Notre Dame, 118 Haggar Hall, Notre Dame, IN 46556 USA

For all author emails, please log on.

Substance Abuse Treatment, Prevention, and Policy 2010, 5:4  doi:10.1186/1747-597X-5-4


The electronic version of this article is the complete one and can be found online at: http://www.substanceabusepolicy.com/content/5/1/4


Received:11 September 2009
Accepted:26 March 2010
Published:26 March 2010

© 2010 Rieckmann et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

The gap between research and practice limits utilization of relevant, progressive and empirically validated strategies in substance abuse treatment.

Methods

Participants included substance abuse treatment programs from the Northeastern United States. Structural equation models were constructed with agency level data to explore two outcome variables: adoption of practice guidelines and assessment tools at two points in time; models also included organizational, staffing and service variables.

Results

In 1997, managed care involvement and provision of primary care services had the strongest association with increased use of assessment tools, which, along with provision of counseling services, were associated with a greater use of practice guidelines. In 2001, managed care involvement, counseling services and being a stand-alone drug treatment agency were associated with a greater use of assessment tools, which was in turn related to an increase in the use of practice guidelines.

Conclusions

This study provides managers, clinicians and policy-makers with a framework for understanding factors related to the adoption of new technologies in substance abuse treatment.

Background

A "widespread unease with the slow pace of adoption of research findings" has developed in the United States field of alcohol and drug treatment [1]. Simultaneously, the complexity of treatment needs, and pressure for high quality services for fewer treatment dollars, has increased the need for educated and highly skilled clinicians. However, the "hodgepodge" of funding streams and lack of formal training in the treatment of alcohol and drug disorders at the graduate level prevent some counselors and agencies from adopting innovations [2]. One such area in which this gap exists is the adoption of practice guidelines that incorporate the use of standardized assessment tools and empirically supported treatments for substance abuse treatment.

Science-based Practice Tools and Guidelines

Variations in practice styles, inappropriate and unnecessary use of services, uncertain health outcomes and risk management have all been linked to the increased need for outcome and effectiveness research and application of science-based practice strategies and guidelines [3]. In contrast, others assert that practice guidelines and manualized treatment tools may "constrain clinical decision-making" [4], and often are based on questionable methods and limited findings. According to Weisz and colleages, the proliferation of collectively produced guidelines represents an effort to increase order and coherence through convention, standards, and regulation of the rapidly expanding and heterogenous medical domain [5]. Thus, rising health care costs and standardization of performance and outcome measurement have increased the development of assessment tools, manualized treatments, and evidence-based strategies available for substance abuse treatment. Practice guidelines that incorporate empirically supported treatments are described as systematically developed statements which assist decision-making and are suggestive, rather than prescriptive, in terms of identifying and providing efficacious treatment recommendations [3,4,6,7].

Currently, there are several practice guidelines for substance abuse treatment. The American Psychiatric Association suggests six components of psychiatric management: (1) the establishment and maintenance of a therapeutic relationship, (2) continued monitoring of the patient's clinical status, (3) management of states of intoxication and withdrawal, (4) reduction of morbidity, (5) facilitation of treatment plan adherence and provision of educational materials, and finally (6) diagnosis and treatment of psychiatric disorders [8]. Another important practice guideline or decision-making algorithm is the American Society of Addiction Medicine (ASAM) level of care criteria. ASAM published this first set of placement criteria in 1991 [9], and they have revised and improved upon the model with the second edition, the Patient Placement Criteria (PPC-2R), published in April 2001 [10]. As one of the most widely used guidelines for the placement and continued stay and subsequent discharge of substance abuse patients, the ASAM criteria is a common acronym across settings in substance abuse service delivery. In regular use within a number of treatment settings, the ASAM PPC-2R provides criteria for five levels of care for adults and adolescents: Level 0.5, Early Intervention; Level I, Outpatient Treatment; Level II, Intensive Outpatient/Partial Hospitalization; Level III, Residential/Inpatient Treatment; and Level IV, Medically-Managed Intensive Inpatient Treatment. Data collected from all 51 single state authorities (SSAs) for substance abuse treatment suggest that ASAM is in widespread use (T.R., unpublished data). SSA representatives from each of the 50 states and Washington DC were interviewed in 2009. SSA representatives used a Likert-type scale ("1 = not at all" to "5 = extensively") to rate the extent to which their state had implemented ASAM. Nearly all SSAs (86.2%) have implemented ASAM at least "slightly", with mean nationwide implementation of 4.4 (out of 5) in 2009.

Another comprehensive effort in establishing practice guidelines for substance abuse treatment has been made by the United States Substance Abuse and Mental Health Services Administration's Center for Substance Abuse Treatment's (CSAT) Treatment Improvement Protocol (TIP) series. Guidelines for treatment are based on an extensive review of the literature and are available in easy to access manuals for specific populations, diagnostic cohorts or co-occurring disorders. Finally, the American Psychological Association took an even broader view related to practice guidelines and developed criteria for the development and evaluations of such guidelines to support clinicians and organizations as they make decisions about implementation of practice guidelines [11]. Thus, there are several key decision-making guidelines and resources across the service delivery system.

Research supports the real-world efficacy of following research-derived practice guidelines in substance abuse treatment. Two examples are opiate substitution treatment for heroin dependence [12] and buprenorphine for acute heroin detoxification [13]. Providing managers, clinicians and policy-makers with a framework for understanding organizational, staffing and service delivery factors related to the adoption of new technologies is critical in an era of increased accountability. To better conceptualize these constructs several models exploring diffusion have been developed and preliminary studies are emerging in the substance abuse treatment literature.

Models of Adoption and Diffusion

Simpson's conceptual framework suggests that institutional/personal readiness and organizational dynamics predict exposure, adoption, implementation, and routine use of innovative practices including practice guidelines [14]. The model delineates interrelationships among readiness for change, training, staff attributes, and institutional resources and support. Successful technology transfer efforts make use of interpersonal contacts (consultants, researchers on location, multi-site workshops) [1]. Thomas and colleagues [15] offer a framework based on classical diffusion theory [16] and posit that environmental factors and clinicians affect the adoption of new technologies or strategies. This model includes interactions between clinician characteristics (age, training, experience), organizational or practice characteristics (philosophy, mission, financing, structure), qualities of the new technology, the patient population, and the treatment environment (state policies, market environment, disease prevalence). These models posit that organizational characteristics and staffing patterns may influence the adoption of new innovations.

Practitioners with more formal education, and with higher social status, tend to have a more favorable outlook regarding change [17]. Adopters also are more likely to seek out information and have national professional contacts [17]. Organizational structure also can affect adoption of new practice and guidelines. Structural characteristics may include the organization's location, size, accreditation, and overall mission [18]. The mix of funding streams, and the related requirements for each entity that programs derive reimbursement or revenue from, is also a major structural or organizational factor influencing use of specific practices. Agencies that have managed care contracts are likely to be encouraged to standardize their practices and use of tools as the managed care companies seek to match requirements and reports across their networks. Organizational dynamics, climate, and the readiness to change are also integral components of the adoption of new technologies or practices [14]. Finally, Fixsen and colleagues developed a cycle of core components ("implementation drivers") including staff selection, training, consultation, and coaching (e.g., providing supervision, feedback, and emotional support) to frame the dynamic process of successful implementation [19].

Staff factors also may determine whether a new assessment tool or practice guideline is adopted into clinical practice. An examination of staff attitudes from the United States National Institute on Drug Abuse (NIDA) Clinical Trials Network indicated that personal beliefs regarding treatment affected clinical practice and the adoption of new interventions [20]. A survey of physicians' attitudes toward clinical guidelines or algorithms reported that physicians believed that guidelines were utilized more for cost containment purposes and less for quality improvement [21]. A more recent survey reported that substance abuse treatment professionals tend to have positive attitudes toward manualized treatment (e.g., beliefs that following a manual helps therapists evaluate and improve clinical skills, and enhances therapeutic outcomes) [22]. Further, increases in knowledge of the effectiveness of a medication and organizational support influence the use of a medication to treat substance dependence [15,23]. There is, however, a paucity of work about the specific organizational qualities that affect implementation of standardized assessments and practice guidelines.

Examination of utilization of practice guidelines and standardized tools may provide insight regarding agency and counselor factors associated with successful adoption for treatment planning and adaptations in service delivery. This study examines the organizational, staffing, and service characteristics that predict utilization of science-based practice tools and practice guidelines in outpatient substance abuse treatment programs.

Methods

The New England Outpatient Survey [24] assessed the routine use of ASAM criteria for patient placement, use of treatment manuals (CSAT TIP documents; NIDA Therapy Manuals for Drug Addiction) and use of assessment tools such as the Addiction Severity Index [25] and the Beck Depression Inventory [26]. Organizational characteristics were assessed including agency size, funding sources, educational level, number of staff in recovery, and agency mission. Surveys completed in 1997, 1999, and 2001 assessed staff and agency characteristics, current practices, and innovations used in treatment. The 1997 and 2001 cohorts were examined in this paper.

Participants

All licensed outpatient substance abuse treatment programs in the six New England states (CT, NH, ME, MA, RI, & VT) were included in the study sample. After accounting for programs that merged, moved or changed names, and programs operating multiple facilities, the list of potential outpatient centers included 341 organizations in 1997 [27]. Introductory letters were mailed, followed by a survey packet mailed one month later. Follow-up calls were placed to all treatment programs to confirm receipt of the packet, answer questions, draw attention to the study, and emphasize the importance of a timely response. The call concluded with scheduling an appointment with a research assistant for a telephone interview. Lost surveys were replaced and missed appointments were rescheduled as needed to ensure a representative sample. The full sample of respondents in 1997 (n = 281 agencies, 83% completion rate) consisted of directors or their representatives at freestanding substance abuse facilities (34%; n = 98), community mental health services (31%; n = 88), hospitals and integrated health care systems (18%; n = 51), and social service agencies and other types of programs (15%; n = 44).

The 2001 survey used similar sample selection including only outpatient programs that were licensed. Some agencies may have closed or merged, although study methods simply noted agencies that were no longer in the database without determination of the specific changes in status of facilities. The full sample of respondents in 2001 (n = 246 agencies, 72% completion rate) consisted of directors or their representatives at freestanding substance abuse facilities (26%; n = 64), community mental health services (20%; n = 50), hospitals and integrated health care systems (21%; n = 51), and social service agencies and other types of programs (33%; n = 81).

Variables

Organizational characteristics and staffing were hypothesized to influence adoption of new technologies. All variables included in the structural models are transformations of items from the New England Outpatient Survey from 1997 and 2001 and are listed in Table 1. Models included three organizational variables (size of agency, managed care involvement, and being a freestanding alcohol and drug treatment program) and two staffing variables (staff recovery status and education level). Two service variables were included (counseling and ancillary services, and medical and medication services). The two outcome variables were use of practice guidelines and use of assessment and screening tools. The practice guidelines variable was a sum of the levels of care tools (e.g., use of ASAM Criteria, use of state modified placement criteria), treatment manuals, and protocols that are used in the organization. The screening or assessment tools measure was the sum of the standardized assessments used, including the Addiction Severity Index and the Beck Depression Inventory.

Table 1. Variable descriptions

Data Analysis

Structural equation modeling (SEM) with manifest (i.e., observed) variables was the primary analytic method. Standard regression models do not allow more than one criterion variable in the same model, and do not allow examination of mediating relationships between predictors. Structural equation modeling allows for complex interrelationships to be modeled simultaneously.

A maximum likelihood estimation method was used to estimate parameters using the CALIS module in the SAS Program [28-30]. Models were estimated for the 1997 and 2001 cohorts, respectively, with similar patterns expected for each time, but also allowing for differences over time. To identify the most parsimonious model, paths with non-significant regression weights or paths that did not contribute to a good model fit were dropped. Because SEM cannot handle missing data, only cases with complete data were available for analysis. A listwise deletion technique of cases with missing data resulted in 188 cases available for the 1997 model and 144 cases for the 2001 model. The variables in SEM included only manifest constructs. For example, "medical and medication services" is a construct of number of medical services and number of medication services (see Table 1). Because some manifest variables were constructed as sums of two or more indicators, and because some item wording changed between the two administrations, a standardization technique (z transformation) eliminated differences in the item metrics. Z tests of two proportions examined differences in binary variables and differences between means were assessed with ANOVAs. Some of these means were counts of variables. The F test is relatively robust and does not generate bias in response to violation of parametric assumptions provided that sample sizes are not overly discrepant.

Results

Table 2 presents variable means and percentages from the full sample of respondents (1997 N = 281; 2001 N = 246). Actual sample sizes for each variable are presented in parentheses in each cell of Table 2. Significant increases were observed between 1997 and 2001 in the use of any practice guidelines, and in the mean number of medication and medical services offered (see Table 2). The ASAM Patient Placement Criteria was the most widely used level of care tool among participating outpatient treatment programs, with nearly half of the programs reporting the use of ASAM at both time points. Freestanding substance abuse treatment clinics were more likely to use ASAM (1997 = 63%; 2001 = 55%), followed by community mental health agencies (1997 = 55%; 2001 = 55%) and hospitals (1997 = 41%; 2001 = 52%). Use of ASAM placement criteria did not differ based on clinic size, licensure, or level of education.

Table 2. Comparisons of differences between the two time points of measurement

The most common standardized assessment tool in the participating outpatient treatment programs was the Addiction Severity Index (1997 = 33%; 2001 = 29%). The most common mental health assessment was the Global Assessment of Functioning (1997 = 79%; 2001 = 84%), followed by the Structured Clinical Interview for Diagnosis (SCID), (1997 = 32%; 2001 = 40%). Many programs used assessments created specifically by their staff to assess addiction and mental health (1997 = 100%; 2001 = 86%).

The structural equation model for the 1997 cohort is presented in Figure 1 and is based on 188 complete observations. This model demonstrated good fit indices (X2 = 33.23, df = 23, p = .0771; CFI = .9341, RMSEA = .0558). No residuals were greater than 2.22. Although not temporal, the models represent relationships among variables. In this first model, programs that have greater involvement with managed care and programs that offer more medical and medication services are more likely to use assessment and screening tools. Extending these relationships, the model also captures the relationships between the increased use of screening and assessment tools, and provision of counseling and ancillary services, and the greater use of practice guidelines.

thumbnailFigure 1. Time 1 Path Model of Predictors of Practice Guidelines and Practice Tools.

Programs with more managed care involvement were less likely to identify themselves as a freestanding addiction treatment programs (as compared to multi-service, hospital, or medical based clinics). Programs with more involvement from managed care were also more likely to have staff with advanced degrees, as opposed to freestanding programs that employed more staff in recovery. Larger agencies were more likely to provide a range of treatment options including offering medications, medical services and additional ancillary or support services.

A similar model with organizational, staff, and service delivery variables was constructed for the 2001 cohort and is based on 144 complete observations (see Figure 2). Eliminating non-significant paths and high residuals reduced this model to a parsimonious description of the interrelationships of these variables. The data fit the model well (X2 = 28.17, df = 20, p = .1055; CFI = .9596, RMSEA = .0439) and no residuals were greater than 2.50. Managed care involvement also was influential in this second model. Freestanding clinics or treatment programs were less likely to be supported by managed care funding. Managed care also was associated with higher counselor education levels and use of assessment and screening tools. Similar to the 1997 model, agencies that were larger in size again offered more medical services, medications and a greater range of counselling and ancillary services.

thumbnailFigure 2. Time 2 Path Model of Predictors of Practice Guidelines and Practice Tools.

Discussion

The results of this study suggest that the two outcomes, use of standardized assessment tools and use of practice guidelines, are interdependent. In the first model (Time 1), managed care involvement, and provision of medical care services and use of medications had the strongest association with increased use of standardized assessment tools. Use of assessment tools and offering counseling and ancillary services was then associated with greater use of practice guidelines. In the second model (Time 2), again managed care involvement was associated with increased use of assessment tools, as was being a stand-alone drug treatment agency. The relationship between provision of counseling and ancillary services had a stronger association with assessment tools in this model, but the relationship between the use of assessment tools and a greater use of practice guidelines remained strong in the second model. Thus, programs that offer a larger range of services (i.e., medical, ancillary or wrap around, medication and counseling) and have strong relationships with or receive funding from managed care entities, appear to be more likely to adopt standardized assessments and practice guidelines or algorithms.

In terms of clinical staff and their impact on adoption, programs that were free-standing or non-hospital based were also more likely to have a greater number of staff in recovery and providers with fewer years of education. Managed care involvement was also associated with having more staff with higher education.

It is also interesting to note that the majority of agencies created their own assessments/intakes, or possibly used a mix of standardized assessments, suggesting a legacy of program tools that may not be updated frequently. This range of eclectic assessment practices may also reflect dissatisfaction with, or a lack of knowledge about validated assessment tools. Thus the models from this study provide data for state, county and community policy makers to consider when allocating resources, planning trainings, and implementing targeted systemic interventions.

Adoption of Evidence-Based Practices

Overall, research thus far suggests limited use of practice guidelines in community-based substance abuse treatment. To better understand why this implementation or such clinical decision guides is slow, organizational, environmental and staff factors must be examined. To date, services research suggests that the decision to adopt new practices is often influenced by the demands of the funding entities and institutional structures [14,15]. Further, providers that are most likely to adopt new practices tend to have more formal education, come from a higher social status, and have a more favorable outlook regarding change [17]. These early adopters are also more likely to take the initiative to seek out information and have a greater number of national professional contacts [17]. Clinicians indicate that they are more open to new strategies when those practices clearly improve services and outcomes, are consistent with their philosophy of treatment, and are supported with training that includes observation, practice, supervision, and feedback prior to full adoption [31-33]. Organizational structures and practices (e.g., funding mechanisms, agency mission, and data management systems) also impact the use of innovations within substance abuse treatment programs. Thus, both individual treatment providers and agency level or organizational characteristics influence the implementation of new practices including practice guidelines and the use of assessment and screening tools [15,18,19]. The results of this study correspond with this implementation science and classical diffusion theory literature. Funding mechanisms (involvement with managed care), treatment philosophy (counseling and use of ancillary services), and staff characteristics were associated with greater implementation of practice guidelines and assessment tools. The ASAM patient placement guidelines and the ASI assessment tool were widely used and were considered best practices by the participating outpatient treatment programs.

Interestingly, although having greater involvement with managed care was associated with specific staff characteristics as well as with use of assessment tools and practice guidelines, in this project the level of counselor education in the programs and the number of staff in recovery was not directly associated with greater use of practice guidelines. Although other research has found that education is associated with more positive opinions about evidence-based practices [32] and greater acceptance of innovation [17], previous investigations were based on attitudes surveys with treatment center staff. The current data came from a survey of treatment center directors and not a direct assessment of counselors or staff. Methodological differences may explain the difference in findings. It may also be that use of assessment tools and practices guidelines present a greater level of controversy and challenge for providers. According to Miller, Zweben and Johnson [34], retraining providers with established habits and experiences is both challenging and time consuming. The use of standardized assessment tools and practice guidelines requires considerable training and supervision. Autonomy also has been associated with increased satisfaction and commitment to the organization [35], thus providers may value independence in decision-making and they may also not have access to the necessary training and supervision related to assessment and the use of guidelines. Finally, staff may have felt constrained by guidelines and may not have perceived any clinical or organizational benefit with their implementation in their treatment programs. Thus, the findings from this study may differ somewhat from previous studies that suggest counselor characteristics predict adoption of new practices due to methods (i.e., response of agency directors), the amount of training and supervision required to use standardized tools and guidelines, as well the constraint or lack of autonomy that counselors may resist when using use tools/guidelines.

Findings from the current study also suggest an important relationship between agency size, counseling and ancillary services, and use of practice guidelines and standardized assessment tools. Larger agencies offered more counseling and ancillary services which contributed to the use of practice guidelines and assessment/screening tools. Integration of primary care and mental health with substance abuse treatment offers increased access to a range of providers, medications, and independence from government funding which provides leverage for change and flexible, progressive decision-making for the organization [36,37]. Large agencies that offer a wider range of services have the resources to purchase assessment instruments, provide training, conduct organizational change processes, and flex their resources in a fashion that is necessary for the implementation of standardized practice guidelines. Consistent with the literature, participation in ancillary service delivery appears to connect programs with other community providers, exposing managers and counselors to diagnostic tools and procedures outside their immediate organization [38]. Applying this literature base to specific clinical practices, including use of standardized assessment tools and practice guidelines, provides greater understanding of these factors and their dynamic and interdependent impact on diffusion of innovations

Limitations

This study had a number of limitations. The sample included six New England states, which may have limited generalizability to the rest of the United States. New England is a region with high managed care penetration and a high degree of public sector treatment agencies which may not be characteristic of the rest of the country. In addition, slight wording changes in the surveys between the two data collection points created some restrictions regarding the type of longitudinal analysis that could be used (i.e., models are not dependent time 1 to time 2). Had the models been able to be dependent, statistical tests would likely have been more sensitive. However, because not all clinics were represented in each sample, this was not possible and is a limitation of the study. Missing data imputation is not used with structural equation modeling, thus a listwise deletion technique results in parsimonious models based on cases with complete data available for analysis. Finally, although data were collected in 2001, dissemination of these findings is important because they are consistent with the literature confirming the difficulties changing practice patterns and disseminating research findings. The study results may also be used for comparison with future assessment that evaluates the use of practice guidelines.

Conclusions

This study provides managers, clinicians and policy-makers with a framework for understanding factors related to the adoption of new technologies in substance abuse treatment. Findings from this study suggest that increasing the use of evidence-based practices or tools may require provider and organizational change efforts as well as systems wide interventions that result in revised policies, changes in contract language and specific detailed descriptions of procedures and expectations. State substance abuse authorities (SSAs), regulatory and funding entities clearly play a significant role in clinical practice and the quality of addiction treatment services. Expanding the framework from provider and organizational factors to include state/county and city policy makers, current change efforts such as the Robert Wood Johnson Advancing Recovery Initiative are emerging. This intervention partners the state authority with providers and other stakeholders to address systems wide change aimed at increasing the use of evidence-based practices. Through this type of collaboration, and with appropriate state administrative data, research literature, and leadership, policy makers will be able to make informed decisions that impact the quality of addiction services.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

TR participated in conceptualization of this paper, the statistical analysis interpretation, and helped to draft the manuscript. BEF participated in the statistical analysis and interpretation. GAS helped to draft the manuscript. DM conceived of the study and participated in its design and implementation. All authors read and approved the final manuscript.

Acknowledgements

Research made possible by a grant from NIAAA (R01-AA11363). The authors thank Anne Kovas, MPH for her contributions.

References

  1. Brown B, Flynn P: The federal role in drug abuse technology transfer: A history and perspective.

    J Subst Abuse Treat 2002, 22:245-257. PubMed Abstract | Publisher Full Text OpenURL

  2. McCarty D, Goldman HH: Treatment for alcohol and drug dependence: History, workforce, organization, financing, and emerging policies. In Substance Abuse: A Comprehensive Textbook. 4th edition. Edited by Lowinson JH, Ruiz P, Millman RR, Langrod JG. Philadelphia, Lippincott, Williams & Wilkins; 2003:1346-1360. OpenURL

  3. Field M, Lohr K: Guidelines for Clinical Practice: From Development to Use. Washington, DC, National Academy Press; 1992. OpenURL

  4. Nathan P: Practice guidelines not yet ideal.

    American Psychologist 1998, 53:290-299. Publisher Full Text OpenURL

  5. Weisz G, Cambrosio A, Keating P, Knaapen L, Schlich T, Tournay VJ: The emergence of clinical practice guidelines.

    Milbank Q 2007, 85:691-727. PubMed Abstract OpenURL

  6. Fiellin DA, Barthwell AG: Guideline development for office-based pharmacotherapies for opioid dependence.

    J Addict Dis 2003, 22:109-120. PubMed Abstract | Publisher Full Text OpenURL

  7. Walker RD, Howard MO, Walker PS, Lambert MD, Suchinsky RT: Practice guidelines in the addictions.

    West J Med 1994, 161:39-44. PubMed Abstract | PubMed Central Full Text OpenURL

  8. American Psychiatric Association Steering Committee on Practice Guidelines: Practice guideline for the treatment of patients with substance use disorders. [http://www.psychiatryonline.com/pracGuide/pracGuideChapToc_5.aspx] webcite

    2nd edition. 2006.

  9. Hoffmann N, Halikas J, Mee Lee D, Weedman RD: Patient Placement Criteria for the Treatment of Psychoactive Substance Use Disorders. Washington, DC, American Society of Addiction Medicine; 1991. OpenURL

  10. American Society of Addiction Medicine: ASAM PPC-2R: ASAM Patient Placement Criteria for the Treatment of Substance Abuse-Related Disorders. Chevy Chase, MD, American Society of Addiction Medicine; 2001. OpenURL

  11. American Psychological Association: Criteria for practice guideline development and evaluation.

    Am Psychol 2002, 5:1048-1051. OpenURL

  12. Humphreys K, Trafton JA, Oliva EM: Does following research-derived practice guidelines improve opiate-dependent patients' outcomes under everyday practice conditions? Results of the Multisite Opiate Substitution Treatment Study.

    J Subst Abuse Treat 2008, 34:173-179. PubMed Abstract | Publisher Full Text OpenURL

  13. Kovas AE, McFarland BH, McCarty DJ, Boverman JF, Thayer JA: Buprenorphine for acute heroin detoxification: diffusion of research into practice.

    J Subst Abuse Treat 2007, 32:199-206. PubMed Abstract | Publisher Full Text OpenURL

  14. Simpson DD: A conceptual framework for transferring research to practice.

    J Subst Abuse Treat 2002, 22:171-182. PubMed Abstract | Publisher Full Text OpenURL

  15. Thomas CP, Wallack SS, Lee S, McCarty D, Swift R: Research to practice: adoption of naltrexone in alcoholism treatment.

    J Subst Abuse Treat 2003, 24:1-11. PubMed Abstract | Publisher Full Text OpenURL

  16. Rogers EM: Diffusion of Innovations. 4th edition. New York, The Free Press; 2003. OpenURL

  17. Rogers EM: Diffusion of Innovations. 4th edition. New York, The Free Press; 1995. OpenURL

  18. Gotham H: Diffusion of mental health and substance abuse treatments: Development, dissemination, and implementation.

    Clin Psychol 2004, 11:160-176. OpenURL

  19. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. Tampa, FL, University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network; 2005. OpenURL

  20. Forman RF, Bovasso G, Woody G: Staff beliefs about addiction treatment.

    J Subst Abuse Treat 2001, 21:1-9. PubMed Abstract | Publisher Full Text OpenURL

  21. Inouye J, Kristopatis R, Stone E, Pelter M, Sandhu M, Weingarten S: Physicians' changing attitudes toward guidelines.

    J Gen Intern Med 1998, 13:324-326. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  22. Huag HA, Shopshire M, Tajima B, Gruber V, Guydish J: Adoption of evidence-based practices among substance abuse treatment providers.

    J Drug Educ 2008, 38:181-192. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  23. Knudsen HK, Ducharme LJ, Roman PM: Research network involvement and addiction treatment center staff: Counselor attitudes toward buprenorphine.

    Am J Addict 2007, 16:365-371. PubMed Abstract | Publisher Full Text OpenURL

  24. McCarty D, Levine H, Steenrod S, Prost C, Meredith T: New England Outpatient Study: Preliminary Findings. Waltham, MA: Brandeis University; 1998. OpenURL

  25. McLellan AT, Cacciola J, Kushner H, Peters R, Smith I, Pettinati H: The fifth edition of the Addiction Severity Index: Historical critique and normative data.

    J Subst Abuse Treat 1992, 9:199-213. PubMed Abstract | Publisher Full Text OpenURL

  26. Beck A, Steer R, Brown G: Manual for the Beck Depression Inventory. 2nd edition. San Antonio, TX, The Psychological Corporation; 1996. OpenURL

  27. Steenrod S: The relationship between managed care and standardized clinical practices in outpatient substance abuse treatment programs in New England.

    Dissertation Abstracts International: Section B: The Sciences & Engineering 1999, 60(6-B):2594. OpenURL

  28. Bollen K: Structural Equations with Latent Variables. New York: Wiley; 1989. OpenURL

  29. Hatcher L: A Step-By-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling. Cary, NC, SAS Institute; 1994. OpenURL

  30. SAS: SAS Version 8. Cary, NC: SAS Institute Inc; 1999. OpenURL

  31. Marinelli-Casey P, Domier CP, Rawson RA: The gap between research and practice in substance abuse treatment.

    Psychatr Serv 2002, 53:984-987. Publisher Full Text OpenURL

  32. McCarty D, Fuller BE, Arfken C, Miller M, Nunes EV, Edmundson E, Copersino M, Floyd A, Forman R, Laws R, Magruder KM, Oyama M, Prather K, Sindelar J, Wendt WW: Direct care workers in the National Drug Abuse Treatment Clinical Trials Network: Characteristics, opinions, and beliefs.

    Psychiatr Serv 2007, 58:181-190. PubMed Abstract | Publisher Full Text OpenURL

  33. Torrey WC, Drake RE, Dixon L, Burns BJ, Flynn L, Rush AJ, Clark RE, Klatzker D: Implementing evidence-based practices for persons with serious mental illness.

    Psychiatr Serv 2001, 52:45-50. PubMed Abstract | Publisher Full Text OpenURL

  34. Miller WR, Zweben J, Johnson WR: Evidence-based treatment: Why, what, where, when, and how?

    J Subst Abuse Treat 2005, 29:267-276. PubMed Abstract | Publisher Full Text OpenURL

  35. Knudsen H, Johnson J, Roman P: Retaining counseling staff at substance abuse treatment centers: Effects of management practices.

    J Subst Abuse Treat 2003, 24:129-135. PubMed Abstract | Publisher Full Text OpenURL

  36. Capoccia V, Abeles J: A question of leadership: In what ways has the challenge of improving health and health care informed your understanding and practice of leadership?

    Leadership in Action 2006, 26:12-13. Publisher Full Text OpenURL

  37. Edmundson E, McCarty D: Implementing Evidence-Based Practices for Treatment of Alcohol and Drug Disorders. New York, Haworth Press; 2006. OpenURL

  38. Kimberly J, Evanisko M: Organizational innovation: The influence of individual, organizational, and contextual factors on hospital adoption of technological and administrative innovations.

    Acad Manage J 1981, 24:689-713. PubMed Abstract | Publisher Full Text OpenURL