Eric Bruns, PhD

The purpose of this project is to develop and test a Tier-3 team-based Wraparound (T3W) intervention package for schools. Researchers will carry out their study in three phases. In the first phase, they will iteratively adapt the existing Wraparound model for use in elementary schools. In the second phase, they will test the feasibility of the revised intervention in elementary settings. In the third phase, they will complete a pilot test to evaluate the promise of the intervention, and with gather cost information. The project will yield a complete T3W intervention package, including training and coaching curricula, guidelines for districts and schools, supervisor supports, fidelity measures, and data systems, as well as preliminary evidence of the promise of positive outcomes.

The Brief Intervention Strategy for School Clinicians (BRISC) is a 4-session, evidence-based, and flexible “Tier 2” intervention tailored to high school students and designed to fit the school context. This cluster randomized efficacy trial (52 public high schools in three states) will use longitudinal data collection with students and parents; analyses of school records; implementation measures; and clinician and administrator surveys and interviews to evaluate outcomes of BRISC compared to services as usual, as well as moderators and mediators of outcomes and feasibility, acceptability, and costs of BRISC. For more information, click here.

(Training & Technical Assistance) In addition to regular training activities and special areas of focus, the Northwest Mental Health Technology Transfer Center (Northwest) has received funding to support increased training and technical assistance for school mental health in Alaska, Idaho, Oregon, and Washington. To operationalize this support Northwest has partnered with the University of Washington School Mental Health Assessment, Research, and Training (SMART) Center, a national leader in developing and supporting implementation of evidence-based practices (EBPs) in schools, including prevention, early intervention, and intensive supports. The Northwest School Mental Health (SMH) and Multi-tiered System of Supports (MTSS) Training and Technical Assistance (TA) Center, within the UW SMART Center, supports school mental health efforts with the goal to support states, districts, schools and community partners to build an equitable single system of delivery in which education and mental health systems are integrated across the tiers.

Background and Goals:

The Wraparound service model (WSM) is the most common care coordination strategy for youth with serious emotional disorders(SEO), with programs in nearly every U.S. state serving more than 100,000 youth. A recent meta-analysis of 17 controlled studies found significant positive effects of WSM on mental health (MH) symptoms, out of home placement rates, and health care expenditures, confirming its critical role in behavioral healthcare for children and adolescents. As is the case for other evidence-based practices, the degree to which data are consistently measured and used to inform care, i.e., "measurement-based care" or MBC, accounts for a large proportion of the variance in outcomes for Wraparound. For example, collection and use of data assessing client satisfaction, therapeutic alliance, and progress substantially increase likelihood of achieving target outcomes as a function of treatment. However, research on WSM shows that measurement and use of data, such as via Routine Outcome Monitoring, is inconsistent at best. The goal of this SBIR is to develop and test a mobile ROM (mROM) system tailored to WSM. The proposed SMART-Wrap (Short Message Assisted Responsive Treatment for Wraparound) product will provide a feasible and acceptable mROM approach for WSM-enrolled parents/caregivers and youth based on evidence-based principles and past research for effective mROM. SMS ("short message system") is supported by every mobile device and network with no software download needed. More than 98% of SMS messages are opened, compared to just 20% of emails, and on average, 90% of SMS messages are opened within the first 3 seconds of receipt.l161 SMART-Wrap will periodically administer brief, straightforward (1-2 items) SMS-based assessments of intermediate outcomes that have been found to predict clinical outcomes of WSM (e.g., harm to self and others, hospitalization, out of home placement)). Data will be used to:

1. Populate tabular and graphical displays (based on user permissions) to inform decision-making by WSM care providers, supervisors, and program managers (i.e., the WSM care team);
2. Trigger alerts to WSM care team members, such as escalation in caregiver stress or youth symptoms; and
3. Generate automated SMS outreach messages for families.

This 18-month Phase I project will accomplish the following specific aims: 

Aim 1: Design SMS system. Leveraging our team's unparalleled access to WSM-implementing organizations, we will work with 50 WSM expert advisors, including experienced youth and caregivers, to determine an initial set of SMS assessment items and define the algorithm for generating data-driven alerts and outreach messages for each end user type (youth, parents/caregivers, WSM care team members). The Phase I proof of concept prototype will focus on four intermediate outcomes associated with positive clinical outcomes for WSM, specifically: therapeutic alliance, treatment satisfaction, youth symptoms, and parent stress/optimism. Aim 2: Test SMS system. We will evaluate item psychometrics and messaging system feasibility with 30 families with a youth with SEO currently enrolled in WSM. Parents/caregivers and youth will independently interact with the prototype messaging system over a two-week period and then participate in follow-up focus groups and complete a prototype evaluation survey. We expect target end users to report high feasibility, usability, and acceptability for the prototype messaging system. We also expect items to show acceptable psychometric properties for youth and caregivers. Findings will be used to inform iterative modifications to items and enhancements to the text messaging platform prior to Phase I pilot testing. Aim 3: Develop care team report features. Building on recommendations from our WSM expert advisors in Aim 1 as well as input from our expert consultants, we will create an online dashboard for WSM teams including tabular and graphical data displays, message and alert tracking logs, and reports to support team­ based decision-making. The online dashboard will be fully functioning to support the Phase I pilot test. Aim 4: Conduct pilot test. We will work with established WSM provider organizations (WPO) to recruit 10 WSM care teams (approx . 30 WSM providers, 10 program managers, and 10 supervisors across 10 WPOs). Teams will use the SMART-Wrap prototype with 1 family over a 2-month pilot period (n=30 families). Software usage metrics will be collected and participants will complete follow-up online surveys. We hypothesize high usability (e.g., expected completion times, few help requests) and positive views of the prototype's feasibility, acceptability, and added value across participant types (youth, caregivers, care team members). Positive results will set the stage for a Phase II SBIR to fully examine efficacy for service and clinical outcomes. Commercial Application. SMART-Wrap will offer a feasible, cost-efficient, and scalable software system to meet the documented public health need for mROM and MBC in care coordination for youth behavioral health. Our end product will provide a novel solution to over 1,000 WPOs and WSM initiatives, many of which already license other technologies from this team, with future expansion to programs that serve youth and adults via other coordinated care models. 3C's expertise in iterative software development and UW's extensive ongoing research and commercial channels into WSM will provide a solid foundation for these efforts.

(non-research) The SMART Center Postdoctoral Research Training Program in School Mental Health is funded by the U.S. Department of Education’s Institute for Education Sciences (IES).The fellowship’s areas of focus align with those of the SMART Center and include research-based school behavioral health strategies and policies, implementation science, educational equity, clinical research methodology, and understanding and reducing ethnic and racial disparities.

---

Want to participate? See information below.

[maxbutton id="2" url="mailto:usability@uw.edu" text="HAVE A QUESTION?" window="new" ]

 

---

Project Information

The aims of this project are to:

1. Evaluate the usability of leading, evidence-based Tier 1 social-emotional learning (SEL) programs and practices and identify unique and common usability problems.
2. Explore the links between SEL programs/practices usability and implementation and student outcomes.
3. Refine the USABILITY theory of change, develop a matrix of usability problems and redesign solutions, and articulate guidance to the field for designing usable Tier 1 SEL programs/practices.

  The research reported here is supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R305A230391 to the University of Washington. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

---

Importance

This is the first study to evaluate the usability of school-wide, universal SEL programs - in other words, how easy (or hard) they are to implement from the perspectives of teachers and students. We will also explore how much a SEL program/practice's usability matters to school and student outcomes.

---

 

---

Recruitment

The study is actively recruiting participants to complete the virtual user testing component.

------------------------------------------------------------------------------------------------------------------

ELIGIBILITY

We invite teachers and students who meet the following criteria to participate.

Teachers Employed at elementary school Teach K - 6th grade Teach general education students Any range of previous experience with SEL programs and practices View informational flyer here > Complete interest survey > Teachers will not participate as a representative of their school or district.

Students Enrolled at elementary school Enrolled in 4th - 6th grade General education student Any range of previous experience with SEL programs and practices View informational flyer here > Complete interest survey >

------------------------------------------------------------------------------------------------------------------

PARTICIPATION Participants are asked to complete virtual testing of 2 SEL programs where they will: Teachers will be asked to review digital SEL program materials 2 weeks prior to the session Share thoughts and experiences on their engagement with the programs Complete brief surveys on perspectives of the programs Teachers Will participate individually Have the option to complete one 2-hour session or split their time across two 1-hour sessions Will receive $250 digital gift card (halved if only one session is attended out of two) Students Will participate in a group setting of 2 - 3 students Will complete one 2-hour session Will receive $200 digital gift card

 

(Training & Technical Assistance) As a key component of this mission, UW SMART has developed strategies and related infrastructure for providing training and technical assistance to state and local education agencies as well as individual school districts. The SMART Center’s “TACore” provides: 1) Training and consultation/coaching focused on developing workforce capacity (among school staff and community partners) to deliver research-based strategies, policies, and practice models relevant to the education context, 2) Technical assistance focused on building evidence-based, multi-tiered systems of school-based behavioral health, using collaborative decision-making processes guided by local data as well as research evidence, and 3) Program evaluation focused on collecting and analyzing existing (e.g., administrative datasets) and novel (e.g., surveys, focus groups) quantitative and qualitative data to determine the impact of new or existing programs, practices, and policies.

Originally funded by federal COVID relief funds, the AESD BH-SAP aims to expand availability to school-based behavioral health services statewide. Across Washington state’s nine Educational Service Districts (ESDs), this initiative expands behavioral health support systems (including mental health and substance use) through a Multi-Tiered System of Support (MTSS) framework by increasing staffing capacity at regional and local levels. TAC has supported this project through regional capacity building as well as by serving as the lead evaluator. Capacity building activities included providing consultation on selection of practice models to be used by Student Assistance Professionals (SAPs) and professional learning opportunities for SAPs. Evaluation efforts include overseeing collection of student, school, and district outcome data, analyzing data, and producing reports to inform continuous improvement of the BH-SAP initiative. See recent program evaluation findings in the 2023-24 report and executive summary.

In response, Washington state was recently awarded $6 million from the U.S. Department of Education to create a pipeline from Washington state’s five accredited Masters in Social Work training programs to Washington state’s K-12 schools. Called the Workforce for Student Well-being Initiative or WSW, 100 aspiring school social workers will receive conditional scholarships based on their financial need so the cost of getting an education is not a barrier to their getting an advanced degree and then committing to working in a high-need public or tribal school. [maxbutton id="1" url="https://smartcenter.uw.edu/workforce-for-student-well-being-initiative-wsw/" text="Learn More Here!" window="new" ]