Local Evaluator Meeting June 19, 2012 University of

Local Evaluator Meeting June 19, 2012 University of

Local Evaluator Meeting June 19, 2012 University of Maryland School of Pharmacy Agenda 10:30 Welcome and Introductions 10:45 Local Evaluators Role 11:00 Implementation & Evaluation Plans Process Evaluation Outcome Evaluation IRB 12:00 Lunch 12:30 Activities on Implementation & Evaluation Plans 2:00 SAMHSA Requirements NOMS CLI part II PLI 2:30 Wrap-up

LOCAL EVALUATOR ROLES IMPLEMENTATION AND EVALUATION PLANS The Strategic Plan identifies the Short-term and Long-term objectives. The Implementation Plan identifies the measureable outcomes. The Evaluation Plan identifies the steps that need to be taken when conducting an outcome evaluation. Overview of Evaluation Process Evaluation documents all aspects of the implementation of an intervention. It monitors the outputs of the strategy. Outcome Evaluation documents whether the

strategies made a difference, and if so, what changed. Priority Decrease Underage Drinking (12-20 year olds) and decrease Young Adult Binge Drinking (18-25 year olds) in the Frostburg Community. Intervening Variable Social Availability Contributing 1. Factor (CF) 2. 3. Strategy Students host drinking parties and charge $5 for a refillable cup of jungle juice or beer Mt. Ridge High School students are attending college house parties and consuming alcohol

Students lack awareness of the consequences for providing alcohol to those under 21 years old. Key Action Steps Advertise TIP 1. hotline already 2. established at FSU to city 3. residents (CF #1) Design a logo Order

magnets Disburse magnets Implementa Whos Responsible Measurable tion - Implementing Outcome (s)? Timeframe 05/12 to 6/12 1. Logo-Ashton Graham 2. OrderingLyndsey Baker 3.

DisbursementJesse Ketterman Social Availability Core Team The number of calls to the hotline How will you Who will measure? collect the data? Increase the Lyndsey number of Baker calls over the

past year for the same two month period PROCESS EVALUATION How will the implementation of the strategic plan be assessed? A Process Evaluation assesses: What activities were implemented Were activities implemented as planned

Who participated and for how long? Were the resources sufficient? What obstacles were encountered? Strengths and weaknesses of the implementation What adaptations were made? The Process Evaluation will assess whether key action steps from the implementation plan occurred as expected. Two examples of process measures to track: 1. Activities number of meetings with legislators, PSAs aired 2. Participants If the strategy is A possible measure might be

Merchant training in RBS Number of merchants attending the training (people served) Percentage of merchants who complete the training (people served) Compliance checks Number of attempts to buy alcohol by youth (services delivered) Number of PSAs aired (services A public awareness delivered) campaign explaining social Number of parents attending an host liability laws to adults information session (people

served) Priority Decrease Underage Drinking (12-20 year olds) and decrease Young Adult Binge Drinking (18-25 year olds) in the Frostburg Community. Intervening Variable Enforcement and Adjudication Contributing Factor (CF) 1. Frostburg City Police is currently understaffed by three officers, thereby making it difficult to patrol effectively. Strategy

Key Action Steps Implementa Whos Responsible Measurable tion - Implementing Outcome (s)? Timeframe How will you Who will measure? collect the data? Enhance and support law enforcement to address

college parties using saturation patrols and party patrols Work with police to map out a plan for saturation patrols one weekend prior to the end of the semester. Frostburg 1. PD= May

10-11-12, 2012 for 48 2. hours Frostburg PD-Chief Douty FSU 3. PD=May 111-12, 2012 for 32 hours Enforcement and Adjudication Core Team Increase the Lyndsey number of Baker

citations over last year for the same weekend according to police reports FSU PD--Lt. Ralston The number of alcohol citation issued in the student neighborhoods Sample of Process Evaluation

Planning Tool Process Evaluation Questions Did the selected strategy follow the plan of implementation? What are the demographic characteristics of the participants? What are the participants levels of satisfaction with the selected strategy ? Are resources to implement the strategy available? What is the staffs perception of the selected strategy ? Process Evaluation Schedule of

Data Collection Completion Methods Person Responsible OUTCOME EVALUATION How well did the strategies affect the contributing factors/intervening variables/priorities? Outcomes are changes that occur as a result of implementing a strategy. Short-term Outcomes are changes of the focus population at the end of the strategy. Examples include changes in knowledge, attitudes, and skills. Long-term Outcomes are the ultimate effects of the strategies. For example, the reduction in past 30 day alcohol use in youth age 12-20.

Examples of Outcomes Measures Reduced access to alcohol by underage youth More responsible beverage training Decline in number of alcohol licenses issued Decline in the number of conditional use permits utilized when granting alcohol licenses Increase in the number of alcohol outlets in compliance Increase in the number of public events that restrict access to alcohol Examples of Outcomes Measures Decrease in availability of alcohol to youth at special events and in public places (e.g., number of patrons

under 21 being able to purchase, get, or consume alcohol) Rates of DUI arrests and convictions Number of calls to law enforcement complaining of incidents related to alcohol outlets Number of ER admissions that involve alcohol Outcome Evaluation Plan What will be measured Design of the evaluation ( Who to assess, when to conduct the assessment, who will collect the data) Methods to be used in the evaluation and develop a plan to put those methods in place. Analyze the data and interpret the findings

Recently Viewed Presentations

  • ALTERNATIVE LEADS - College of Charleston

    ALTERNATIVE LEADS - College of Charleston

    ALTERNATIVE LEADS Chapter 7 "Soft Leads" Alternative or "soft" leads bring creativity and variety to news (sports, features, business) writing See examples on page 181 Instead of beginning with the main news element, ala summary/central point "hard" news leads, an...
  • Maricopa Association of Governments - ASHE

    Maricopa Association of Governments - ASHE

    Revise to include Type M copper. Detail. Title. Recommended Action by Outside ROW Working Group. 301. Blocking for Water Gate and Butterfly Valves. Review to determine if a detail is needed for butterfly valves. 302. Joint Restraint with Tie Rods....
  • What is Sport & Entertainment Management?

    What is Sport & Entertainment Management?

    , physical, mental and social . benefits. Student athletes are . ineligible. for participation in an intercollegiate sport if they ever agree (orally. or in writing) to be represented by an . agent. for . marketing. their . athletic ability...
  • Region 4 report--Thursday 28 July session

    Region 4 report--Thursday 28 July session

    Ron>>>>>Introduce incoming Vice Chair: Anne Ellis, Ph.D. Director Dr. Ellis holds a bachelor's degree in organic chemistry and an MBA in strategic marketing and communications from the State University of New York at Buffalo, and a Ph.D. in Public Administration,...
  • Organizational Behavior - University of Richmond

    Organizational Behavior - University of Richmond

    Relational Dialectics 3 relationship dialectics Openness/closedness dialectic 'I want to be close/I need my own space' Novelty/predictability dialectic 'I like the familiar rhythms/we need to do something new and different' Autonomy/connection dialectic 'I like sharing with you/I don't want to...
  • Media Timeline: Key Events Cindy Royal, Ph.D Associate

    Media Timeline: Key Events Cindy Royal, Ph.D Associate

    Media Timeline: Key Events Cindy Royal, Ph.D Associate Professor Texas State University School of Journalism and Mass Communication [email protected]
  • Physical Geography of the United States and Canada: A Land of ...

    Physical Geography of the United States and Canada: A Land of ...

    Physical Geography of the United States and Canada: A Land of Contrasts. ... - Interior Plains extend from Appalachians to Missouri River - Great Plainsextend from Missouri River to Rocky Mountains - Canadian Shield—vast, flat area around Hudson Bay.
  • The Earth and Its Atmosphere

    The Earth and Its Atmosphere

    Two Types of Alpha-Numeric Guidance FOUS (Forecast Output United States): Raw model forecast data interpolated to specific geographic points from actual model grid points. Example: FOUS (NAM Model) bulletins This raw model guidance is directly translated from the model forecast...