11.10.16 Final Chickasaw County IPFS Evaluation Plan

Iowa Partnerships for Success Evaluation Plan Template Chickasaw County Revised: October 26, 2016 Approved: November 10, 2016 Instructions Please type your answers directly into this document Your answers to each question need not be longer than one paragraph in length If more explanation is needed, please try to be as brief and concise as possible If you not currently have the capacity to answer one of the questions, please indicate what course of action you will take to address this Additional instructions about how to complete this document can be found in the IPFS Evaluation Primer and Guide located in the Project Resources folder on the IPFS workstation https://www.myctb.org/wst/iowapfs/default.aspx If you have questions about how to complete the document or the evaluation planning process, please email Cheryl Davidson, IPFS Evaluator at cheryl.davidson@iowa.gov or call 515-281-6929 Once you have completed all the questions, please submit this document tocheryl.davidson@iowa.gov The deadline is July 1, 2016 Evaluation Plan Template Part 1: Evaluation Summary A Audience i What groups or stakeholders will be sought for input in the evaluation process? Input will be sought from key stakeholders and groups in Chickasaw County including: Chickasaw Connections coalition members, schools, teachers, youth, parents, law enforcement, juvenile court services, city and county elected officials, park oversight committees, grocery/convenience store retailers, county attorney, community event organizers, behavioral health, healthcare, and faith-based organizations ii What, if any, efforts will be in place to ensure that minorities or special populations are represented? U.S Census demographic data from the County Assessment Workbook will help to assess the county’s youth population and identify youth being served in the project When possible, the coalition will aim to reach as broad and diverse a group as possible In the strategic plan for the project, youth who are not involved in extracurricular activities and females between the ages of 16 and 18 from New Hampton Schools were identified as being disproportionately impacted by underage drinking The project coordinator and evaluator will work to ensure the identified youth are included in implementation activities and in quantitative and qualitative data collection Whenever possible, a representative approach will be used when administering quantitative evaluation assessments in order to reach the entirety of the targeted youth in Chickasaw County For instance, if a school survey is administered to evaluate the effectiveness of the media campaign, all schools will be asked to invite all students in the targeted age range to participate For qualitative data collection, such as focus groups, the project coordinator and evaluator will recruit a range of participants to mirror the demographics of Chickasaw County If needed, minority or special population focus groups will be recruited to augment findings from focus groups reflecting a broad swath of the Chickasaw population iii What kinds of information you anticipate stakeholders will be interested in knowing about your project? • Underage drinking and binge drinking rates • Accident and Arrest trends • • • • • • • • • • • • • iv Substance abuse treatment trends Number of youth involved in extracurricular activities and extracurricular activity suspensions Iowa Youth Survey trends Changes in youth's attitudes and beliefs around alcohol Community readiness Fidelity of strategy implementation Adaptations made to strategies and the impact of adaptations Strengths and weakness of the implementation and delivery of the strategies Persons/groups who received the services/interventions Costs of implementation and project delivery Effectiveness of the strategies Potential sustainability of strategies in terms of effectiveness, cost, community support, etc Strategies that resulted in the most challenges How will you share data and reports with your coalition and stakeholders? Reports on aggregated data will be prepared by the IPFS project coordinator and evaluator and shared at coalition meetings Members will split into groups and answer questions to help them analyze the data This information will be used to prepare handouts/case statements to share results with stakeholders at meetings and during speaking engagements Handouts and case statements will also be available on the coalition website The project coordinator will provide additional summarized findings to the coalition and stakeholders upon request and availability B Data Methods i List all the methods that you plan to use to collect data on your strategies (e.g secondary data, survey, focus group, interviews, pre-post- tests, and any other methods) Secondary data, meeting minutes/notes, surveys, focus groups, interviews, pre-post tests, administrative data, and observational data will be used to collect data on strategies a If using secondary data, how will you obtain the data and from what sources? Data will be obtained from the following secondary data sources: • Iowa Youth Survey: IPFS staff will work with the Chickasaw County schools to ensure youth participate in the survey County-level data from the survey will be accessed online, and school-specific data will be requested from school leaders • • • • County Assessment Workbook tables: This information will be maintained by the coalition assessment committee with assistance from IDPH Information on substance abuse treatment and data from the Justice Data Warehouse will be accessed Administrative data from law enforcement: The two municipal police departments in the County and one sheriff's department will be asked to provide information through their charge analysis reports and the party patrol and bar walkthrough forms Records from media outlets: Media outlets will assist in identifying the number of youth reached by the media campaign b If conducting surveys, how will you solicit participants and approximately how many will be surveyed? What information will you seek from them? How will you store the completed surveys? How you plan to tabulate the results? Schools will assist in conducting surveys on how many youth are reached by the IDPH "What Do You Throw Away" Media Campaign The project coordinator will request permission from the school administrators to send a web link survey invitation to students via email It is anticipated that all 1300 students in 6th-12th grade in Chickasaw County public and parochial schools will be invited to participate Students will be asked if they've seen or heard of the campaign and, if so, where Students will take the survey during the school day to try to boost the response rate The surveys will be tabulated and stored electronically, which will allow for better security and easier tabulation of the results c If conducting focus groups, what groups will be represented and how many participants will be recruited? What information will you seek from them? Who will conduct the focus group and where will it take place? How you plan to tabulate the results? Youth between 12-20 years of age will be recruited for focus groups The purpose of these focus groups is to gain insight on youth’s perceptions of the consequences of and reasons for underage drinking The assessment/planning committee will arrange the focus group(s) to take place at an accessible location(s) Notes will be taken during the focus group(s) and recordings will potentially be transcribed and coded to identify emerging concepts Transcriptions will not contain information that could personally identify the respondents The results will be stored electronically d If using pre-post-tests, what information will you collect and how? Will data be available to you through the individual strategy curriculum? If not, what process will you use to collect the data? How will you store the completed tests? How you plan to tabulate the results? We will use pre-post-tests for the All Stars strategy that will measure student's perceptions of the risks/harms of underage alcohol use The curriculum includes a pre- and post-test that the IPFS project coordinator and All Stars facilitator will deliver to the students during the course Data collection, analysis, and compiling of results will be provided by Brilliance Analytics as part of the student materials to be purchased Storage of completed tests, datasets, and results will be decided following discussions with Brilliance Analytics e If using another method, please explain how the data will be collected Interviews with various stakeholders such as retailers and youth aged 18 to 20 will be arranged on an individual basis by Assessment/Planning Committee members This will be done in order to get qualitative data on the progress in implementing the strategies Interviewer notes will be used to identify themes from the interviews about awareness, knowledge, and perceptions of the strategies Results will be stored electronically and personally identifying information will not be included in the original notes or electronic copies Other program data collected on an ongoing basis will be stored in paper form and kept in a locked office or electronically in the Chickasaw County Assessment Workbook on a password protected laptop Assessments and environmental scans will be conducted by coalition members, project staff, and volunteers throughout the project to collect data on alcohol advertisements in convenience/grocery stores and alcohol use in public places within the county Lastly, every All Stars facilitator will be required to complete a fidelity monitoring log form with information on the number of sessions, parent involvement, and activity completion ii How you plan to protect the confidentiality of the people you collect information from? The Center for Social and Behavioral Research (CSBR) at the University of Northern Iowa is assisting with the evaluation of the IPFS grant and will provide guidance on best practices for protecting the confidentiality of participants in the evaluation CSBR will review all forms, surveys, pre-post tests, and interview questions to ensure confidentiality is protected CSBR will also provide advice on how to de-identify the data for analysis and reporting Participants will be given informed consent in which they can choose to participate in surveys, interviews, and focus groups or opt out Signed consent will be obtained prior to recording any sessions Survey participants’ names will not be stored with their responses The original data files will be stored in a secure, locked office, and raw survey responses will be kept on a secure password protected laptop C Data Quality i Are the data sources you plan to use reliable (consistent measures over time)? Why or why not? The secondary data sources are the most reliable sources of information available at the county level These datasets have been maintained for many years with minimal changes in the questions or indicators The All Stars program has received above average Quality of Research Ratings for reliability of the measures in its assessments (for more information, see: http://vfhy.org/sites/default/files/pdf/All_Stars_NREPP.pdf) For other data collection activities, pre-existing questionnaires and evidencebased instruments will be used, when possible, that have demonstrated reliability In the event that new instruments are needed, the materials will be reviewed by the assessment committee to ensure the items are appropriate Pretesting of new questions will also be conducted with youth in the target population, when needed CSBR will advise on questionnaire design and pretesting strategies before quantitative and qualitative data collection begins When possible, questions will be derived from items known to have internal consistency for measuring a specific concept or set of concepts Finally, to reduce inter-observer reliability concerns, the same observer/interviewer will be used for qualitative data collection when possible ii Are the data sources valid (they measure what you want them to measure)? Why or why not? The secondary data sources are strong in external validity because the research designs have been constructed to be generalized to populations across the state of Iowa The data collected as part of the other evaluation activities, such as the focus group notes, will have limited external validity because of the lack of random selection of participants and the qualitative nature on the data collection However, in instances where a census approach is used, such as the school survey, the effectiveness of the strategies may be generalized, with specified limitations, to the targeted subpopulations in Chickasaw County The assessments that are part of the All Stars Curriculum have received average scores for internal validity as rated by Quality of Research (for more information, see: http://vfhy.org/sites/default/files/pdf/All_Stars_NREPP.pdf) Questionnaires and assessment tools used will be derived from previously used tools that have been tested locally and in communities that have successfully implemented these strategies in the past New instruments developed for the evaluation activities will be reviewed by the assessment committee to ensure the instruments have face validity The project coordinator will review the instruments for content validity, and both the project coordinator and CSBR will seek out established measures whenever possible to ensure criterion validity As resources allow, pre-testing will also be conducted in part to ensure construct validity iii How will you ensure that the data you collect are representative of your county’s IPFS priority population (12-20 year olds)? The data sources used (survey, interviews, focus group, secondary sources, or administrative data) will focus on sampling the 12-20 year old age group when possible In-depth interviews and secondary data will provide data on underage drinking from the harder-to-reach 18 to 20-year-old population working in the county or Chickasaw residents attending college outside of the county Some data on 18 to 20 year olds will be available through law enforcement, including minor in possession of alcohol citations and fines Demographic information collected from participants during the evaluation will be compared to secondary data, primarily the American Community Survey, to ensure adequate representation of the priority population D Analysis a How will you use the data to help you find answers about your project? Both quantitative and qualitative data will be collected for the outcome evaluation All strategies will include some indicators to measure changes over time Baseline data collected prior to the start of the strategies will be compared to post-activity assessments to determine the extent to which the strategies were effective For example, the All Stars school curriculum incorporates pre- and post-assessments to measure changes after the intervention Also, there are plans to conduct a school survey targeting both students and parents before the start of several strategies and on a yearly basis thereafter to help assess awareness, knowledge, attitude change, and impact Table 1D shows the strategies and indicators the coalition will collect data on to show change over time Interviews will be conducted near the end of the project to get an idea about what changes community members and key stakeholders feel have been most successful and have the greatest potential for sustainability Other measures of effectiveness will include any changes observed in community policy, changes in the environment in terms of the promotions or counter-advertisements youth are exposed to, and changes in the attitudes and beliefs youth have about drinking Table 1D Strategy Alcohol Use in Public Places Underage Drinking Media Campaign Apply Appropriate Penalties to Minors in Possession (MIP) All Stars Alcohol Advertisements in Public Places Indicator Number of policies before implementation and at the end of the project Number of youth who report seeing or hearing the media campaign in the first year of implementation and at end of implementation The percentage of youth reporting it would be easy or very easy to get alcohol in their community in the 2014 Iowa Youth Survey compared to the percentage of youth who report easy/very easy alcohol access in the 2018 Iowa Youth Survey Changes in student's attitudes, beliefs, and behaviors before beginning All Stars compared to after they have taken the program The number of alcohol advertising policies before implementation and at the end of the project b How will you use the data to identify what changes/modifications are needed? The indicators listed under the “Monitoring Your PFS Process and Activities” section of Part 2: Data Reporting Plan will comprise the main elements of the process evaluation The project coordinator, with assistance from CSBR, will review the data collected and make recommendations to the Assessment/Planning committee for changes or modifications to the project activities and strategies Before making changes/modifications, the findings will be shared with the parties and committees implementing the given strategy and action steps to ensure they are following fidelity guidelines and core components will be addressed All changes or modifications will be informed by the indicators planned for the outcome evaluation The outcome indicators include: 1) measurement of the perception of risk/harm of alcohol use according to pre- and post-test surveys administered by the All Stars program; 2) the number of alcohol retailers in Chickasaw county with new or revised policies for alcohol advertisements; 3) the average number of impressions among the target population reached by the media campaign; 4) number of new or revised policies for alcohol use or sales in parks; and 5) proportion of students in the Iowa Youth Survey who report the ease or difficulty in obtaining alcohol 10 who is drinking? (Is there a difference among cultural groups?) Costs to implement and deliver Resources generated Media coverage of IPFS initiative Individuals and organizations who received IPFS services Price quotes and invoices Attendance forms, newly recruited coalition members, donation/inkind log Media venues' data on reach New Hampton Tribune, Nashua Reporter, Fredericksburg Review, Facebook, Twitter, Chickasaw Connections Blog, 95.1 the Bull Radio Focus groups, surveys, interviews, pre and post tests What did it cost to implement and deliver strategy Donated materials, time, mileage, meeting space, food, print/copying, advertising, and funds What was the reach, venues used, when were printed, recorded, and posted (online) products released? Counts on the number of articles (electronic and print), recorded ads, photos of media pieces Who was reached by the activity/ intervention? Was knowledge increased? Were skills developed? Sub-contractors, media venues, curriculum companies, and IPFS coordinator Coalition, subcommittees, and strategy stakeholders General population 12 to 20-year-olds and anyone who received IPFS Services Ongoing Annually Ongoing Annually Ongoing Ongoing Monthly Monthly No anticipated limitations/problems IPFS Coordinator and Supervisor No anticipated limitations/problems IPFS Coordinator, Coalition Secretary No anticipated limitations/problems No anticipated limitations/problems IPFS Coordinator IPFS Coordinator and Evaluator 12 Barriers and successes Capacity checklist, minutes and notes from coalition and subcommittee meetings Indicator A Method From what source you plan to collect the data? Did behavior change? Was the experience positive? What were barriers to success? What successes happened? What went well? How can things be improved? Were outcomes achieved? Were strategies implemented with fidelity? How?/Why not? Coalition and subcommittee members and strategy stakeholders B Measurement What question or measure will be used to capture this indicator? Ongoing C Target Population What group will you be collecting information from? D Reporting How often will the data be available for collection? Quarterly No anticipated limitations/ problems IPFS Coordinator and Evaluator E Timeframe What period of time will the data you report cover? F Data Limitations Are there any problems with the data source? Will the data be a limited measure? G Name Person or group responsible for collecting the data n/a n/a n/a Strategy Outcomes - Best Practices for Alcohol Use in Public Places # alcoholfree signs in public places n/a: The group does not anticipate a ban on alcohol, but instead, n/a n/a n/a 13 plans to work with cities on creating clear policies for alcohol use or sales in their park(s) # and type of new or modified alcohol policies # places impacted by policy enactment # law enforcement patrolling public places # citations, arrests, or warnings issued to adults and Administrative data (Notes from meetings City Councils and Park Boards and copies of the policy) City/Park Board Records (existing, new, or modified alcohol policies) Environmental scans (administrative data) Law enforcement patrol report/ charge analysis # of policies at beginning of project (before implementation) # of policies created/ modified at end of project What were the key characteristics of the created/modified policies? How did the policy compare to model public alcohol use policies? Photos of alcohol use signage by end of project Which locations in Chickasaw do/do not have policies in place? What locations does this policy apply to? (i.e shelters, playground, ball field) If a policy was in place, how was it modified as a result of the strategy? Did you see any police officers or other people assisting with security? If so, please specify: How many citations, arrests, or warnings were issued pertaining to alcohol use of minors in public places? Municipal government divisions (Park Boards, City Councils) City councils and park boards Coalition members Law enforcement Annually Ongoing April November AprilNovember Annually The availability of this data will depend on the speed at which the councils/boards approve new/modified policies Best Practices for Alcohol Use in Public Places Subcommittee Annually The availability of this data will depend on when the councils/boards approve new/modified policies Best Practices for Alcohol Use in Public Places Subcommittee Annually Annually No anticipated limitations/ problems No anticipated limitations/ problems Assessment/Planning Committee, Law enforcement, IPFS Coordinator Assessment/Planning Committee, Law enforcement, IPFS Coordinator 14 minors in public places regarding alcohol # law enforcement trained to recognize/ manage intoxicated patrons Optional: Community leadership's awareness of restrictions and degree of support Other:# of assessments conducted in public places (If you plan to collect data on another indicator for Alcohol Use Restrictions in Public Places, report n/a: There are no plans for law enforcement to receive training on how to recognize intoxicated patrons They should already know how to this Pre-post Interview Event assessment n/a What alcohol policies exist in the parks? What strategy has had the greatest impact (list all strategies) Parks in Chickasaw County have strengthened or created new public alcohol use policies, what changes, if any, have you noticed? The Public Places Assessment form will be used n/a Community leaders Event goers, park users, youth under 21 n/a Ongoing AprilNovember n/a n/a n/a June 2016September 2019 Annually No anticipated limitations/ problems No anticipated limitations/ problems Best Practices for Alcohol Use in Public Places Subcommittee Coalition members, Best Practices for Alcohol Use in Public Places Subcommittee 15 please add information) Other: Underage Binge Drinking School survey Indicator A Method From what source you plan to collect the data? Students who have reported binge drinking in the past 30 days B Measurement What question or measure will be used to capture this indicator? Chickasaw County6th12 graders C Target Population What group will you be collecting information from? Annually D Reporting How often will the data be available for collection? Annually (August May) The availability of this data will depend on students/ grades /schools willingness to complete survey E Timeframe What period of time will the data you report cover? Schools, Assessment/Planning Committee F Data Limitations Are there any problems with the data source? Will the data be a limited measure? G Name Person or group responsible for collecting the data Media outlet data may be an estimation No anticipated problems/ limitations Media sector, IPFS Coordinator Marketing/ outreach committee, media vendor Strategy Outcomes - Underage Drinking or Binge Drinking Media Campaign Average number of impressions among target population # of different media that participated Records from media outlets Media circulation log #of social media page views # of radio runs #of articles printed/posted # of posters posted # of media venues who participated Media outlets (New Hampton Tribune, Nashua Reporter, Fredericksburg Review, Facebook, Twitter, Chickasaw Connections Blog, 95.1 the Bull and 92.3 Radio, Fairway billboard co., schools, etc.) Media outlets (New Hampton Tribune, Nashua Reporter, Fredericksburg Review, Facebook, Twitter, Chickasaw Connections Blog, Ongoing Ongoing Monthly Monthly 16 Number of "runs" per media outlet Records from media outlets % target population reached Optional: Negative attitudes about youth drinking/bin ge drinking or perceived consequence s among youth School Survey School Survey How many times did the media outlet run the campaign material? Have you seen this media piece? Where did you see these materials displayed? What is one thing you could "throw away" if you drink? It is against my values to underage drink Students caught drinking, smoking, or using an illegal drug are not allowed to participate in an extracurricular activity for some time period Would you be more or less popular if you 95.1 the Bull and 92.3 Radio, Fairway billboard co., schools, etc.) Media outlets (New Hampton Tribune, Nashua Reporter, Fredericksburg Review, Facebook, Twitter, Chickasaw Connections Blog, 95.1 the Bull and 92.3 Radio, Fairway billboard co., schools, etc.) Chickasaw County 6th-10th graders Chickasaw County 6th-12th graders Ongoing Annually Annually Monthly Annually Annually (August May) No anticipated problems/ limitations IPFS Coordinator, media vendor No anticipated problems/ limitations The availability of this data will depend on students/ grades /schools willingness to complete survey IPFS Coordinator, media vendor Schools, Assessment/Pla nning Committee 17 used alcohol? Adult and peer norms questions Other: (If you plan to collect data on another indicator for Underage Drinking or Binge Drinking Media Campaign, please add information) Indicator n/a n/a n/a n/a n/a A Method From what source you plan to collect the data? B Measurement What question or measure will be used to capture this indicator? C Target Population What group will you be collecting information from? D Reporting How often will the data be available for collection? E Timeframe What period of time will the data you report cover? n/a F Data Limitations Are there any problems with the data source? Will the data be a limited measure? n/a G Name Person or group responsible for collecting the data Strategy Outcomes – Apply Appropriate Penalties to Minors in Possession(MIP) Frequency of training # citations or warnings for selling to minors; MIP Training Post test survey Administrati ve data from juvenile court services and law enforcement Certificate of Completion or training attendance record How many MIP complaints were filled (under 18) How many minor in possession citations were issued? (18-20) Law enforcement, subcommittee members Youth under 21 Unknown Annually FY 2016-FY2017 Annually Not all law enforcement officers may be able to attend the training No anticipated problems/ limitations IPFS Coordinator and IDPH IPFS Coordinator, Law enforcement 18 (Charge analysis report) # retailers posting compliance certificate # retailers using scanners Method of penalty enforcement # efforts by enforcement type n/a: This strategy will not involve compliance checks n/a: scanners will not be involved in the bar walkthrough s and party patrols Administrati ve data from Juvenile Court services (1217) Administrati ve data from law enforcement (18-20) Administrati ve Data from Law enforcement (Charge analysis report, work schedule, report of tracked n/a n/a n/a n/a n/a n/a n/a Age of violators # with past offenses What penalty was the minor given? (12-17) What fines and charges were given to the violator(s)? (1820) # and location of party patrol operations conducted n/a n/a n/a n/a n/a Annually Annually Juvenile court data just reflect youth under 18 No anticipated problems/ limitations IPFS Coordinator, Juvenile Court Services IPFS Coordinator, Law enforcement Youth under 21 Youth under 21 and Adults /property owners 21 and over Annually Annually # and location of bar walkthroughs conducted # of minor in 19 hours) # and type alcohol policy changes n/a: At this point, there are no plans to change alcohol policies with this strategy # public meetings (media advocacy) Receipts or agreements with media vendors Optional: Retailer support for UA drinking law enforcement Optional: Youth Interview Interviews (18-20) possession, zero tolerance, OWI, social host, and providing to a minor charges n/a # of published media/social media/ blog pieces # of calls or "tips" local law enforcement received regarding underage drinking parties Qualitative information on how walkthrough went and if there was any resistance (Retailers: Did you notice an increased law enforcement presence? Did it make you feel more supported?) What consequences, if n/a General public Law enforcement or retailers 12 to 20-year-olds n/a Monthly Annually Annually, during breaks n/a n/a n/a Monthly No anticipated problems/ limitations IPFS Coordinator No anticipated problems/ limitations It may be challenging to IPFS Coordinator, Law enforcement Assessment/pla nning Annually Annually 20 perceived likelihood of being punished Focus group School Survey (1218) Other: Youth perception of alcohol availability Other: Youth alcohol related arrests Other: Treatment Episodes Compliance Check failures School Survey Secondary Data (JDW, CJJP, and Chickasaw County Juvenile Court Services) Secondary Data (ISMART and Pathways Behavioral Services) Administrati ve Data (law enforcement any, youth who underage drink face? How likely are youth to face consequences for underage drinking? How difficult you think it would be for a kid your age to get alcoholic beverages? # of juvenile alcohol offenses # of OWI offenses Alcohol charges by age and gender Alcohol/Drug Referral History # and rate of treatment episodes # of youth clients who received substance abuse treatment services # of licenses, # of compliance checks, # of for 18 to 20year-olds who attend college Chickasaw County 6th-12th graders Youth under 18 Youth under 21 Alcohol retailers Annually Annually Annually unknown Annually (August - May) Annually Annually unknown recruit 18 to 20year-olds (high school graduates) to participate in interviews The focus group will strive to represent the targeted population The quality of this data will depend on students/ grades /schools willingness to complete survey The availability of this data will depend on students/ grades /schools willingness to complete survey This will not account for youth age 18-20 No anticipated problems/ limitations It may not be possible to check every alcohol committee Assessment/Pla nning committee Assessment/Pla nning Committee, Juvenile Court Services Sector, IPFS Coordinator IDPH, Assessment/Pla nning committee, Behavioral Health Sector, IPFS Coordinator IPFS Coordinator, law enforcement 21 Locations with reports of underage drinking Indicator ) Administrati ve Data (law enforcement ) A Method From what source you plan to collect the data? compliance check failures Potential locations and sources for underage drinking B Measurement What question or measure will be used to capture this indicator? 16 to 20-year-olds Annually C Target Population What group will you be collecting information from? D Reporting How often will the data be available for collection? 6th and 7th grade students Twice per year 6th and 7th grade students 6th and 7th grade students Twice per year Twice per year Annually license holder depending on when the checks are conducted Data availability will depend on if checks are conducted The focus group will represent a sample of the target population E Timeframe What period of time will the data you report cover? F Data Limitations Are there any problems with the data source? Will the data be a limited measure? August 15, 2016 - May 31, 2019 No anticipated problems/ limitations August 15, 2016 - May 31, 2019 August 15, 2016 - May 31, 2019 No anticipated problems/ limitations No anticipated problems/ limitations Assessment/ Planning Committee G Name Person or group responsible for collecting the data Strategy Outcomes – All Stars # sessions Survey % parents actively involved in program Documented changes in students’ (program data) Homework Pre and Post-tests Teacher session rating form How many students worked on the homework with a parent? How many students are in the class? Pre and post test provided by Brilliance All Stars Facilitator All Stars All Stars Facilitator 22 attitudes and behaviors Teacher’s reports about activity completion Other: Students and parents who received information on the benefits of extracurricular activities Analytics as part of All Stars Prevention, LLC Teacher session rating form Record of materials distributed or presentation attendance record Other: Popularity relating to alcohol use Other: Extracurricular Activity Suspensions School Survey School records Form provided by All Stars Prevention, LLC How many flyers were given to parents to promote extracurricular activities? How many youth/parents attended a presentation about activities? Would you be more popular (respected or cool) if you used alcohol? # in extracurricular activities at beginning/end of project (include demographic) How many students had a substance abuse violation? How many of those were alcohol related? How Curriculum Facilitators Twice per year August 15, 2016 - May 31, 2019 No anticipated problems/ limitations 6th and 7th grade students and their parents/guardians Twice per year August 15, 2016 - May 31, 2019 Annually Annually Annually (August - May) Annually No anticipated problems/ limitations The availability of this data will depend on students/ grades /schools willingness to complete survey No anticipated problems/ limitations Chickasaw County 6th-12th graders 6th-12th graders All Stars Facilitator All Stars Facilitator, IPFS Coordinator Schools, Assessment/Planning Committee Schools 23 Other: Underage Alcohol Use Indicator School Survey A Method From what source you plan to collect the data? many of those were students in extracurricular activities? Students who have reported alcohol use in the past 30 days B Measurement What question or measure will be used to capture this indicator? Chickasaw County 6th-12th graders C Target Population What group will you be collecting information from? Annually D Reporting How often will the data be available for collection? Annually (August - May) The availability of this data will depend on students/ grades /schools willingness to complete survey E Timeframe What period of time will the data you report cover? Schools, Assessment/Planning Committee F Data Limitations Are there any problems with the data source? Will the data be a limited measure? G Name Person or group responsible for collecting the data No anticipated problems/ limitations The availability of Best Practices for Alcohol Advertising Subcommittee Best Practices Strategy Outcomes - Best Practices for Alcohol Advertisements in Public Places # and type of alcohol policies restricting advertiseme nt # public Records from meetings with grocery/con venience store management (Copies of policies from grocery/con venience stores) Records What is your alcohol advertising policy? What guidelines you follow pertaining to advertisements from 3rd party retailers? Stores with alcohol advertising policy at beginning of project The number of Convenience and grocery stores Convenience and Ongoing Ongoing Annually Annually 24 places impacted by alcohol policy enactment Media advocacy for policy change - # advertiseme nts promoting restrictions (times ad appears or is distributed) Media advocacy for policy change -distribution method (Details about how ad is being distributed) Media advocacy for policy from meetings with grocery/con venience store management / Environment al scans Media venues: New Hampton Tribune, Nashua Reporter, Fredericksbu rg Review, Facebook, Twitter, Chickasaw Connections Blog, 95.1 the Bull Radio Same as above Published press release or letter to signed policies collected both before and after strategy implementation # of exterior ads before and after strategy implementation Stores with policy at end of project # of times the advertisements/m edia advocacy pieces appear or are distributed Details about how the advertisement/ media advocacy piece was distributed What message is being shared grocery stores this data will depend on the speed at which the convenience/ grocery stores create new/ modified policies for Alcohol Advertising Subcommittee Media outlets Ongoing Annually No anticipated problems/ limitations IPFS Coordinator Marketing/Outr each Committee Same as above Same as above Same as above Same as above Same as above Same as above Same as above Same as above Same as above Same as above 25 change – Type of advertiseme nts (What message is being shared) Optional: Retailer's response to advertising restrictions (complete only if you plan to use this indicator) Other: # of alcohol advertiseme nts at each convenience /grocery store the editor Same as above Interview How have these changes affected you/your business? Has it been positive/negative? What ones? Environment al scans # and placement of alcohol ads/promotions per store (before and after strategy implementation begins) Convenience and grocery store employees Convenience and grocery stores Annually Annually Annually Annually We will likely use a sample of the retailers population to gauge response to advertising restriction Assessment/Pla nning Committee No anticipated limitations/ problems Youth, Best Practices for Alcohol Advertisements Committee 26 ... Review, Facebook, Twitter, Chickasaw Connections Blog, 95.1 the Bull and 92.3 Radio, Fairway billboard co., schools, etc.) Chickasaw County 6th-10th graders Chickasaw County 6th-12th graders Ongoing... stakeholders and groups in Chickasaw County including: Chickasaw Connections coalition members, schools, teachers, youth, parents, law enforcement, juvenile court services, city and county elected officials,... following secondary data sources: • Iowa Youth Survey: IPFS staff will work with the Chickasaw County schools to ensure youth participate in the survey County- level data from the survey will be accessed