evaluation_yr2

This is an archive of previous year's Evaluation Pages: BA Year 1, BA Year 2

=Evaluation Overview=

Introduction
//Becoming America// is required by the U.S. Department of Education to collect and analyze data about the impact of the project on teachers and their students. To meet this requirement, Dr. Diane Schilder, the independent project evaluator, will be asking //Becoming America// participants and comparison teachers to participate in the evaluation. //Note: The evaluation is not assessing individual teachers! It is only designed to assess the project itself//.

Evaluation Activities
The evaluation activities for the entire year are as follows:

- Survey 1 -- Baseline Background/Education and American History Knowledge Survey (participants completed this in late spring 2010). This survey asked questions, linked with the U.S. Department of Education requirements, to include participants' baseline American history knowledge. Survey link: [] - Survey 2 -- Post-Summer Institute Survey of participating teachers captured teachers’ perspectives about the content and format of the Institute (September 2010) - Survey 3 -- Follow-up Teacher Surveys (spring 2011) captured changes in teachers’ education and American history content knowledge. - Pre- and post-tests aligned with each lesson administered to students of participating teachers and //comparison students identified by participating teachers// (late winter 2011 to spring 2012, depending upon dates of implementation). Teachers are asked to contribute to the construction of these assessments by selecting assessment questions (See below) and creating any new items that relate specifically to the lesson. - Comparison teachers who are not participating in the project are asked to complete a web-based survey and to administer the pre and post student assessments. Participating comparison teachers receive a $5 Target gift card. Comparison teacher survey is here: []
 * Surveys**
 * Student assessments**
 * Comparison teacher data**

- During and after participation in //Becoming America// activities of participating and comparison teachers (spring 2011 through spring 2012, depending on dates of implementation).
 * Interviews, observations and informal information sharin**g

Contact Information
Dr. Schilder will be working with Teacher Learning Center Directors on these activities. If you have questions or comments, please contact Diane at 617-816-2026.

A status chart is presented below the assessment questions section.
 * Status**

**ASSESSMENT QUESTIONS**
Here is the page with the test bank of questions from which to draw: @Assessment10_items

50% or more of the questions on the pre-/post-assessment should be drawn from this test bank. These questions should be used "as is." You may write your own question or modify items from the test bank for additional items for the pre-/post- assessment.

When you have selected the test bank questions you wish to use, note the numbers of those questions on your Teachers Side page under the "Assessment" section. Include any questions you have modified or written.

Diane Schilder, Project Evaluator, will prepare the pre-/post- assessment for you and email it to you. Email her at dschilder@eval-inc.com when you have your implementation dates; please include your Director on the email as well.

IMPLEMENTATION CHECKLIST (Year 2, 2011)
ImplChecklistYr2_2011.pdf

**2010/2011 Participants Implementation Status**
Updated 3/9/2011 (Cathleen observed) || X || X ||  || X ||   || X ||
 * ** First name ** || ** Last name ** || ** Planned implementation dates ** || **Selected assessment items** || Teacher has assessment ||  || **Lesson Fully Implemented** ||   || **Checked** ||
 * ||  |||||||||||||| ** BRAINTREE PUBLIC SCHOOLS ** ||
 * Natalie || Forbes || May 16 (Meghan observed) || X || X ||  || X ||   || X ||
 * Patrick || **Condon** || May 19 (Meghan observed) || X || X ||  || X ||   || X ||
 * **Kathryn** || **Gamache** || March 28, 2011 || X || X ||  || X ||   || X ||
 * **Rachel** || ** Porter** || May 5, 2011 (Meghan observed) || X || X ||  || X ||   || X ||
 * **Deborah** || ** Vose** || May 5, 2011 (Meghan observed) || X || X ||  || X ||   || X ||
 * ** CHELSEA PUBLIC SCHOOLS ** ||  ||   ||   ||   ||   ||   ||   ||   ||
 * **Jessica ** || **Travaline** || May 26 (Meghan observed) || X || X ||  || X ||   || X ||
 * **Inmaculada** || ** Peters** || June 2 || X || X ||  || X ||   || X ||
 * **Hope** || ** Rossow** || June || X || X ||  || X ||   || ? ||
 * ** EVERETT PUBLIC SCHOOLS ** ||  ||   ||   ||   ||   ||   ||   ||   ||
 * Robert || D'Agostino || June 1, 2 (Cathleen observed) || X || X ||  || X ||   || X ||
 * **Lisa ** || **DiSalvatore ** || April 27, May 5 and May 11, 2011 (Diane observed May 5) || X || X ||  || X ||   || X ||
 * **Linda** || ** Maltais** || June 2, 8, 10
 * **Lisa ** || **DiSalvatore ** || April 27, May 5 and May 11, 2011 (Diane observed May 5) || X || X ||  || X ||   || X ||
 * **Linda** || ** Maltais** || June 2, 8, 10
 * **Helen ** || **Martin** || June 14 || X || X ||  ||   ||   ||   ||
 * **Mecky** || ** Napoli** || April 27 & 29, May 2 & 3, 2011 (Meghan observed) || X || X ||  || X ||   || X ||
 * **Mary** || ** Puleo** || April 11, 25 2011 and May 2011 (Cathleen to observe) || X || X ||  || X ||   || X ||
 * ** MALDEN PUBLIC SCHOOLS ** ||  ||   ||   ||   ||   ||   ||   ||   ||
 * **Mike** || ** Lightbody** || Fall 2011 || X || X ||  ||   ||   ||   ||
 * **Paul** || ** Mallett** || 1st or 2nd week May 2011 || X || X ||  || X ||   || X ||
 * **Colleen** || ** Synan** || Implemented March 2011 || X || X ||  || X ||   || X ||
 * ** MEDFORD PUBLIC SCHOOLS ** ||  ||   ||   ||   ||   ||   ||   ||   ||
 * **Deborah** || ** Corleto** || After April Break || X || X ||  || X ||   || X ||
 * **Kevin** || ** Cullen** || Fall 2011 || X ||  ||   ||   ||   ||   ||
 * **Michela** || ** DeBari** || Fall 2011 || X ||  ||   ||   ||   ||   ||
 * **Maria ** || **D'Orsi** || Week of May 2 || X || X ||  || X ||   || X ||
 * **Jody** || ** Liu** || Week of May 2 (Meghan observed) || X || X ||  || X ||   || X ||
 * **Kathleen** || ** O'Donoghue** || Aiming for spring 2011 || X || X ||  || X ||   || X ||
 * ** MYSTIC VALLEY REGIONAL CHARTER SCHOOL ** ||  ||   ||   ||   ||   ||   ||
 * Aaron || Minton || End of April 2011 || X || X ||  || X ||   || X ||

**2009/2010 Participants Implementation Status**
Updated 3/1/2011
 * ** First name ** || ** Last name ** || ** Planned implementation dates ** || ** Emailed evaluator to get draft assessment ** || **Planned** || **Completed** || **Checked** ||
 * ** BRAINTREE PUBLIC SCHOOLS ** ||
 * Patricia || Bagnell || May 24, 2010 || Complete || Complete || Complete || Complete ||
 * Rebecca || Drayer || June 2010 || Complete || Complete || Complete || Complete ||
 * Philip || Krall || April or May 2010 || Complete || Mid-May || Complete || Complete ||
 * Michael || Larkin || April 2010 || Complete || Complete || Complete || Complete ||
 * Jamie || Wiggin || May 3 2010 || Complete || Spring ||  || Follow up to have him send materials and sign checklist ||
 * ** CHELSEA PUBLIC SCHOOLS ** ||
 * Ilana || Ascher || April 2010 (Diane observed) || Complete || Complete || Complete || Complete ||
 * Dave || Lafontana || April 2010 || Complete || Late spring 2011 || Complete || Finished ||
 * Pete || Pappavaselio || April 2010 || Complete || Late spring || Complete || Complete ||
 * Donald || Valentine || Late May 2010 || Complete || June 1 || Complete || Complete ||
 * ** EVERETT PUBLIC SCHOOLS ** ||
 * Robert || D'Agostino || Spring 2010 || Complete || Spring 2011 || Spring || Complete ||
 * Lisa || DiSalvatore || Spring 2010 || Complete || April 2010 || May || Complete ||
 * Debbie || Hartman-McCulley || May 2010 || Spring 2011 || April 2011 || Complete || Complete ||
 * ** MALDEN PUBLIC SCHOOLS ** ||
 * Dana || Brown || March/April 2010 (Diane observed) || Complete || Complete || Complete || Complete ||
 * Coryne || Legare || Fall 2010 or later (Meghan to observe) || Spring 2011 || Complete || Complete || Complete ||
 * Ann || Pember || Completed in March 2010 || Complete || Complete || Complete || Complete ||
 * ** MEDFORD PUBLIC SCHOOLS ** ||
 * Matt || Brophy || 2010/2011 academic year || Complete || Complete || Complete ||
 * Deborah || Corleto || Spring 2010 (Ellen observed) || Complete || May/June || Complete || Complete ||
 * Jay || Griffin || June 2010 (Diane observed) || Complete || June || Complete || Complete ||
 * Nicholas || Kain || NA || NA || NA || NA || NA ||
 * Taryn || Ross || April 2010 (Diane observed) || Complete || Complete || Complete || Complete ||
 * Jonathan || Streff || 2010/2011 academic year || Complete || Complete || Complete || Complete ||
 * ** MYSTIC VALLEY REGIONAL CHARTER SCHOOL ** ||
 * Timothy || Jones || January 2011 (Diane observed) || Complete || Complete || Complete || Complete ||
 * Aaron || Minton || January 2011 (Diane observed) || Complete || Complete || Complete || Complete ||
 * Matthew || Walton || Week April 26th || Complete || Complete || Complete || Complete ||
 * Matthew || Walton || Week April 26th || Complete || Complete || Complete || Complete ||

Year 1 Surveys
All project participants completed this baseline survey. It took about 20 minutes. [|Year 1 - Pre-Survey]

All project participants completed the Post Summer Institute survey. It will took less than 10 minutes. [|Year 1 - Post Summer Institute Survey]

IMPLEMENTATION CHECKLIST
Year 1 - All 2009-2010 project participants must complete and submit this form. ImplementationChklist_form_Yr1.pdf

PARTICIPATING TEACHER SURVEY
Year 1 - This survey takes approximately 15 minutes. [|Participating Teacher Spring 2010 Survey]

COMPARISON TEACHER SURVEY
=== Year 1 - This survey takes approximately 15 minutes. To thank you for your involvement in our project, when you complete both this survey and administer the student assessments (pre- and post-tests), you will receive a $5.00 Target Gift Card. [|Comparison Teacher Spring 2010 Survey] ===