Researchers at Penn State University have contracted with the Pennsylvania Department of Education to lead a comprehensive evaluation of the Classrooms for the Future (CFF) initiative.    This evaluation is designed to addresses a series of research questions identified in the program's initial years, by conducting and analyzing data from classrooms observations, surveys, and interviews, as well as data provided by schools and the Pennsylvania Department of Education. 

The reports and documents available in the list above are products of the team’s work in the first two years, with the exception of the PATI survey and report, which were developed by the Metiri Group and PDE and are posted here for your convenience at the request of PDE.  The survey and observation tools we use in the CFF evaluation were developed based on previous work done by Metiri, and were modified and used with permission from Metiri.

The evaluation is in the third year, during which the CFF Evaluation Team will perform the following tasks:

Interviews

•Work with PDE to update and refine interview protocols to be used with CFF Coaches, Contacts, and Principals, and Technology Coordinators.

•Identify, train, and compensate interviewers to interview 25 CFF Coaches, 25 CFF Principals, 25 CFF Contacts, and 25 CFF Technology Coordinators in late May and early June of 2009

•Record, synthesize and describe the interview data

Classrooms Observations

•Receive data files from Casenex containing observation data from the Teaching in Pennsylvania Record (TPR) by December 1, 2008 (pre), and by July 15, 2009 (post).

•Contract with the Penn State Survey Research Center to collect data from CFF observations from all CFF schools in the 2008-9 School year (pre and post).

•Receive data files from the Penn State Survey Research Center containing data from the Classrooms for the Future (CFF) observations by December 1, 2008 (pre), and by July 15, 2009 (post).

•Review CFF and TPR observation data, reporting any data anomalies to CaseNex or the Penn State Survey Research Center for resolution.

•Analyze observation data, for teachers overall and for teachers of different subjects to answer research questions, as indicated in the attached matrix.

•Conduct CFF observer training and assist with TPR observer training.

Teacher and Student Surveys

•Contract with the Penn State Survey Research Center for the administration of both the teacher and student CFF Surveys (pre and post) for the 2008-2009 school year.

•Receive survey data files from the Penn State Survey Research Center by December 1, 2009 (pre), and by July 15, 2009 (post).

•Review survey data, reporting any data anomalies to the Penn State Survey Research Center for resolution.

•Analyze student and teacher survey data, to answer research questions, as indicated in the attached matrix, which includes the comparison of teacher and student responses.

PATI Data

•Accept and review data from relevant items on the Pennsylvania Technology Inventory (PATI) from the PDE/Metiri Group.

•Extract CFF teachers' records from the PATI data files.

•Review PATI data, reporting any data anomalies to Metiri for resolution.

•Analyze the PATI data to answer the CFF research questions.

School-based Data Analysis

•Receive data from CFF schools on teacher and student participation in CFF.

•Work with PDE data analysts to define the most appropriate way to investigate changes in attendance and discipline referrals.

•Work with PDE to extract attendance and discipline referral data for CFF schools

•Analyze differences in attendance and discipline referrals, either by comparing CFF students to non-CFF students, or by comparing pre-CFF years to CFF years.

Achievement Data Analysis

•Work with PDE to determine the most appropriate methods to analyze effects of CFF on student achievement.

•Work with PDE to develop data files that can be used to compare the academic achievement of CFF students to non-CFF students.

•Analyze data from state tests to identify any differences that may be attributed to CFF. 

Higher-Order Skills Analysis

•Using approximately 100 students from CFF schools and 100 students from non-CFF schools, examine differences between CFF and non-CFF student performance on a task requiring higher-order skills as well as measures of creativity, formal reasoning, and teamwork.

Reporting

•Produce a draft report by the end of August, 2009 addressing each of the research questions in the attached matrix, and present the drafts to the CFF Director at PDE for review.

•Revise draft report as requested by PDE.

•Produce an executive summary of the report, capturing the most important findings.

•Post the report and executive summaries on a website for public access.

Data Collection, Professional Development, and Public Relations

•Refine, implement and maintain a database that will be used to monitor completion of the surveys and observations, to promote communication that will result in high-levels of completion.

•Assist PDE in informing CFF Coaches and Building Leaders about the data collection requirements and procedures.

•Assist PDE in training CFF Observers who will collect classroom observation data.

•Present sessions at educational conferences about CFF and the evaluation process and findings.