Hybrid Alignment Model
ACS TEAM ON PROJECT
-
Drew, Wiley, Ph.D., Partner
-
Kelley Stethen, MS Ed. Psychometric Associate
CLIENT
Test Publisher with U.S. State Department of Education
ACS was subcontracted by an educational publishing company to conduct an independent alignment study of the Science assessments developed for a U.S. State Department of Education assessment program.
PROJECT
ACS completed an independent alignment study of Science assessments as End-of-Course (EOC) in Grades 5 and 8 as well as high school. The project utilized a hybrid model for the participation of subject matter experts (SMEs). A series of virtual workshops were conducted where SMEs were trained and completed activities associated with the alignment of state standards to depth-of-knowledge. A one-day in-person workshop was also held where SMEs completed test item alignment activities. At the conclusion of all activities, ACS prepared a comprehensive report that the state can utilize moving forward with activities such US DOE Peer Review.
UNIQUE VALUE
One key feature of this design is that it allowed for the completion of all virtual alignment activities that only required non-confidential materials. The value of the in-person workshop time was maximized by working with the secure testing materials.
ACS’s effective approach of one-day in-person helped the Client with the recruitment of SMEs for the panel and helped reduce direct meeting expenses.
SUSTAINABILITY
The ACS team produced a comprehensive report at the conclusion of the workshop that the State DOE can utilize in support of the overall validity of their Science assessment programs. The final report also provided complete data and documentation that can be utilized to fulfill US DOE Peer Review requirements.