ACS Ventures Bridging Theory & Practice Logo

Next Generation Bar Examination

Case Studies - Research & Design: Job/Practice Analysis

ACS TEAM ON PROJECT

    • Chad Buckendahl, Ph.D., Partner
    • Susan Davis-Becker, Ph.D., Partner
    • Jamie Kavanaugh, MS. Ed., Psychometrician
    • Deborah Schnipke, Ph.D., Senior Psychometrician

CLIENT

A not-for-profit corporation that develops licensing tests for bar admissions.  Client also provides testing, research and educational services to jurisdictions.

PROJECT

ACS has partnered with Client on a multi-year project to provide psychometric support and guidance. Client engaged ACS to audit and evaluate existing practices across credentials and examinations within each credential. Client also requested ACS to develop solutions that would resolve a series of challenges the program was facing that prompted a need for change management.

Some of these challenges resulted in notable program improvements, including:

    • enhanced test design to better reflect current practice,
    • increased efficiencies in test administration and scoring,
    • enhanced comparability of scores and decisions across forms,
    • reduced workload for volunteers,
    • increased understanding of the science and practice of testing for the program leadership.

ACS worked with Client senior management in redesigning its program, and considered related policy, political, and business challenges associated with any potential modifications to the program.

UNIQUE VALUE

ACS managed both the qualitative and quantitative aspects of the project. The overarching nature of the engagement with this client allowed ACS to gather in-depth information from the focus groups and comprehensive coverage of the profession through the survey.

ACS was able to navigate the complexity of licensure in this procession as it worked to identify the knowledge and skills for the next generation bar exam.

SUSTAINABILITY

The next generation bar exam is scheduled to be released in July of 2026. Using the data and analysis gathered throughout this project, Client was able to create a vision for this next version of the program and create a road map for the operational development of this program.