Provides leadership in the development implementation, and monitoring of strategic plans, goals, and objectives for each examination program.
Provides leadership, training and supervision to support staff.
Ensures effective communication within the department and throughout the organization.
Interviews and evaluates applicants for employment within the program as assigned.
Provides psychometric leadership in the creation and development of new examination programs and initiatives.
Creates, implements, and monitors policies and procedures related to examination development, administration, scoring, reporting, documentation, and quality control.
Provides expertise and guidance for job task or practice analyses and test plan revisions.
Monitors and evaluates operational item calibrations and performance.
Monitors new item analysis, calibration, and promotion.
Conducts periodic analyses of item parameter drift and refreshes operational item parameters as needed. Ensures that items comply with approved specifications and Association/testing industry standards.
Provides expertise and guidance in the establishment of cut scores and participates in and monitors standard setting processes and events.
Reporting & Standards
Provides expertise and guidance regarding the creation, maintenance, and documentation of performance statistics, statistical summary reports, and technical reports.
Develops and reviews reports relevant to examination program operations, including NABP, vendor, and consultant reports.
Keeps current with test and measurement standards, practices, issues, and trends through the review of literature, attendance at meetings, and communications with appropriate testing organizations; communicates with the program managers and the Competency Assessment Director regularly regarding these activities.
Provides expertise and guidance regarding the scoring of the examinations, including the preparation of scoring keys, and conducts and documents statistical analyses such as item analysis, key validation, and test equating.
Oversees all psychometric aspects of exam security including routine data forensics and the investigation of reported incidents.
Provides expertise and guidance regarding score discrepancies and irregularities as required.
Fosters and maintains good working relationships and actively cooperates with state boards of pharmacy and colleges of pharmacy regarding exam programs.
Maintains good working relationships with exam program committees; actively cooperates with state boards of pharmacy, as appropriate.
Prepares and/or presents Executive Committee and Advisory Committee on Examinations meeting reports.
Initiates research efforts, submissions, and proposals for professional journals and presentations at meetings.
Reviews the activities and work products of testing vendors and other contractors and consultants and vendors.
Ph.D. in Educational Research, Measurement, Research Methodology, Psychometrics, or a related field.
Skills in statistical analysis and previous statistical work experience.
Demonstrated proficiency with statistical systems (e.g., SPSS, SAS, BiLog, Winsteps, etc).
Conceptual knowledge of one or more of the following: classical test theory, item response theory, statistical analysis, and one or more of the following:
industrial/organizational psychology, or
Excellent communication skills,
Excellent attention to detail and accuracy,
Proven dependability and high regard for security,
Strong organizational and problem-solving abilities.
Proficiency in Microsoft Office applications.
Related field experience in data analysis, advanced measurement, testing, standard setting, and program development preferred.
To apply for this position, please email the following information to firstname.lastname@example.org:
No phone calls, please.
About National Association of Boards of Pharmacy
The National Association of Boards of Pharmacy (NABP) was founded in 1904 and represents all of the pharmacy regulatory and licensing jurisdictions in the United States, eight providences in Canada, and Australia.
Its purpose is to serve as the independent, international, and impartial Association that assists its member boards and jurisdictions in developing, implementing, and enforcing uniform standards for the purpose of protecting the public health.
NABP (1) assists the state boards of pharmacy in protecting the public health and welfare, (2) serves as an information and disciplinary clearinghouse for the interstate transfer of licensure among the state boards of pharmacy, and (3) provides model regulations in order to assist the state boards of pharmacy with the development of uniform practice, educational, and competency standards for the practice of pharmacy.