Job Information
PSI Services Manager, Psychometric Analytics ($120-$130K) in Albany, New York
Description
Title: Data Forensics Manager
Location: US Remote
About PSI
We are PSI Services. We power world leading tests. Delivered with trusted science and the very best test taker experience. PSI supports test-takers on their journey to pursuing dreams and gaining certifications that are important to them. They believe that their dreams are worth working for; that their dreams are worth the effort. And we believe that too. This is our core purpose, to empower people to achieve their dreams. We do this by being the best provider of workforce solutions, which foster both technology and science to deliver the best solutions for our test takers.
We are searching for top talent to join our PSI team and help grow our products and services. We have a creative, supportive and inclusive culture where we empower people in their careers to be their authentic self and make the most of their great talent.
At PSI, we are committed to helping people meet their potential and we believe that promoting diversity, equity and inclusion is critical to our success. That’s why you’ll find these ideals are intrinsic to our company culture and applied throughout the employee lifecycle.
Learn more about what we do at: https://www.psiexams.com/
About the Role
The manager, Psychometric Analytics is responsible for the detection of fraudulent test taking behaviours using advanced statistical methods and web crawling procedures. The person in this role is expected to have advanced training and expertise in measurement, research methodology, and data analytics. This person will manage a portfolio of clients and manage a team of Data Forensics Psychometricians providing guidance, training, and oversight of their assigned duties. The Data Forensics Manager will also engage opportunities to present PSI’s data forensics offering to existing and prospective clients and assist with special initiatives.
This is a full-time permanent role, with flexible hours around core office availability Monday to Friday. The role can be performed remotely, with occasional travel required for meetings, events, and workshops.
Role Responsibilities
Provide training, guidance, and oversight of Data Forensics Psychometricians and Senior Data Forensics Psychometrics assigned duties.
Facilitate goal setting and participate in performance evaluation for assigned team members.
Coordinate team member activities and tasks and provide support to meet deliverables.
Participate in load forecasting and client program assignment process.
Participate in internal process development and improvement initiatives.
Maintain awareness of industry standards and research in the area of data forensics and web crawling procedures for the purpose of test security.
Design and conduct data analytics to support the security and integrity of high stakes examination programs.
Design and conduct R&D studies to evaluate, validate, and optimize the use of secure test delivery modes and technologies (including AI), while preserving validity and fairness of assessments.
Develop and implement frameworks for data forensic analyses to detect test fraud (cheating, IP harvesting/theft, exposure, breach, drift, and other testing anomalies).
Support investigations of potential test fraud at the candidate, test site, school, and other aggregate levels.
Design and generate exam program surveillance reports, summarize and interpret findings and make recommendations.
Evaluate test items and exams to identify potential test integrity issues.
Assess the potential impact of test security breaches, cheating, and related issues.
Develop test scoring (rescoring) solutions to address security-related anomalies.
Conduct ad hoc analyses to investigate test security-related issues and special inquiries.
Comply with industry best practices, standards and guidelines for test security analytics and forensics monitoring (e.g., ATP).
Write technical reports.
Present findings to key stakeholders.
Represent PSI in the professional testing community (e.g., ATP, COTS, NCME, ICE).
Knowledge, Skills and Experience Requirements
Master’s degree or D. in Educational Measurement & Statistics, Quantitative Research Methods, Industrial/Organizational Psychology, Psychometrics, or highly related discipline.
Minimum of 5 - 7 years of experience in psychometrics, test equating, measurement-based methodologies and analyses, and advanced statistics.
Two years of experience managing the work of others.
Experience in Data Forensics including operational implementation and usage of analysis results to guide investigations preferred.
Graduate training and experience in psychometrics, measurement theory, test development, validation, item bias, standard setting.
Skill in using statistical and data science software (R, SAS, SPSS, Python), Excel, and Word required.
Experience in using of IRT software programs (i.e. Winsteps, Parscale, BILOG) and CTT applications strongly preferred.
Experience with large-scale testing programs, including Certification and/or Licensure applications preferred.
Experience with NCCA and ISO 17024 accreditation standards strongly preferred.
Benefits & Culture
At PSI, our culture is to be transparent and fair. That’s why all of our roles have been benchmarked at a competitive rate against the local market they are based in. To be transparent all of our adverts now include the salary so you can see if we align with your expectations when looking for your next role.
In addition to a competitive salary, we offer a comprehensive benefits package and supportive culture when you join us. This includes;
401k/Pension/Retirement Plan – with country specific employer %
Enhanced PTO/Annual Leave
Medical insurance – country specific
Dental, Vision, Life and Short Term Disability for US
Flexible Spending Accounts – for the US
Medical Cashback plan covering vision, dental and income protection for UK
Employee Assistance Programme
Commitment and understanding of work/life balance
Dedicated DE&I group that drive core people initiatives
A culture of embracing wellness, including regular global initiatives
Access to supportive and professional mechanisms to help you plan for your future
Volunteer Day and a culture of giving back to our community and industry through volunteering opportunities
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)