Senior Survey and Evaluation Analyst
Application Procedure:
https://careers.umass.edu/amherst/en-us/job/520356/senior-survey-and-evaluation-analyst-hybrid-opportunity
Special Instructions to Applicants
Along with the application, please submit a resume, cover letter and contact information for three (3) professional references. The search will remain open until filled.
UMass Amherst is committed to a policy of equal opportunity without regard to race, color, religion, caste, creed, sex, age, marital status, national origin, disability, political belief or affiliation, pregnancy and pregnancy-related condition(s), veteran status, sexual orientation, gender identity and expression, genetic information, natural and protective hairstyle and any other class of individuals protected from discrimination in employment, admission to and participation in academic programs, activities, and services, and the selection of vendors who provide services or products to the University. To fulfill that policy, UMass Amherst is further committed to a program of affirmative action to eliminate or mitigate artificial barriers and to increase opportunities for the recruitment and advancement of qualified minorities, women, persons with disabilities, and covered veterans. It is the policy of UMass Amherst to comply with the applicable federal and state statutes, rules, and regulations concerning equal opportunity and affirmative action.
Job Duties
Job Summary
Reporting to the Executive Director of Survey and Effectiveness Research, the Senior Survey and Evaluation Analyst collects, analyzes, interprets, and visualizes both quantitative and qualitative data. The Senior Analyst develops and implements surveys of undergraduates, graduate students, faculty, staff, and other university affiliates. The Senior Survey and Evaluation Analyst supports the work of the Executive Director and the Office of Academic Planning and Assessment (OAPA) to produce high-quality survey and evaluation data and analyses in accordance with the aims of the UMass Amherst strategic plan and to support an equity-minded culture of evidence that applies the best possible information and analysis to decisions.
Essential Functions
- Survey Research
- Designs and conducts surveys in accordance with established best practices for question design and measurement, question order and flow, visual design, ethical engagement, minimization of nonresponse, and optimization for online formats and mobile devices.
- Applies best practices to craft survey invitations and identifies appropriate incentives to maximize completion and response rates.
- Programs surveys in Qualtrics and manages resulting data to ensure confidentiality of responses, security of datasets, and ethical use of responses.
- Conducts descriptive and inferential analyses of survey response data and evaluates potential non-response associations and/or patterns.
- Analyzes open-ended survey responses including codebook development.
- Serves as an active member of the Campus Survey Coordinating Committee contributing to the work of institution-wide survey coordination and providing feedback on survey instruments, email invites, and administration plans.
- Stays current on survey design, implementation, and analysis best practices and uses knowledge of higher education issues, research methodologies, and statistics to assist with office projects.
- Data Visualization
- Creates charts, tables, and visualizations to present data clearly and commensurate with audience needs and background.
- Creates datasets and designs, codes, validates, and maintains interactive and dynamic data visualizations of survey data including dashboards.
- Develops and maintains documentation on visualization methodologies.
- Data Collection, Analysis, and Decision Support
- Develops questions for and conducts interviews and/or focus groups in-person and remotely.
- Analyzes qualitative data and interprets and presents results.
- Maintains institutional datasets and documentation to facilitate responses to survey and evaluation data/information requests.
- Provides individual and small group training related to survey design and administration and the equitable use of data to support a culture of equity-minded continuous improvement and educational effectiveness.
- Contributes to campus-wide data governance and data literacy efforts.
- Represents the Office of Academic Planning and Assessment in on- and off-campus settings.
Other Functions
- Performs other related duties as assigned or required to meet Department, Executive Area/Division, and University goals and objectives.
Job Qualifications
Minimum Qualifications (Knowledge, Skills, Abilities, Education, Experience, Certifications, Licensure)
- Master’s degree in the social sciences, measurement and evaluation, education research, or another field requiring experience with and knowledge of surveys, qualitative and mixed methods research.
- At least three (3) years of experience in survey design, implementation, and analysis. Proficiency with Qualtrics required.
- Demonstrated experience developing and applying qualitative and mixed methods including conducting interviews and focus groups, statistical analyses, response coding, and reporting.
- Proficiency with data visualization software and with data analysis and presentation tools.
- Excellent written and oral communication skills with the ability to provide technical and nuanced information and feedback to non-technical audiences and to collaborate with stakeholders at all levels of the institution and with external constituents.
- Superior attention to detail, organizational skills, and ability to work independently and accurately within specified time frames.
- Ability to work effectively with varied constituents.
- Ability to access, analyze and report on sensitive and/or not-yet-public information and to exercise care to maintain privacy and confidentially while attending to reporting transparency.
Preferred Qualifications (Knowledge, Skills, Abilities, Education, Experience, Certifications, Licensure)
- Proficiency with SPSS, Excel, and Tableau.
- The ability to conduct statistical modeling (e.g., logistic regression, propensity score analysis) or learn modeling techniques.
- Experience within a higher education setting.
Institution Description
About UMass Amherst
UMass Amherst, the Commonwealth's flagship campus, is a nationally ranked public research university offering a full range of undergraduate, graduate, and professional degrees. The University sits on nearly 1,450-acres in the scenic Pioneer Valley of Western Massachusetts and offers a rich cultural environment in a bucolic setting close to major urban centers. In addition, the University is part of the Five Colleges (including Amherst College, Hampshire College, Mount Holyoke College, and Smith College), which adds to the intellectual energy of the region.
Benefits
Benefits
https://www.umass.edu/hr/benefits-and-pay/benefits
Physical Demands/Working Conditions
- Typical office environment activity.
Work Schedule
- Monday – Friday, 37.5 hours per week (typically between 8am – 5pm EST) with occasional nights/weekends needed for deadline-driven work.
- This position has the opportunity for a hybrid work schedule, which is defined by the University as an arrangement where an employee’s work is regularly performed at a location other than the campus workspace for a portion of the week. As this position falls within the Professional Staff Union, it is subject to the terms and conditions of the Professional Staff Union collective bargaining agreement.
Salary Information
Level 29
Search for openings in IR, effectiveness, assessment, planning, and related fields at higher education institutions in the U.S. and abroad.