Evaluation Manager

Salary Grade ---------------- Case Western Reserve University is committed to providing a transparent estimate of the salary range available for this position at the time of its posting. The salary range is between $52,705 and $66,672, depending on qualifications, experience, department budgets, and industry data. Employees receive more than just a paycheck. University employees enjoy a comprehensive benefits package that includes excellent healthcare, retirement plans, tuition assistance, paid time off, and a winter recess. Job Description ------------------- POSITION OBJECTIVE The evaluation manager takes leadership in designing, developing, and implementing ongoing evaluation of medical education programs, curricula, faculty teaching, and medical student achievement in a learner\-centered curriculum. This role is responsible for oversight of evaluation tool development, data collection, management, analysis and visualization related to medical education. The evaluation manager provides expertise and support in designing, developing, and implementing evaluations to all projects overseen by the office of Medical Education Research and Evaluation (MERE). The evaluation manager will work collaboratively in a fast\-paced multi\-disciplinary environment with faculty and students in a variety of areas, including but not limited to Curricular Affairs, Student Affairs, educational research and evaluation across the School of Medicine, and medical education programs in the office of Medical Education. Responsibilities of the evaluation manager focus on the evaluation of the undergraduate medical education efforts, and other programs as prioritized by the office of medical education, with attention to program quality and effectiveness, including courses, clerkships, faculty teaching, and data collection, management, analysis, and visualization. This role manages the design, development, and implementation of the evaluation program, including tools and dashboards with limited supervision. In addition, this position is responsible for supporting key initiatives across MERE's portfolio and the office of medical education as requested by the Associate Dean of Accreditation, CQI, and Academic Analytics, and Vice Dean for Medical Education. ESSENTIAL FUNCTIONS Primary responsibility of evaluation operations within the learning management system and other data collection platforms required. This includes ensuring evaluation activities are implemented with accuracy and timeliness from programing and piloting evaluation tools to aggregation and dissemination of evaluation results to required stakeholders. Lead all aspects of LMS/data collection system evaluation needs including but not limited to survey design, updates, system settings, programming and disseminating surveys, all aspects of student communication, and results reporting. Responsible for addressing student and faculty concerns related to evaluation systems (within and outside of the learning management system) as they arise. Carry out these tasks with a high degree of autonomy and attention to detail. (20%) Lead the design and management of evaluation and quality improvement efforts with specific attention to the careful administration of a high volume of time\-sensitive instruments, analyze results, prepare reports, datasets, and visualizations. Manage, monitor, and update all data collection procedures. Conduct advanced quantitative and qualitative data collection, manage databases and all data collection relevant to medical education research and evaluation initiatives. Present summary evaluation data for necessary committees, leaders, and key stakeholders. Analyze evaluation data using mixed methods expertise. Lead reporting of data trends. Present reports to committees and councils as requested. (20%) Direct efforts related to the evaluation of the MD program(s) in collaboration with the director. Develop and implement all aspects of program evaluation projects. Collaborate with faculty and staff in designing, assessing, updating, and revising evaluation procedures in compliance with AAMC recommendations and LCME requirements. (20%) Lead program evaluation analysis efforts. Export, maintain, create and manage data and data visualizations. Express expertise in understanding evaluation data structure and technology protocol. Maintain and improve a robust program evaluation tracking and management database which combines recent and historical data from various sources. Manage communication and collaboration with the School of Medicine and University Technology teams to develop and maintain dashboards using Tableau, PowerBI, and other tools. Document and distribute materials for process improvement, data management, and automation within the designated groups. Act as the primary point of contact for process data inquiries, management, and visualization related to program evaluation. (20%) NONESSENTIAL FUNCTIONS Execute with minimal supervision other program evaluation activities and assume tasks and activities as required by the director in a timely manner. Manage communication and collaboration with other Offices (e.g., Curriculum, Assessment) for daily operations as well as strategic requests for data that consider evaluation and student performance (assessment). (5%) Respond to requests, both within and outside of the school, for evaluation information. Including information needed for required AAMC annual surveys; working with university and school departments to integrate evaluation data into centralized systems. (5%) Manage and prepare requests for data from the Educational Data Registry. Obtain IRB approval and/or uphold ethical standards and work within IRB approved protocols as appropriate. Collaborate on and/or initiate educational research and evaluation projects and proposals. Engage in educational scholarship and produce scholarly reports, publications, and presentations. (5%) Coordinate all logistics, providing minutes of meetings and preparing reports evaluation related committee requirements. Provide high level data summaries, reports, and data visualizations for committees as requested. (4%) Perform other duties as assigned. (1%) CONTACTS Department: Contact with Director of the Office of Medical Education Research and Evaluation (MERE), MERE team, Associate Dean for Accreditation, CQI, and Educational Analytics, the Vice Dean for Medical Education, Associate Dean for Curricular Affairs, Associate Dean for Student Affairs, Society Deans, Director of Student Assessment, Executive Director of Curricular Affairs, Director of Clinical Curriculum, Clinical Assistant Deans, Block Leaders, Clerkship Directors, educational and technology staff as needed University: Contact with educational leaders across the Health Sciences Campus, the Cleveland Clinic Lerner College of Medicine, the School of Medicine leadership, and University Technology External: Contact with the AAMC to respond to annual questionnaires. Students: Contact with students enrolled in the School of Medicine. SUPERVISORY RESPONSIBILITY No supervisory responsibility. QUALIFICATIONS Experience: 3 to 5 years related work experience; experience in evaluation of medical education programs preferred. Education: Bachelor's degree required; Master's degree preferred. REQUIRED SKILLS Innovative and creative evaluation professional. Expertise in statistical analysis, mixed methods approaches, and qualitative analysis. Ability to clearly communicate technical issues across stakeholders from various disciplines. Familiarity with educational innovations and best practices for education programs and student performance evaluation in other health professions at educational institutions. Leadership skills and ability to work collaboratively and efficiently with others in various settings on a timely basis. Excellent communication skills, with the ability to convey complex concepts and findings to varied audiences. Demonstrates expertise in Microsoft Office, Google Suite, and database management. Advanced knowledge of Microsoft Excel. Experience with dashboard platforms such as Power BI, Google Dashboard, Looker Studio, Tableau, Excel, etc. Mastery of common evaluation platforms (e.g., Qualtrics, Elentra) or similar web applications for building and managing online surveys and databases. Experience with accreditation processes and standards in medical education (e.g., LCME). Strong knowledge of evaluation methodologies, including quantitative and qualitative research methods, survey design, and data analysis techniques. Excellent knowledge of data analysis tools such as SPSS, Stata, and Excel. Excellent attention to detail and timeliness. Willingness to learn and work with artificial intelligence (AI) tools and technologies. Ability to demonstrate successful support, education, and advocacy for all students, aligned with the values, mission, and messaging of the university, while adhering to the staff policy on conflict of commitment and interest. Ability to meet consistent attendance. * Ability to interact with colleagues, supervisors, and customers face to face. WORKING CONDITIONS This role is in a typical office setting. Occasional evening work may be requested. This position is eligible for hybrid work. Hybrid Eligibility ---------------------- This position is eligible for hybrid work arrangement up to two remote days per week at the discretion of the department. New employees may begin a hybrid schedule upon approval from the supervisor, successful completion of an orientation period and signing the remote work checklist certification form. EEO Statement ----------------- Case Western Reserve University is an equal opportunity employer. All applicants are protected under federal and state laws and university policy from discrimination based on race, color, religion, sex, sexual orientation, gender identity or expression, national or ethnic origin, protected veteran status, disability, age and genetic information. Reasonable Accommodations ----------------------------- Case Western Reserve University complies with the Americans with Disabilities Act regarding reasonable accommodations for applicants with disabilities. Applicants requiring a reasonable accommodation for any part of the application and hiring process should contact the CWRU Office of Equity at 216\-368\-3066 to request a reasonable accommodation. Determinations as to granting reasonable accommodations for any applicants will be made on a case\-by\-case basis. .