Evaluation & Assessment
About Evaluation & Assessment
The Office of Evaluation and Assessment (OEA) delivers trustworthy evaluation and assessment data and analytics to facilitate decision-making, which assists the medical education program in producing well-trained, patient-centered physicians. OEA provides high-quality service by identifying and solving problems for Texas A&M School of Medicine faculty, staff and students.
What We Provide
Other Information
Education & Curriculum Evaluation
Evaluation Process
Continuous Quality Improvement (CQI)* of Courses, Clerkships and Curricular Components
Evaluation Software
Evaluation Resources
Pre-Clerkship Evaluation Resources
• Pre-Clerkship End of Course Evaluation Form
• Pre-Clerkship Lecturer Evaluation Form
• Pre-Clerkship Small Group Facilitator Evaluation Form
Clerkship Evaluation Resources
• Clerkship: Student Evaluation of Clerkship Form
• Clerkship: Student Evaluation of Clinical Teaching Form
• Clerkship Specific Evaluation Forms:
Emergency Medicine Shift Card
Internal Medicine Clinical Evaluation of Student Form
Family Medicine Clinical Evaluation of Student Form
Psychiatry Clinical Evaluation of Student Form
Obstetrics & Gynecology Clinical Evaluation of Student Form
Pediatrics Clinical Evaluation of Student Form
Surgery Clinical Evaluation of Student Form
• Clerkship Interim Evaluation Forms:
Emergency Medicine Interim Eval Form
Internal Medicine Interim Eval Form
Family Medicine Interim Eval Form
Psychiatry Medicine Interim Eval Form
Obstetrics & Gynecology Medicine Interim Eval Form
Pediatrics Medicine Interim Eval Form
Surgery Medicine Interim Eval Form
Elective Evaluation Resources
• Clinical Elective Form
• Non-Clinical Elective Form
Other Evaluation Resources
Evaluation FAQs
Q: What is the difference between evaluation, research, and assessment?
Q: If I want to send out a survey to students, who should I contact?
A: Submit and OEA Help Ticket
Q: What evaluations/surveys does OEA send out?
A: To Faculty:
- Faculty evaluation of course (PreClerkship)
- Student Performance Evlaluations (Clerkship)
- Multi-Stakeholder Survey of the Learning Environment (MSSLE) (January of even years)
To Staff: Logistics logs-used to collect logistical feedback from coordinators about courses
To Students:
- Course and Clerkship Evaluations
* At the end of the course/clerkship
* Evaluation of course attributes and teaching - End of Phase (EoP) Survey
* After each phase of the curriculum (Pre-Clerkship, Clerkship, and Elective Phases) - Preparedness Survey
* Approximately Annually
Q: How do I access my faculty evaluations?
A: Submit an OEA Help Ticket and we will be happy to provide these to you. Please just ensure that you include your name, course(s) taught, campus, and year(s) being requested.
Q: How can I modify a course evaluation, such as ask additional questions, or ask questions about a specific course activity (workshop, small group activity, etc.)?
A: Please submit a OEA Help Ticket. Most forms have a core set of questions that are common across courses, clerkships or teaching evaluations, and these are not as easily modified. However, clerkships and courses can add up to five (5) additional questions (per track) on the end of course/clerkship form.
Q: Can we send additional evaluation forms?
A: OEA would suggest modifying the current evaluation form to reduce the number of evaluations received by students. To modify evaluation forms, please submit an OEA Help Ticket.
Assessment
The Office of Evaluation and Assessment (OEA) provides services to build, deliver, and improve the quality of assessments. OEA helps monitor and show progress towards achieving the medical education program objectives (MEPOs) through routine examination and development of student performance data in pre-clerkship courses and clerkships, USMLE Step exams, NBME exams, OSCEs, etc. Additionally, OEA strives to provide and improve quality formative and summative assessments throughout the curriculum.
OEA provides the following services:
- Working with faculty members to choose and build appropriate assessments for courses, blocks, and clerkships
- Running exam analyses to help ensure reliability
- Providing analyses to help inform the Question Review Committee
Assessment Process
Assessment Resources
Exam Tagging ListAssessment FAQs
Q.Does OEA create the exams?
A.Exams are created by faculty members and reviewed by the question review committee (QRC). The exam content is provided to OEA and OEA builds the exams.
Q.Does OEA do the grading?
A.No, OEA helps with the building, delivery and scoring of the internal exams, and OEA helps with delivery of external exams (e.g., NBME) and delivery of the outcomes.
Q.What kind of analysis is being used to keep track of reliability of the exams?
A.OEA provides item and exam level analysis using psychometric theories of Classical Test Theory (CTT) to course leadership.
Q.When is question and exam data reviewed?
A.During the course, in order to make real time grading decisions, the course directors receive question and exam psychometric data within 72 hours of each exam. At the conclusion of the courses, during continuous quality improvement (CQI) meetings, course directors review exam performance.
Q.What is the QRC?
A.QRC is the Question Review Committee. The committee is comprised of faculty members who review items for formatting and content
M.D. Curriculum Mapping
Curriculum mapping is the process of documenting all components of the curriculum to show the relationship between these components to help us understand what is being taught and to create opportunities for improvement by identifying redundancies and gaps.
Curriculum information on teaching sessions is collected through a Qualtrics survey. Requests for course teaching information are emailed to the course and clerkship directors about 6 weeks before the beginning of each course/clerkship. Please email the OEA office for more information.
Curriculum Mapping Process
Curriculum mapping is a process for collecting and recording curriculum-related data that identifies core skills and content taught, processes employed, and assessments used for each subject area and phase (grade level) (from www.educationworld.com)
Pre-clerkship Process
Clerkship Process
Curriculum Mapping FAQs
What is curriculum mapping?
Curriculum mapping is the process of indexing or diagramming a curriculum to identify and address academic gaps, redundancies, and misalignments for purposes of improving the overall coherence of a course of study. 1
Curriculum mapping is a process for collecting and recording curriculum-related data that identifies core skills and content taught, processes employed, and assessments used for each subject area and grade level 2
Curriculum mapping is the process of documenting all components of the curriculum to show the relationship between these components to help us understand what is being taught and to create opportunities for improvement by identifying redundancies and gaps.
Why do we need a curriculum map?
Curriculum mapping is the process of documenting all components of the curriculum to show the relationship between these components to help us understand what is being taught and to create opportunities for improvement by identifying redundancies and gaps.
Mapping also allows us to ensure curriculum is aligned vertical and horizontal.
It is essential that the faculty lead curriculum committee manages the curriculum as described in LCME Standards 8.1 - 8.4. Additionally, the AAMC Curriculum inventory project allows medical schools to share their mapping data to create a national “benchmarking and reporting tool on content, structure, delivery, and assessment of U.S. and Canadian medical school curricula for both M.D. and D.O. degree-granting accredited schools.”
Why do we have to submit session plan information every year?
The objectives may rarely change, but the DATA around each session DOES change year to year. For example, the length of a session, who taught the session, what order the sessions occur, or delivery method of the session (lecture vs. TBL) likely changes from year to year. Additionally, session level objectives may change from year to year or be reorganized into different sessions.
How can a curriculum map be helpful for our medical school?
(See-Why do we need a curriculum map section)
We can use the curriculum map to improve the curriculum by reviewing redundancies to ensure they are intentional and necessary and addressing gaps as science and content advances and changes over time. For example, health systems science (HSS) has become an essential element in medical education. The map can help us know what we already cover related to (HSS) and where we may want to add or change content related to these new objectives.
Moreover, the college can use resources to assist faculty and support courses with identifying better ways to teach content or ensure we are teaching and assessing the content we intended to teach and assess.
How can curriculum mapping benefit the faculty?
Course directors and faculty need to see what is taught before and after their course or their session so that curriculum is coherent between courses and across phases. The map allows faculty and the curriculum committee to ensure the curriculum is scaffolded. Scaffolding is an instructional practice where a teacher gradually removes guidance and support as students learn and become more competent.
Faculty need to ensure their individual sessions are INTEGRATED in courses taught by many different expert faculty and are appropriate in scope for the learner in that phase of the curriculum. Faculty can also connect their session content to other relevant content which aids in students creating connections between and among many different disciplines. The better the faculty understand their sessions in context the better they can instruct their students. The same is true for the curriculum committee to manage the curriculum from a global perspective.
How can curriculum mapping benefit the students?
The curriculum map very literally serves as a road map for students. They can see where they are going and where they have been. Students should be able to see what they are learning and need to learn. The map can help them manage their learning gaps.
How do faculty, staff and students have access to the map?
The COM determined this issue was our biggest issue regarding our mapping system. As of September 2021, the COM pulled our AY 20-21 map out of a commercial product and temporarily placed it in OneDrive/Teams. Access can be requested at com-oea@tamu.edu. At any time, you can also email com-oea@tamu.edu to request a search.
A new curriculum mapping software/system is in the works. Faculty, staff, and students will be given access in Fall 2022.
Research & Consultations
OEA provides research consultations to support, grow, and enhance medical education research and scholarship by providing faculty and students assistance with question and research design, analysis & statistical consulting, and access to student data.
Educational Research Process
Educational Research Resources
Educational Research FAQs
Student Resources
OEA Staff
Name | Title | Campus Location | Phone | |
---|---|---|---|---|
Danielle Dickey, EdD | Interim Senior Associate Dean of Academic Affairs | Bryan | dmdickey@tamu.edu | |
Halil Sari, PhD | Assistant Director of Assessment & Psychometrics | Round Rock, Suite N306K | hisari@tamu.edu | 512.341.4995 |
Currently recruiting | Assistant Dean of Evaluation and Assessment | |||
Jayshree Pandey, MS | Program Manager of Data Management & Visualization | Round Rock, Suite N306C | jpandey@tamu.edu | 512.341.4281 |
Alyssa Hausmann, MS | Program Coordinator | Round Rock, Suite N306J | berneche@tamu.edu | 512.341.4960 |
Stacey Keller, MBA | Sr. Administrative Coordinator | Round Rock, Suite N306E | keller@tamu.edu | 512.341.4981 |
Jody Ping, CCRC | Program Coordinator | Round Rock, Suite N306F | jping@tamu.edu | 512.341.4997 |
Darla McPherson | Education Specialist | Round Rock, Suite N306L | mcpherson@tamu.edu | 512.341.4994 |
James Dubuisson, BA |
Program Coordinator for Exam Building and Ordering | Bryan, HPEB, Suite 1083 | Dubuisson@tamu.edu | 979.436.0565 |