coaemsp web logo  
coaemsp logo
   
 
 
Evaluation Instruments/Program Resources
Resource Assessment Terminal Competency Form  
 
Graduate and Employer Surveys   Attrition/Retention – Student Change Status form       
     
Self Study Report Instruments Patient Encounters Tracking Tools    
 
Advisory Committee Agenda and Checklist       Program Evaluation Tools    
 

Programs are required to evaluate their services in a variety of ways, obtaining input from multiple sources. One important component is the evaluation of the appropriateness and effectiveness of the program resources. The tools on this page will support the Program when it assesses its resources throughout the year.

Resource Assessment

“The Resource Assessment Matrix is a vital tool for programs and helps them get the resources it needs.” Paramedic Program Director

Assessment of program resources is to be performed at least annually (Standard III.D) using the Program Resource Survey - Students instrument and the Program Resource Survey - Program Personnel instrument as well as any other program assessment activities. Programs are to use the Resource Assessment Matrix format to define their assessment system, collate the assessment results, and develop action plans to address deficiencies.

To assist program directors with analyzing the data collected from administering student and personnel resource surveys, a RAM and PRS Data Collection was created. This spreadsheet tallies numbers from the surveys and prepares the Resource Assessment Matrix for analysis and completion. This tool is offered as a sample and an option for program directors.

DOC   Program Resource Survey – Program Personnel
DOC   Program Resource Survey – Students
XLS   RAM and PRS Data Collection
XLS   Resource Assessment Matrix
PDF   Guidelines for administration, analysis, and implementation
of the Evaluation Instruments to support the RAM
MOV   Resource Assessment & Evaluation Processes
PDF   Resource Assessment & Evaluation Processes - FAQ
PDF   Resource Assessment & Evaluation Processes - slide deck

Terminal Competency Form

CoAEMSP has developed a Terminal Competency form that programs can use to provide consistent verification of each student's accomplishment of program competencies. The form documents successful completion of didactic, laboratory, clinical, and field internship components of the curriculum as well as affective learning domain evaluations. It also includes a section for tracking the outcomes of the individual after graduation. The form provides for the signatures of both the Program Director and the Medical Director

PDF   Terminal Competency form

Medical Director Student Review

The CAAHEP Standards and Guidelines for Paramedic educational programs require that the program’s Medical Director to “review the progress of each student throughout the program, and assist in the determination of appropriate corrective measures, when necessary” (CAAHEP Standard III.B.2.4).  To assist programs with implementing this requirement, the following interpretation was developed: “the Medical Director must demonstrate review during each phase (didactic/lab, clinical, field internship) for each student.  For example, academic advisement, end of semester testing, progress report listing each student, etcetera.”   In addition, the Medical Director must review terminal progress and sign and certify competency using a Terminal Competency Form based on the CoAEMSP provided template.  Per the CoAEMSP’s interpretations of the CAAHEP Standards: “At the conclusion of the program there must be a document signed by the Medical Director attesting to the competence of each graduate as an entry-level Paramedic. A terminal competency form for each student must contain a dated original signature by the medical director. A stamped signature is not acceptable. A secure electronic signature is acceptable.” 
 
In addition, programs are required to provide routine academic advisement/counseling.  This is in addition to counseling for cause for poor academic performance or affective domain issues.  Per the CoAEMSP’s interpretations of the CAAHEP Standards: “It is expected that the school will meet with each student at least once each academic session (e.g., semester, term, quarter) in sufficient time that the student can adequately respond to the counseling, as needed.”  This is an excellent opportunity for Medical Director involvement.  
 
The program can use various methods to track and document the Medical Director’s review of student progress toward competency.  Activities may include the Medical Director’s involvement in academic advisement sessions, participation in staff meetings that include a review of student progress, or conversations with the Program Director regarding the progress of each student.  This review must include each student (as opposed to a global comment on the cohort).  This conversation/communication can occur in-person or electronically.  The Medical Director Student Update form is one tool to facilitate and communicate the information.  This tool is not mandated but can be a convenient mechanism to provide a systematic update and platform for review.

DOC   Medical Director Student Update Form

Graduate and Employer Surveys

For each group of graduating students, programs are required to conduct surveys of those graduates and the employers of those graduates within 6-12 months after graduation using the CoAEMSP required graduate survey and employer survey items. Programs may use the CoAEMSP survey as presented or may convert the CoAEMSP items into an electronic format. Programs may add items to a program-developed survey, but cannot delete any CoAEMSP required items.

PDF   Employer Survey
PDF   Graduate Survey

Attrition/Retention – Student Change Status form

Education programs across the country are being held more accountable for program outcomes, typically including passing rates on credentialing examinations, placement of graduates, and attrition/retention of students. Of these three outcomes, retention of students tends to be the most challenging for programs. The reasons that students leave are many and varied. The CoAEMSP has set the outcomes threshold for retention at 70%.

Programs not meeting this threshold for three years are required to submit a Standard Progress Report to the CoAEMSP Quality Improvement Committee and are asked to identify the primary reasons that students leave the course.

To assist in tracking, a Sample Student Change of Status form is available that identifies academic and non-academic reasons for attrition. This form is not required but can assist the Program in analyzing attrition and developing a plan of action.

PDF   Sample Student Change of Status Form

Self Study Report Instruments

Programs preparing a self study report for inital accreditation (ISSR) or for continuing accreditation (CSSR) must survey program personnel using the Faculty Evaluation SSR Questionnaire, and must survey students using the Student Evaluation SSR Questionnaire. The Student Evaluation Questionnaire is conducted via SurveyMonkey. The link to the Student Evaluation SSR Questionnaire is automatically provided via email to the program one year in advance and again six months before the due date of the Self Study Report. The Faculty Evaluation SSR Questionnaire results must be kept on file and made available to the site visit team; do not send paper copies to the CoAEMSP.

DOC   Faculty Evaluation SSR Questionnaire

Patient Encounters Tracking Tools

Tracking patient encounters is an essential factor for accredited Paramedic programs. Several options are available for tracking tools, from individual program developed tools to commercially developed products. Here are two (2) samples of program developed tracking tools using Microsoft© Excel:

XLS   Sample 1
XLS   Sample 1 with sample data
XLS   Sample 2

Advisory Committee Agenda and Checklist

CoAEMSP has developed an Advisory Committee Agenda and Checklist form that programs can use for their Advisory Committee meetings. The Advisory Committee must meet at least once a year and review the goals, outcomes for the classes, and make recommendations to the program. In addition, Advisory Committee meetings should include a review of minimum competency requirements, including team leads, achievement of goals, analysis of goals, action plans, and results of action, and review the annual report. Advisory Committee meetings must have minutes reflecting the attendees and meaningful discussion and actions during the meeting. The form includes of all these items.

DOC   Advisory Committee Agenda and Checklist form

Program Evaluation Tools

Evaluation includes a variety of tools, administered at specific points throughout the Program.  Guidelines for administration, analysis, and implementation are identified.  The CoAEMSP is providing samples of the tools that a program may choose to use to evaluate its courses, exams, instructors, and the program. 

Instructor Evaluations. 

  • New faculty members, adjunct/skill instructors, and content experts should be evaluated with sufficient frequency to determine student reception and identify areas that require counseling or positive feedback.
  • Program Directors should observe and evaluate experienced faculty members at least annually.
  • Evaluations should be reviewed with the individuals: document notes of the topics discussed, feedback and direction provided. These observations may become part of a professional development plan.

    Course Evaluations
  • Evaluations should be distributed and collected at the end of each term. 
  • A final course/program evaluation should be required once the capstone field internship is complete.  
  • The Program Director should review the evaluations and compile a list of positives/issues using a course summary report format.
  • The course/program evaluations should be reviewed with the appropriate instructor(s).
  • The course/program evaluations and course summary report may be reviewed with the school leaders.
  • The course/program evaluations should be reviewed with the Program Medical Director.
  • Discuss any changes/revisions to the Program resulting from the analysis of the evaluations at a staff meeting and document the discussion in faculty meeting minutes.
  • Capture any other changes/revisions in writing and retain those documents.
PDF   Course Evaluation
PDF   Exam Analysis
PDF   Instructor Observation Process
PDF   Presentation Evaluation
PDF   Program Summary Report
PDF   Skill Instructor Evaluation
 
Site Map