We read the 2017 NAVLE Practice Analysis Report and here’s what you need to know

NAVLE PRACTICE ANALYSIS

The most recent NAVLE Practice Analysis was completed in 2017.

• NAVLE Practice Analysis Webinar Recording (December 5, 2017)

• 2017 NAVLE Practice Analysis Report (48 pages) (pdf file)

• NAVLE Practice Analysis Executive Summary (2 pages) (pdf file)

• ICVA NAVLE Practice Analysis Press Release (1 page) (pdf file)

• NAVLE Practice Analysis Memo to Veterinary Stakeholders (2 pages) (pdf file)

To ensure that licensure examinations required for the practice of veterinary medicine remain highly job-related, the International Council for Veterinary Assessment (ICVA) has periodically conducted practice analyses, with the most recent completed in 2003, 2010, and 2017.

The Collaboration for Veterinary Assessments, consisting of the International Council for Veterinary Assessment (ICVA) and National Board of Medical Examiners (NBME), has completed the final report from a two-year NAVLE Practice Analysis process. The resulting blueprint will be used to update the North American Veterinary Licensing Examination (NAVLE®) for future administrations.

All licensing examinations are based on a practice analysis, which describes the tasks that practitioners perform in practice and the knowledge required for competent performance of those tasks. 

The NAVLE Practice Analysis Executive Summary, ICVA NAVLE Practice Analysis Press Release, and a link to the 2017 NAVLE Practice Analysis Report (all posted above) were e-mailed to ICVA constituent organizations, accredited veterinary schools, and other interested parties on October 11, 2017. The blueprint, prepared for the ICVA by the National Board of Medical Examiners, was approved by the ICVA Board of Directors in June 2017. 

The current analysis obtained information about the following characteristics of veterinary practice: (a) work context, (b) animal species and diagnoses managed, (c) clinical and professional competencies required for success, and (d) foundational and basic veterinary sciences knowledge required to appropriately perform the responsibilities of effective practice. Each of these characteristics provides important considerations when designing and developing an examination's blueprint and overall context.  For additional details visit the NAVLE Practice Analysis or Executive Summary.

Background and Overview

The role of practice analysis in developing credentialing examinations is well-established in assessment literature (APA, Kane 1982, Raymond & Luecht 2013). Given the critical importance of licensing examinations to prospective veterinarians, the field of veterinary medicine, public health, and both animal and human welfare, it is crucial that these examinations are job-related. Ensuring this involves developing examination content specifications based on practice analysis. Valid practice analysis results guide test design activities, such as determining the required knowledge and skills, selecting appropriate assessment methods, designing best-practice examination items, and defining score categories for feedback. In essence, a high-quality, valid practice analysis informs key decisions about test blueprints and content for examinations like the NAVLE, making it a cornerstone of a professional licensing system.

To maintain the job-related relevance of veterinary licensure examinations, the International Council for Veterinary Assessment (ICVA) periodically conducts practice analyses, with the most recent studies completed in 2003 and 2010. These studies involved administering questionnaires to large samples of North American veterinarians to identify common diagnoses and the frequency of various activities. The current analysis updates previous studies by surveying an even larger, more representative sample of North American veterinarians about the species they see and the diagnoses they manage. This study also extends previous analyses in two important ways: by incorporating elements of competency modeling and systematically identifying the basic science knowledge foundational to veterinary medicine.

Over the past two decades, competency modeling has become prominent in guiding personnel selection, training, and other human resource functions in various fields, including veterinary medicine. For instance, the Royal Veterinary College published a list of competencies required for veterinarians at entry into practice (Bachelor of Veterinary Medicine Day One Skills, 2007). Similarly, the North American Veterinary Medical Education Consortium (NAVMEC 2013) published a comprehensive list of core competencies required throughout a veterinary career.

The current practice analysis included competencies derived from numerous documents created by various organizations since 2007 (Appendix G). This analysis aimed to determine the frequency and importance of these competencies in practice. Additionally, the study began the process of confirming how foundational sciences are integrated into veterinary practice. An extensive review of relevant textbooks and veterinary curricula was conducted, resulting in a list of academic disciplines and specific topics within each discipline. This list will guide the NAVLE Examination Committee and other subject matter experts (SMEs) when coding new NAVLE content. NBME staff will track the content coverage to ensure appropriate emphasis on various basic science disciplines (e.g., microbiology, parasitology, anatomy) and specific topics (e.g., bacteriology, virology, nematodes, anterior cruciate ligament).

Survey Rationale

The current analysis gathered information on the following aspects of veterinary practice: (a) work context, (b) animal species and diagnoses managed, (c) clinical and professional competencies required for success, and (d) foundational and basic veterinary sciences knowledge needed for effective practice. These characteristics are crucial when designing and developing an examination’s blueprint and content.

A significant challenge in creating a comprehensive survey is keeping it concise enough for participants to complete. The 2010 job analysis had a response rate of 13.8%, which was less than ideal but acceptable. The present study employed two strategies to optimize response rates: splitting the survey into multiple sections targeted at specific groups, and designing the longest section—animal species and diagnoses managed—so that respondents only completed diagnoses relevant to their practice. An online, web-based survey used logic algorithms to route respondents accordingly.

With this introduction and overview, the remainder of this report is organized as follows: the next section explains the survey methodology, including questionnaire development, sampling, and administration. Key results are then presented, followed by a discussion of their implications for NAVLE design and content.

Survey Development

ICVA representatives met with NBME staff in December 2014 to discuss the components and logistics of a high-quality professional practice analysis, set its goals, and begin planning. A detailed project plan was developed in early 2015, followed by a literature review to assist in developing the survey instrument.

Key documents used in developing the survey included the NAVMEC (2013) report “Enduring Contributions,” OIE (World Organisation for Animal Health) publications, and current NAVLE diagnoses lists, as well as activity codes and demographic reports from the American Veterinary Medical Association (AVMA). A panel of Subject Matter Experts (SMEs) was established in May 2015 to design the survey sections. SMEs worked collaboratively to finalize the content, and a draft survey for pilot testing was approved by the ICVA board in October 2015.

Survey Structure and Content

The final practice analysis survey consisted of three sections: Demographics and Practice Characteristics, Species and Diagnoses, and Clinical and Professional Competencies. Each respondent evaluated specific species and competency statements based on their demographic responses. Foundational veterinary science components were addressed in a later supplemental activity.

Demographics and Practice Context

This section gathered participant demographic and practice information to route respondents to relevant sections of the questionnaire, verify sample comparability to known US and Canadian veterinary demographics, and compare participant groups based on various factors. The demographic questions included in the survey are in Appendix E.

Animal Species and Diagnoses

This section evaluated species and diagnoses to estimate how often veterinarians encounter specific diagnoses. It contained 1,034 diagnoses across 23 animal species, categorized by organ system (e.g., cardiovascular, gastrointestinal).

By following these steps, the ICVA aims to ensure that the NAVLE remains a relevant and effective tool for assessing the competencies required for veterinary practice.