How to Identify, Interpret and Apply the Scientific Literature to Practice

29
How to Identify, Interpret and Apply the Scientific Literature to Practice

Alonso Carrasco‐Labra, DDS, MSc, PhD*

Malavika Tampi, MPH*

Olivia Urquhart, MPH*

Scott Howell, DMD, MPH

Austin Booth, MLIS, MA

Michael Glick, DMD

* The content of this publication is solely the responsibility of the authors and does not necessarily represent the official view of the American Dental Association.

More than ever, we are inundated with biomedical and other scientific information from varied and sundry sources. Such material is readily available and can today be retrieved by anyone with access to the internet. However, this type of access comes with a certain responsibility. The traditional publishing landscape is rapidly changing, with an increasing number of journals and websites purportedly providing trustworthy and reliable information.

There has been a rapid rise in the number of predatory journals—journals that will publish any article for a fee without proper peer review, claim to be indexed on different publishing databases, and assert that they have a system of measurement that implies scientific rigor, for example high impact factors, which turn out to be of their own creation or from dubious sources—and books that offer miracle cures and recommend strange and often dangerous medical practices and interventions. Many individuals get much of their medical information from health apps and social media postings, where pseudoscientific beliefs can gain a large following and be reinforced, which generates a culture of suspicion and distrust of recognized medical norms and healthcare professionals.

In order to provide faster exchange of research ideas and research findings, several websites have emerged where articles can be posted prior to being accepted or even prior to being peer reviewed (medRχiv: www.medrxiv.org; bioRχiv: www.biorxiv.org; Preprints: www.preprints.org). Information found on these websites must be evaluated, like all non‐peer‐reviewed materials. There obviously also exists access to trustworthy and reliable biomedical information, much of which can be retrieved for free (see below).

This changing publishing landscape puts the onus on the users of biomedical information, including oral healthcare professionals, to be able to formulate focused and precise clinical queries, utilize good and efficient search strategies to find pertinent information, and, last, be able to assess and synthesize the retrieved information in order to acquaint themselves with the best available evidence and put it into practice.

DEFINING AND ASKING THE RIGHT QUESTION

There are two facets to addressing the “right question”: one when articulating a research question in order to identify an existing knowledge gap and generate research that can bridge this gap; and the other when searching for an answer to a clinical query in order to inform practice. This chapter will address the second aspect: how to formulate a clinical query to perform a thorough literature search and assess the trustworthiness and reliability of the available evidence to enhance patient care.

PICO Questions

A focused question should be relevant to a particular clinical scenario and articulated in a manner that can inform an appropriate search strategy. One approach, often utilized when performing a systematic review, is to parse a question into four different parts:

  • The patient, population, or health problem being addressed.
  • The intervention or exposure being considered.
  • The comparison intervention or exposure.
  • The clinical outcome(s) of interest.

Framing a question in this manner is often abbreviated as a “PICO” question, where the “P” represents a patient, a population, or a health condition; “I” represents an intervention or an indicator; “C” represents a comparison or control; and “O” represents an outcome. Sometimes a “T” is added—PICO(T)—representing a time element or even a type of study.

A simple example that illustrates a PICO(T) question is assessing the outcome of treating patients with aphthous ulcers with systemic glucocorticosteroids (GCS). Patients with major aphthous ulcers (Patient) that are treated with systemic GCS (Intervention) are compared to patients not receiving systemic GCS (Comparison) to assess the healing of the aphthous ulcers (Outcome) during a time period ranging from 10 to 14 days (Time). This question can be made even more granular by, for example, including only male patients, who receive only a specific dose of systemic GCS, and comparing these patients with patients who receive oral mouth rinses containing GCS (Table 29‐1).

PICO and similar frameworks need to be tweaked according to the type of question being asked. For example, clinical questions concerning therapy, prevention, diagnosis, prognosis, or etiology may have to be framed differently (Table 29‐2). Utilizing a PICO(T) framework is also helpful when treating patients in order to formulate differential diagnoses.

Table 29‐1 Example of PICO(T) questions and framework.

PICO(T) Item Specifics Example
P— patient, population, or problem being addressed Patients’ demographics, such as age, gender, and ethnicity, and overall health status
Possible subcategory of the problem
Presence of major aphthous ulcers
I—intervention or exposure What type of intervention is being considered? In case of medication, what is the dosage? How is the medication being dispensed and used (systemically or a mouth rinse)? Treatment of major aphthous ulcers with systemic glucocorticosteroids
C—
comparison intervention or control
The comparison may be no intervention, or an intervention with the same medication but with a different dosage No medication
O—
clinical outcome(s) of interest
What is the desired outcome? Are there undesired outcomes? Who will assess the outcome (the patient or the clinician)? Healing of the major aphthous ulcer
T—time frame Time from dispensing the medication to clinical examination Patient is being examined by a calibrated examiner every 3 days

Table 29‐2 Changes in the PICO framework depending on the type of query.

Question Type Ppatient, population, or problem Iintervention or exposure C
comparison intervention or control
Oclinical outcome(s) of interest
Diagnosis— discriminate patients with a disease or conditions from those without the disorder Specific disease or condition Diagnostic test or procedure, diagnosis by exclusion Accepted reference standard for that disease or condition Sensitivity, specificity, predictive values, accuracy, odds ratio, proportion of true positives, true negatives, false positives, and false negatives, likelihood ratio
Therapy—determining the effects (desirable and undesirable effects) of an intervention on relevant outcomes Patient’s disease or condition Therapeutic intervention Active intervention, standard of care, no intervention, or placebo Resolution of the disease or condition, impact on quality of life, disease frequency and incidence rate
Harm and prevention— determining the effects of an intervention or exposure considered potentially harmful on outcomes relevant to patients (e.g., downsides or adverse effects) Patient’s general health condition and risk factors Preventive measure, e.g., minimize drinking sugar‐sweetened beverages Another preventive measure, no intervention Disease frequency and incidence rate, harmful effects
Prognosis— predicting the future course of a patient’s recovery or aggravation from a disease Patients with a disease or health condition Presence of one or multiple prognostic factors Absence of one or multiple prognostic factors Survival rates, mortality rates, rates of disease progression
Etiology or causation—
determining the origin of a disease or condition
Patients at risk of a disease or condition, or comorbidities Presence of risk factors and the duration of exposure Absence of risk factors or shorter duration of exposure Disease frequency and incidence rate, rates of disease progression

PICO questions are often referred to as foreground questions, as these are more specific than background questions that address more general knowledge. Differentiating between foreground and background questions facilitates formulating a search strategy.

SEARCHING THE LITERATURE

When answering clinical inquiries, it is necessary to conduct an evidence‐based literature search. Below is an outline of search strategies that will help the oral medicine practitioner retrieve the most useful information, as well as descriptions of the commonly used evidence‐based resources.

The practice of evidence‐based oral medicine begins with articulating a clinical question (see above), and then moves to conducting a literature search for relevant information, evaluating the evidence, and using that evidence to answer the clinical question in order to make a decision in a clinical setting.

The exponential growth of complex health information is why it is essential not only to learn how to search for the best evidence‐based literature in effective and efficient ways, but to be able to evaluate that literature as well. In order to conduct complex literature searches (such as the literature searches required to conduct systematic reviews), it can help to work with a librarian or other information professional.

Search Strategies

Begin with a broad search, using only a few terms, and do not apply any search filters. There are several databases and resources available that are populated with clinical practice guidelines, synopses, systematic reviews, primary studies, and other information (Table 29‐3). (Tip: Use nouns as search terms rather than adjectives to retrieve literature that contains quantifiable results.) If researching a clinical question, the PICO framework (see above) components of population and intervention are useful in determining initial search terms. To narrow results, add additional terms using Boolean logic (Figure 29‐1). Next, employ search filters to limit results to relevant material—useful search filters include limits such as language, publication date, and study design type. If the search is retrieving too many results or too many irrelevant results, narrow the search by searching a specific field (e.g., title or abstract). Finally, if the results of the initial search are not relevant, try using Boolean logic to include synonyms (e.g., “pregnancy” for “pregnant women”) and alternative spellings (e.g., UK and US spellings) for search terms.

Table 29‐3 Databases and other resources for searching the literature.

Databases and Other Resources Website Cost Specialty of Resource
Comprehensive Resources Epistemonikos www.epistemonikos.org Free, with limited full‐text availability Clinical practice guidelines, synopses, systematic reviews, primary studies, other
Trip www.tripdatabase.com Free. A premium version is available to individuals via subscription
Summaries and Guidelines Point‐of‐Care Resources UpToDate www.uptodate.com Only available via subscription. Access to the patient content is free Summaries
ClinicalKey www.clinicalkey.com Only available via subscription
Lexicomp http://www.wolterskluwercdi.com/lexicomp‐online Only available via subscription
Guidelines ECRI* Guidelines Trust https://guidelines.ecri.org Free; must sign up for free account to use Clinical practice guidelines, guideline summaries
ADA Center for Evidence‐Based Dentistry https://ebd.ada.org/en/evidence/guidelines Free, with limited full‐text availability Clinical practice guidelines
Preappraised Resources Cochrane Library www.thecochranelibrary.com Only available via subscription Primary research, systematic reviews
PubMed http://www.ncbi.nlm.nih.gov/pubmed Free, with limited full‐text availability
MEDLINE http://www.ncbi.nlm.nih.gov/pubmed or http://www.ovid.com/site/catalog/databases/901.jsp MEDLINE records are available within PubMed for free with limited full‐text availability, or available via subscription on several different platforms
Embase www.embase.com Subscription based
Web of Science https://apps.webofknowledge.com Subscription based
Scopus https://www.scopus.com Subscription based

*  ECRI, formerly the Emergency Care Research Institute.

Schematic illustration of boolean search.

Figure 29‐1 Boolean search.

Many medical databases use controlled vocabulary—the preferred terminology used within a particular database to describe and index materials. When conducting extensive searching, examine the databases’ thesauri to identify synonyms for search terms. (Note: most medical databases will correct common misspellings, recognize abbreviations, and automatically search plurals.)

Databases and Other Resources

In order to conduct a thorough search for relevant information, search a combination of databases. Although the determination of which databases to search depends on the topic/question at hand, at a minimum search Cochrane (the gold standard for evidence‐based information), Trip (the best “preappraised” resource), and PubMed (the most comprehensive medical literature search engine; see below for database descriptions and individual search tips). Search all three of these major databases in order to avoid missing relevant material; there is less overlap among these resources than one would assume, because they cover different types of materials and the material in each is updated on different cycles. Each of these databases has a unique underlying architecture, vocabulary, and results algorithm, and therefore will return different results.

A search strategy for evidence in order to decide a course of action within a clinical setting or answer a clinical question will differ from a search strategy for conducting a literature review or a systematic review. The latter are comprehensive, the former is not. If a search is being conducted to answer a clinical question, include high levels of evidence (e.g., guidelines or systematic reviews).

If an initial search results in too many irrelevant items, the following strategies may be useful:

  • Limit the search to the title and abstract.
  • Limit the results to secondary, preappraised literature such as clinical practice guidelines, summaries, critical summaries, and systematic reviews.
  • If the search does not result in secondary literature, one strategy to narrow down the result of primary studies is to limit the search to randomized controlled trials (RCTs).
  • If a search retrieves too many irrelevant results, searching using subject headings (rather than keywords) might prove to be a more efficient search strategy. Searching by subject headings will narrow the result of the search to only those items for which the subject heading in question has been considered (indexed) as the main topic of the item. Most of the databases listed here include specialized thesauri that list the subject headings used to index articles contained in the databases.
  • At least preliminarily, set aside results published a decade or more ago.
  • Add additional PICO components to your search terms, beginning with the outcome category.

Table 29‐4 contains a list of databases that contain oral medicine–related information. An effective search strategy would begin with a search in Cochrane, followed by a search of Trip (particularly if Cochrane does not return relevant results), and then a search of PubMed to cover any potential gaps in results. Cochrane contains materials with high levels of evidence, such as systematic reviews, and is therefore an effective starting place. Because Cochrane only includes secondary materials, however, it is a smaller database than many of the others listed, and therefore may not contain all the information relevant to the topic being searched (including the most recent information). PubMed, by contrast, is the largest database listed, and will always retrieve the most results.

Begin with a search using a combination of keywords and subject headings in order to gather a sense of the results and to capture results that might be so new that they have not been assigned subject headings at the time of the search. Cochrane and PubMed share a thesauri of index terms—both databases use MeSH (Medical Subject Headings) for subject headings (see below for a detailed explanation of MeSH). Trip does not use a specialized thesaurus. After conducting the initial search, note any useful related terms and synonyms, and revise the search using all relevant search terms.

SELECTING THE RIGHT ARTICLE

Type of Clinical Information

Clinicians informing their practice using scientific literature are interested in answering questions directly related to their day‐to‐day activities. As mentioned before, such questions are classified according to their nature in four clinical areas:1,2

  • Diagnosis: establishing the ability of a test to discriminate patients with a disease or conditions from those without the disorder.
  • Therapy or prevention: determining the effect (desirable and undesirable) of an intervention on relevant outcomes (e.g., patient‐centered outcomes).
  • Harm/etiology: determining the effects of an intervention or exposure considered potentially harmful on outcomes relevant to patients (e.g., downsides or adverse effects).
  • Prognosis: predicting the future course of a patient’s recovery or aggravation from a disease.

Table 29‐4 Workflow for searching for evidence.

Type of Question/Situation Resources to Consult Level of Evidence Available
Consider first: Does a guideline for the question/situation exist?
  1. Epistemonikos
  2. Trip
  3. ECRI Guidelines Trust
  4. Point‐of‐care resources
Guidelines, guideline summaries
Therapy/prevention question (general)
  1. Cochrane Database of Systematic Reviews
  2. Trip
  3. PubMed
Critical summaries, meta‐analyses, systematic reviews, randomized controlled trials (RCTs)
Therapy/prevention question (drug therapy)
  1. Cochrane
  2. Trip
  3. Embase
  4. PubMed
Critical summaries, meta‐analyses, systematic reviews, RCTs
Harm/etiology question
  1. Cochrane
  2. Trip
  3. PubMed
Critical summaries, meta‐analyses, systematic reviews, observational studies
Diagnosis question
  1. Cochrane
  2. Trip
  3. PubMed
Critical summaries,* meta‐analyses,* systematic reviews,* cross‐sectional studies, case report/series
Prognosis question
  1. Cochrane
  2. Trip
  3. PubMed
Critical summaries,* meta‐analyses,* systematic reviews,* observational studies, case report/series

* Indicates that this type of evidence may not be available for this type of question.

Table 29‐5 Type of clinical questions and preferable type of study design.

Type of Question Example When Feasible, Preferable Study Design Preferable Source of Information for Clinicians
Harm or etiology What is the association between receiving dental radiographs and the occurrence of any type of meningioma? Cohort or case–control studies Systematic review including the appropriate type of study design for a clinical question
Diagnostic What is the diagnostic test accuracy of autofluorescence devices when triaging a seemingly innocuous oral mucosa lesion for biopsy? Cross‐sectional diagnostic test accuracy studies or
Prognostic What is the impact of different radiation dose exposures of the parotid and submandibular glands in salivary flow 3 months post radiation? Cohort studies Evidence‐based clinical practice guideline informed by systematic reviews, including the appropriate type of study design
Therapy or prevention What is the effect of using a hyperbaric chamber for preventing osteonecrosis of the jaw in a patient’s head and neck cancer undergoing radiation therapy? Randomized controlled trials

It is recommended that users of the literature correctly determine the type of question to address, as achieving this step will allow the question to be linked to the most appropriate study design (Table 29‐5). When addressing therapeutic questions, experimental designs using chance (analogous to tossing a coin) rather than convenience to allocate participants to a treatment of interest that is compared with another active intervention, placebo, or no treatment are preferable (RCTs). In the absence of such experimental types of study, clinicians can also use nonexperimental or observational types of design. In this type of study, not chance but clinicians, patients and their preferences, or simply the circumstances determine the allocation of participants to treatment arms or an exposure.

In theory, one can also answer harm questions using RCTs; however, when a potential hazard is apparent (e.g., a serious, initially unintended adverse event), the intentional assignment of participants to the potential harmful intervention is not ethical. In this case, observational studies (cohort and case–control studies) are helpful to learn about the eventual harmful effect of an exposure or intervention that has occurred or will occur, without the need for the investigator to assign participants to the study arms.

As no diagnostic test is perfect, clinicians who want to learn about the performance or accuracy of diagnostic strategies for replacing a preexisting test because it is cheaper or less invasive, for triaging subsequent test applications (e.g., a positive result warrants further investigation to confirm diagnosis, while a negative result rules out the disease), or for adding on a new test to a preexisting diagnostic workout will choose a particular type of study design. Diagnostic test accuracy studies recruit participants with a suspicion of having the condition of interest and undergo an index test or new test, while also receiving a reference test or gold standard. Then, investigators report how often the index test is in agreement and disagreement with the reference test.3

Questions of prognosis examine the presence of factors that can positively or negatively influence the future course of action of a disease or condition, with the purpose of increasing the chance of achieving better outcomes. These studies include patients with and without a particular feature or prognostic factor (e.g., age, comorbidity, educational status, etc.) and examine the extent to which this factor influences a particular outcome in the future.

It can be inferred from the variety of clinical questions and study design indications presented here that the idea of a single “evidence pyramid” placing RCTs at the top of the hierarchy as the most suitable study to inform all clinical decisions is an oversimplification, as such a depiction ignores the idea that study design on its own is not a fair indicator of trustworthiness.4 The traditional evidence pyramid is more appropriate for being applied to questions about therapy. Thus, it is strongly recommended to abandon the use of this evidence pyramid and replace it with a broader perspective, in which not a single primary study but rather a body of evidence (i.e., the group of studies informing the effect of an intervention of exposure on a particular outcome) is considered for decision‐making. The certainty that clinicians can place in this evidence then not only focuses on the risk of bias of the studies at hand, but also the consistency across their findings (i.e., studies showing similar results), the precision of their estimates (i.e., width of confidence intervals), the relevance or directness of the study to the question at hand (i.e., appropriate generalizability or applicability), and the possibility for publication bias (i.e., the extent to which all studies conducted are made available irrespective of their results).1,5,6 (For more details on study design, see Chapter 1: Overview of Clinical Research).

It is not uncommon that a new and somewhat controversial primary study attracts clinicians’ and patients’ attention, including presentations of the findings in media channels. However, clinicians should favor systematic reviews and evidence‐based clinical practice guidelines over a single study, as systematic reviews and evidence‐based clinical practice guidelines provide the full picture of all available evidence regarding a clinical question, making them more informative for the busy practitioner. In the same way that “one swallow doesn’t make a summer,” a single study outcome must be put in the context of the totality of the evidence before it is decided that a change in practice is warranted.

Causation, Association, and Correlation

Causation is important for clinical practice. Any practitioner trying to determine what is the best therapeutic strategy to treat a condition or disease, or looking for risk factors and studying their influence in the occurrence of a future event, is framing a causal question. Despite seeming simple, causal inferences are complex. In a hypothetical world where anything is possible, an investigator interested in studying the effect of the human papilloma virus (HPV) vaccine on the incidence of oropharyngeal squamous cell carcinoma (OSCC) will administer the vaccine to a group of participants, preferably a few thousand of them, and then perform follow‐up assessments to determine how many did and did not develop OSCC. In this hypothetical world, the investigators would now time‐travel back to the time before the vaccine was initially administered and enroll the same people who, in the first scenario, were vaccinated against the HPV virus and this time not administer the vaccine. The investigators would again perform follow‐up assessments and determine how many did and did not develop OSCC. Thus, in these hypothetical scenarios, the same people were both vaccinated and not vaccinated and were essentially acting as their own control group. However, in the real world where one only has access to one side of the story at a time and the alternative scenario is missing and unobserved, this is called the “counterfactual dilemma.”7

Since time‐traveling remains possible only in theory, researchers will try all sorts of methodologic strategies to access that inaccessible alternative scenario. One strategy is to have a control group that could stand in for the second (unobserved) scenario. As inferred from the time‐traveling idea, it is necessary to have a second observation—a control group—that is as similar as possible to the group receiving the experimental intervention. Hence, any time that two groups under comparison differ, the trustworthiness of an association or causality claim weakens. Additional information on causality and its frameworks can be found elsewhere.8

The terms “causation” and “association” are often used interchangeably, but while causation implies association, the opposite is not true. For example, people who consume four or more cups of coffee a day have a lower risk of presenting with actinic cheilitis (AC). This does not mean that consuming coffee provides a protective effect from suffering from AC; rather, an alternative explanation would be that those consuming a larger amount of coffee a day usually work in indoor environments, such as an office, which dramatically reduces their exposure to direct sunlight, a known risk for AC. In this scenario, sunlight exposure is a confounder—that is, an alternative explanation for both the exposure (sunlight) and the outcome (AC)—for the association between coffee consumption and AC. Thus, a causal connection cannot be claimed, and the hypothesized association is spurious.

Nor can the terms “association” and “correlation” be used interchangeably. An association refers to one variable or clinical feature providing information about another variable or clinical feature. A correlation refers to one variable or clinical feature increasing or decreasing a fixed amount for a unit of increase or decrease of the other variable or clinical feature (Figure 29.2). Thus, “correlation implies association, but not causation. Conversely, causation implies association, but not correlation.”9

Only gold members can continue reading. Log In or Register to continue

Stay updated, free dental videos. Join our Telegram channel

Nov 28, 2021 | Posted by in General Dentistry | Comments Off on How to Identify, Interpret and Apply the Scientific Literature to Practice

VIDEdental - Online dental courses

Get VIDEdental app for watching clinical videos