In a recent editorial [ ], the question of selecting the appropriate method for addressing a specific dental materials research topic was addressed. A criticism was expressed about authors who, in order to justify test selection in a research paper, simply and only refer to the fact that the test was described in an ISO standard; such use has been explicitly encouraged [ ]. In considering the ramifications of this, it might be worthwhile to consider the terms ‘research’ and ‘test’ a bit more closely. According to the Encyclopedia Britannica [ ], science is any system of knowledge that is concerned with the physical world and its phenomena and that entails unbiased observations and systematic experimentation. In general, science involves a pursuit of knowledge covering general truths or the operations of fundamental laws. Research means careful or diligent search or studious inquiry, examination, investigation or experimentation aimed at the discovery and interpretation of facts. The term test is described (1) as a critical examination, observation, or evaluation or (2) as a procedure … used to identify or characterize something. In the context of statistical examination of data, a ‘test’ is used to determine the probability of an outcome against a formal ‘null hypothesis’, and thus potentially to falsify it according to the Popperian principle [ ], despite its difficulties ( e.g. Ref. [ ]). Alternatively, the word ‘test’ applies to a physical embodiment, the use of an instrument, device or experimental set-up to obtain a characterizing value for some property, or to observe some behaviour or effect, but it is also more concretely used for the test method as such. Testing, in whichever sense, is an integral part of the research endeavour, and is a fundamental component of the scientific method.
In the dental materials field, the term research may be used to describe a rather basic approach, e.g. to develop new chemistry, or discover new mechanisms of action. The term test may be used in the context of characterizing a dental material or product in direct comparison with others but also for comparison with some defined or threshold value of the tested property, and it is in this sense that international standards are frequently and properly being used. The prime intention of establishing such international standards ( e.g. ISO standards) for products is to provide test methods for those products and thus ascertain fulfillment or not of related requirements, primarily for performance and safety “rather than on chemical and/or physical properties” with consideration toward clinical relevance to contribute to improved oral and general health [ , ]. In the biological context, standards might not contain stringent ( i.e. pass/fail) requirements, but the results of such standardized tests are intended to be used within a clinical risk assessment. In any case, the aim is to set criteria for products, which – when having successfully passed these procedures – can be regarded as safe for humans and for the environment, and fit for their intended purpose [ , ]. For a number of years now such standards have also been used to test compliance with legal regulations, especially in order to permit market access for new products. This means that society has granted great trust in such standards for the protection of people and the environment, which in return means a great responsibility for those who set up and draft them. Consequently, therefore, standards bodies strive to base standards on the best available evidence, and to develop test procedures which are optimized for discriminatory power, reproducibility and comparability for use all over the world within constraints such as of expense, time, equipment and expertise availability, yet still sufficient for purpose with confidence. Accordingly, these standards are based on and contain much valid and valuable information, often to avoid pitfalls in testing, and they guarantee a certain level of methodological quality because they have been validated for their specific purpose internationally.
This valuable resource can and should be used wisely, for example when a new material or a new application method has been developed. That is, such new materials and applications ought to be tested for comparison with established procedures or products on the market in order to inform the dental community, including dental practitioners, of the potential application. Here, international standards for laboratory or in vitro testing may indeed play a beneficial role, as has clearly been outlined [ ]. In such a specific context, researchers are therefore well advised to consult such standards, if they exist for that topic. This does not, of course, mean that such tests are automatically the prime choice in every case, nor that deviations from the standards are not possible or allowed. It is the overriding responsibility of a scientist to determine which approach is the best for the particular task, making sure that there are no protocol defects that would compromise interpretation. There is a distinction to be drawn between a compliance test designed to be sufficiently discriminatory, e.g. for safety or performance, where a cost-benefit analysis is implicit, and one designed to obtain basic information on a new material, product or procedure. Nevertheless, if available, the body of standards should be regarded as a repository for methods to be seriously considered and as a valuable source of information [ ] where, quite specifically, a comparison with established products or procedures is required. Precise, easy to follow protocols, taking into account potential variables, are given in these standards. Following such a protocol exactly provides a certain level of assurance about the data derived in that context.
Thus, it is well accepted and understood, especially by the drafters, that laboratory test methods as are described in such standards may have severe limitations, some of which have been alluded to in the literature [ ]. But, this does not disqualify them per se from being used in the proper way and in the right circumstances (as outlined above). Of course, there is no such thing as the perfect test method — we are all using model-based approaches, even when testing clinically. However, in the discussion of the results of such usage, these limitations must be carefully documented, addressed in the analysis, and taken into consideration in framing conclusions. This discussion should then be the impetus for the refinement and improvement of those methods (as implied below). Indeed, such consideration beforehand is expected to be routine, and modifications of the protocol to avoid, minimize or mitigate those limitations is sound scientific method.
The rather basic oriented research domain is generally regarded as more sophisticated than what is often called “only testing”. For example, to receive extramural or non-industry funding for such testing, just to compare dental products, is virtually impossible, as opposed to obtaining funding for the basic oriented research in the field. An often-heard argument is that this sort of product comparison should be performed (and thus paid for) by industry. Also, some consider testing simply to report the mechanical properties of materials, for example, as simplistic and not “real research”. Furthermore, it is also sometimes difficult to find a platform ( i.e. , a peer-reviewed journal), which will accept a paper on such reportage, which may not be seen as advancing science. However, for the practical use of the products in dental practice, that is, to guide the dentist in selecting from the range of available products, such information may be of value, at least for the time that they are marketed and available. Both domains, the rather basic oriented research and product testing, are necessary, although it should be kept in mind that a clear demarcation between the two is not always possible. However, data from both domains should in some way be peer reviewed and publically available.
Indeed, it is clear that it would be proper for investment to be made in research which has the explicit goal of improving the methods used in standards. This could be towards improving the discriminatory power, reliability, validity of application, efficiency, economy of effort, and so on, but also with a view to refinement based on our evolving understanding of the behaviour of mechanical tests, for example, or of the chemical processes occurring in products. There are also topics for which standardization is considered to be important, yet the absence of published satisfactory test protocols, or the data on which they could be designed, suggests that such investigations, i.e. to design standards tests, would be great value. This is for instance true in biological contexts.
Accordingly, a wider appreciation of the nature of standards and standards test methods would be beneficial both to the dental materials science research community and to the drafters of those very standards. Communication between the two could be facilitated by the active involvement of bodies such as the Academy of Dental Materials and the International Association for Dental Research. This may have a carry-over for dental practice in general, of course, but given the high expectations that governments, through accreditation or licensing bodies, have for the role and practice of standardization, and the commitment of standards bodies such as ISO to meeting those expectations, it is plain that such appreciation and focused research will indeed serve the greater good and the well-being of patients.
References
Stay updated, free dental videos. Join our Telegram channel
VIDEdental - Online dental courses
