Skip to main content
Download PDF

Developing a modular architecture for creation of rule-based clinical diagnostic criteria

BioData Mining volume 9, Article number: 33 (2016) Cite this article

Abstract

Background

With recent advances in computerized patient records system, there is an urgent need for producing computable and standards-based clinical diagnostic criteria. Notably, constructing rule-based clinical diagnosis criteria has become one of the goals in the International Classification of Diseases (ICD)-11 revision. However, few studies have been done in building a unified architecture to support the need for diagnostic criteria computerization. In this study, we present a modular architecture for enabling the creation of rule-based clinical diagnostic criteria leveraging Semantic Web technologies.

Methods and results

The architecture consists of two modules: an authoring module that utilizes a standards-based information model and a translation module that leverages Semantic Web Rule Language (SWRL). In a prototype implementation, we created a diagnostic criteria upper ontology (DCUO) that integrates ICD-11 content model with the Quality Data Model (QDM). Using the DCUO, we developed a transformation tool that converts QDM-based diagnostic criteria into Semantic Web Rule Language (SWRL) representation. We evaluated the domain coverage of the upper ontology model using randomly selected diagnostic criteria from broad domains (n = 20). We also tested the transformation algorithms using 6 QDM templates for ontology population and 15 QDM-based criteria data for rule generation. As the results, the first draft of DCUO contains 14 root classes, 21 subclasses, 6 object properties and 1 data property. Investigation Findings, and Signs and Symptoms are the two most commonly used element types. All 6 HQMF templates are successfully parsed and populated into their corresponding domain specific ontologies and 14 rules (93.3 %) passed the rule validation.

Conclusion

Our efforts in developing and prototyping a modular architecture provide useful insight into how to build a scalable solution to support diagnostic criteria representation and computerization.

Peer Review reports

Background

Introduction

Diagnostic criteria are one of the most valuable knowledge sources for supporting clinical decision-making and improving patient care [1–4]. The clinical informatics research community has been seeking a solution to standardize and computerize clinical diagnosis criteria for all clinical domains. Diagnostic criteria are usually scattered over different media such as medical textbooks, literatures and clinical practice guidelines mostly in textual format. Furthermore, they are usually described in different narrative style, granularity, term usage and inner logic. There is an urgent need to develop a standard information model specification and a unified architecture to support the diagnostic criteria modeling and representation, and thereby enabling computerization and machine interpretability. To achieve a unified architecture, the following aspects should be considered: a) an information model that supports standard representation of diagnostic criteria; b) semantic interoperability and expressivity of a knowledge representation language; c) rule-based reasoning capability over factual knowledge; and d) a standard exchange format for different layers of the architecture.

The content model of the International Classification of Diseases (ICD)-11 developed by the World Health Organization (WHO) is a structured framework that defines “a classification unit” in ICD in a standard way in terms of its components that allows computerization [5]. Under the definition of the content model, each ICD entity can be seen from different dimensions and there are currently 13 main dimensions in the content model. One purpose of the ICD-11 content model is to use different settings of these dimensions or parameters to construct different sets of diagnostic criteria, so different elements in the content model come together to define the diagnosis criteria of a particular ICD category. The ICD-11 content model entails a diagnostic criteria computerization at a high level and it has achieved consensus among the members in the ICD Revision Group, thus we regard it as a feasible framework for constructing a unified architecture for computable diagnostic criteria creation.

The Quality Data Model (QDM) [6] is an information model that describes clinical concepts in a standardized format to enable electronic quality-performance measurement in support of the Meaningful Use Program of the Health Information Technology for Economic and Clinical Health Act [7, 8]. It allows electronic clinical quality measure (eCQM) developers and many clinical researchers or performers to describe clearly and unambiguously the data required to calculate the performance measure. QDM enables electronic health records (EHR) and other clinical electronic system to share a common understanding and interpretation of the clinical data. To describe different parts of the clinical care process, QDM defines many datatypes to specify the context in which each category is used. As a QDM serialization format, the Health Quality Measure Format (HQMF) [9] is a HL7 standard that formally represents a eCQM (data elements, logic, definitions, etc.) as an electronic document to support consistent and unambiguous interpretation.

Semantic Web technologies provide a homogeneous framework that enables an ontology-based modeling with the Web Ontology Language (OWL) [10] and supports rule-based reasoning with the Semantic Web Rule Language (SWRL) [11]. In a semantic web environment, OWL is a W3C recommendation for ontology description and modeling and SWRL is a rule language to formalize and represent rules to support knowledge representation and reasoning. In the present study, we utilize and evaluate OWL and SWRL-based representation languages for formalizing complex inner logic for diagnostic criteria.

The objective of our study is to develop and evaluate a modular architecture for enabling the creation of rule-based clinical diagnostic criteria leveraging Semantic Web technologies. We prototype and evaluate a number of key components of the architecture, including an upper ontology and a transformation tool. We select a collection of QDM datatypes that are commonly used in describing diagnostic criteria and integrated them into ICD-11 Content Model for building an upper ontology. We perform the rule-based criteria translation and interaction following the HQMF standard format and propose extensions where needed.

Related work

Previous studies have been conducted in integrating and formally expressing diagnostic rules from different perspectives. These rules are usually extracted from free-text-based clinical guidelines or diagnostic criteria, and integrated into computerized decision support systems to improve clinical performance and patient outcomes [12, 13]. The related studies mainly include as follows.

  1. (1)

    Clinical guideline computerization and Computer Interpretable Guideline (CIG) Systems. Various computerized clinical guidelines and decision support systems that incorporate clinical guidelines have been developed. Researchers have tried different approaches on computerization of clinical practice guidelines [12, 14–18]. Since guidelines cover many complex medical procedures, the application of computerized guideline in real-world practice is still very limited. However, the methods used to computerize guidelines are valuable in tackling the issues in diagnostic criteria computerization.

  2. (2)

    Formalization method studies on clinical research data. Previous studies investigated the eligibility criteria in clinical trial protocol and developed approaches for eligibility criteria extraction and semantic representation, and used hierarchical clustering for dynamic categorization of such criteria [19]. For example, EliXR provided a corpus-based knowledge acquisition framework that used the Unified Medical Language System (UMLS) to standardize eligibility-concept encoding and to enrich eligibility-concept relations for clinical research eligibility criteria from text [20]. QDM-based phenotyping methods used for identification of patient cohorts from EHR data also provide valuable reference for our work [21].

However, few studies are directly related to building a unified architecture to support the goal of diagnostic criteria formalization. In particular, the lack of a standards-based information model has been recognized as a major barrier for achieving computable diagnostic criteria [22]. Fortunately, current efforts in the development of international recommendation standard models in clinical domains provide valuable references for modeling and representing computable diagnostic criteria. The notable examples include the ICD-11 content model [5, 23] and the National Quality Forum (NQF) QDM [21, 24, 25].

Methods

Materials

WHO ICD-11 content model

WHO developed a content model to represent the knowledge that underlies the definition of an ICD entity [23]. The content model is composed of three layers: a foundation layer, a linearization layer, and an ontological layer. The foundation layer is the core product of the ICD-11 revision that stores the full range of knowledge of all classification units in ICD. Each ICD entity can be seen from different dimensions. The content model represents each one of these dimensions as a parameter. Currently, there are 13 main parameters defined in the content model to describe a category in ICD-11, as shown in Table 1 [5]. “Diagnostic Criteria” is one of the main parameters for describing an ICD category.

Table 1 The ICD11 Content Model Main Parameters
Full size table

NQF QDM

QDM consists of two modules: a data-model module and a logic module. The data-model module includes the notions of category (e.g., Medication), datatype (e.g., “Medication, Administered”), attribute (e.g., information about dosage, route, strength, and duration of a medication), and value set comprising concept codes from one or more terminologies. The logic module includes logic operators, functions, comparison operators, temporal operators, subset operators. As mentioned above, the HQMF provides a standard format to render the QDM-based criteria (i.e., instance data) in XML format using a collection of templates. In a previous study [26], we evaluated the feasibility of using QDM for representing diagnostic criteria through a data-driven approach and suggested that common patterns informed by QDM are useful and feasible in building a standards-based information model for computable diagnostic criteria. In this study, we used the common patterns and selected a collection of QDM datatypes and attributes for developing an upper ontology.

System architecture

The overall system architecture for the creation of rule-based clinical diagnosis criteria is shown in Fig. 1. The system architecture contains two major modules: one is an authoring module that utilizes a standards-based information model and the other is a translation module that leverages SWRL. The first module of the architecture contains an upper ontology that supports the element organization of diagnostic criteria. We integrated a collection of manually selected ICD-11 content model elements and QDM elements informed by the analysis of real-world diagnostic criteria [26]. The first module also contains a unified web user interface that supports collecting and authoring diagnostic criteria by clinicians or subject matter experts. Standard QDM model serves as a foundation layer for the downstream translation and reasoning. All collected data elements, value sets and logic expressions of diagnostic criteria are formalized using QDM-based HQMF templates. The second module of the architecture contains a rule translation engine that converts diagnostic criteria represented in QDM/HQMF format into a domain-specific diagnostic criteria ontology and a set of rules using SWRL.

Fig. 1
figure 1

Overall System Architecture for Creation of Rule-based Clinical Diagnosis Criteria

Full size image

Developing a standard-based diagnostic criteria upper ontology

The purpose here is to integrate existing standard information models relevant to modeling of diagnostic criteria by expert review and manual editing. As previously mentioned, we choose the ICD-11 content model and NQF QDM as reference information models. Our work in this stage is to create the diagnostic criteria upper ontology (DCUO) through the integration of ICD-11 content model with those QDM elements commonly used in diagnostic criteria. We evaluated the distribution of the QDM elements using a collection of textual diagnostic criteria. The selection of these QDM elements was informed by the results from a previous study [26]. We selected 10 QDM datatypes and 4 QDM attributes and integrated them with ICD-11 content model-based ontology schema. Table 2 shows a list of the QDM datatypes and attributes used for the integration. We used Protégé ontology editing environment [27] for manually integrating these two standard information models into a diagnostic criteria upper ontology.

Table 2 A list of selected QDM datatypes and attributes for developing the upper ontology
Full size table

We merged these two information models manually by conducting both concept and property analysis. Specifically, ICD-11 content model contributes a well-defined concept schema with general concepts that provide a systematic view of disease, whereas the QDM contributes more specific elements of disease diagnosis. Therefore, we chose all classes defined in the ICD-11 content model as our fundamental classes of DCUO, and named them by a prefix “ICD:” in conjunction with its original class name. QDM datatypes (with a prefix “QDM”) as the subclasses merged with ICD-11 content model classes. The mappings of the merged classes and integrated properties are shown in the Table 3. In total, four QDM attributes are integrated into the DCUO as object properties [26]. In addition, we also defined a number of new classes in the DCUO so that they can be used for supporting the SWRL rule construction and reasoning. Currently DCUO includes 3 newly defined classes (with a prefix “DCUO”): Patient, Unit, and Evidence.

Table 3 The Concept Integration between QDM Datatypes and ICD-11 Content Model Elements
Full size table

Transforming QDM templates into domain-specific diagnostic criteria ontology

The DCUO provides a schema of general diagnostic criteria representation. To build a scalable diagnostic rule translation environment, it is important to dynamically populate the DCUO with domain-specific elements and produce a Diagnostic Criteria Domain Ontology (DCDO) for a specific disease or condition, e.g. the DCDO for AMI (Acute Myocardial Infarction). DCDO extends the DCUO by adding the disease-specific sub-classes, attributes and instances, and the number of elements incorporated in a DCDO depends on the complexity of the diagnosis criteria. For example, the QDM elements extracted from the AMI diagnostic criteria are shown in an Supplementary File [see Additional file 1]. Each QDM element can be represented in a structured format using one of the HQMF templates [see Additional file 2]

To transform each QDM/HQMF template into a DCDO, we designed rule-based pipelines that support data extraction from diagnostic criteria encapsulated by a template. The parsing tool decomposed a HQMF template into different parts and populated the parsed elements into the DCDO that supports for the representation of a particular ICD disease. Therefore, to create a domain-specific DCDO, it requires three kinds of input data: the DCUO, a group of disease diagnosis criteria rendered in the QDM/HQMF templates, and a group of parsing rules for these templates. As previously mentioned, the DCUO is an upper-ontology that we created for general use and is applicable for all diagnostic criteria. And the rule-based HQMF XML template parsing and populating are core tasks in this transforming implementation. For example, Table 4 shows the QDM/HQMF templates we used to develop an AMI DCDO.

Table 4 HQMF templates used to represent the AMI diagnostic criteria
Full size table

According to the structured representation of the QDM/HQMF templates, the general rules to populate DCDO from the HQMF templates are:

  1. (1)

    Locate the class of {$datatypeName}, such as “Laboratory Test, Result”;

  2. (2)

    Extract $valueSetName from HQMF XML tag < title > “{$datatypeName}: {$valueSetName}” </title>;

  3. (3)

    Insert $valueSetName into DCUO as the subclass of this class, for example, “cTn Test” as the subclass of “Laboratory Test, Result”;

  4. (4)

    Extract properties elements from HQMF structured templates;

  5. (5)

    Insert properties into DCUO as the annotation properties of this class.

Specifically, we analyzed the structure of HQMF templates, and developed a parsing tool to extract elements of each template. Figure 2 shows two HQMF template examples and their parsing rules. The upper part of Fig. 2 is the parsing of the Laboratory template “Laboratory Test, Result” (hqmf r1 template - 2.16.840.1.113883.3.560.1.12) and the lower part is the parsing of the Transfer of Care template “result-comparison” (hqmf r1 template - 2.16.840.1.113883.3.560.1.1019.3). Other templates (not shown) are parsed by a similar approach.

Fig. 2
figure 2

XML Parsing of the HQMF template “Laboratory Test, Result” (hqmf r1 template - 2.16.840.1.113883.3.560.1.12) and “Result-Comparison” (hqmf r1 template - 2.16.840.1.113883.3.560.1.1019.3)

Full size image

And then, we created mapping rules between the extracted XML elements and the elements in the DCUO ontology. Table 5 shows the mappings rules of two HQMF templates (2.16.840.1.113883.3.560.1.12 and 2.16.840.1.113883.3.560.1.1019.3). After populating the extracted elements into the DCUO, a domain-specific DCDO is produced [see Additional file 3]. The dynamics of DCDO are reflected by the variables of a template, such as “$valueSetOID”, and “displayName”. There are also a number of constants that maintain the metadata of each template.

Table 5 Integrating elements of HQMF template “Laboratory Test, Result” into DCUO
Full size table

Automatic rule composition and validation

After having a DCDO ontology produced, we developed JAVA-based algorithms using Protégé OWL API and SWRL API for conducting automatic rule composition and rule validation. These APIs are also responsible for rule assembling and rule grammar checking.

The SWRL syntax contains two parts: Body and Head. The Body part is also called the antecedent and the Head part is the consequent of the rule. There are 7 atom types that can be used as the components of the Body and Head: class, individual property, same individual, different individual, data valued property, built-in atom and data range [28].

Adhering to the SWRL structure and grammar, we designed a collection of translation algorithms that automatically extract the SWRL rule elements from the logic components of an HQMF XML template and then assemble these rule elements into the SWRL syntax.

For example, Table 6 shows the HQMF XML representation of a QDM-based criterion “Laboratory Test, Result: LDL-c (result < 100 mg/dL)”. The criterion is composed by two HQMF templates: the template “Laboratory Test, Result” (hqmf r1 template - 2.16.840.1.113883.3.560.1.12) and the template “result comparison” (hqmf r1 comparison template - 2.16.840.1.113883.3.560.1.1019.3). Our translation algorithms then automatically extract the SWRL rule elements from the logic components of the two templates and then assemble these rule elements into the SWRL syntax. The translation processing is shown in Table 7.

Table 6 The example of HQMF XML representation of the QDM-based criterion
Full size table
Table 7 The Steps for Translating Individual Criteria to a SWRL Rule
Full size table

Each rule is generated from an individual criterion. After each rule is composed, our algorithms could aggregate these individual rules with logic operators for the diagnosis reasoning.

Evaluation design

First, we evaluated the domain coverage of the ICD-11 content model for representing diagnostic criteria. We collected 20 diagnostic criteria from different clinical topics and manually annotated them with the elements in the ICD-11 content model.

Second, we evaluated the translation algorithms in the following two aspects: ontology population and rule generation. Currently,we tested the ontology population algorithms using 6 HQMF templates. The 6 HQMF templates are listed in Table 8. The first author (NH) assessed whether they are correctly parsed and represented in the domain ontology, and the assessment results were verified by the other three co-authors.

Table 8 A list of the HQMF templates used for the evaluation
Full size table

We then tested the rule generation algorithms using 15 QDM-based criteria represented in HQMF XML format. All the 15 criteria are selected from existing clinical quality measures [29] that use the HQMF template - “Laboratory Test, Result” (hqmf r1 template - 2.16.840.1.113883.3.560.1.12). We used Protégé SWRL API to validate the syntactical correctness of the generated SWRL rules. The first author assessed the semantic correctness of the generated SWRL rules through comparing the HQMF XML-based logic with SWRL rule logic and the assessment results were verified by the other three co-authors.

Results

DCUO development and evaluation

Figure 3 shows a screenshot of the classes and properties integrated in the DCUO in Protégé ontology editing environment. There are 14 root classes, 21 subclasses, 6 object properties and 1 data property in the ontology. In this ontology, 22 classes came from the ICD-11 content model with the namespace prefix ‘ICD’, 10 of the classes are integrated from the QDM datatypes with the namespace prefix ‘QDM’ and 3 classes with the namespace prefix ‘DCUO’ created for the need of representing diagnostic criteria in the SWRL rules.

Fig. 3
figure 3

The Protégé Screenshots for the Diagnostic Criteria Upper Ontology (DCUO)

Full size image

We also evaluated the domain coverage of ICD-11 content model elements in annotating diagnostic criteria. Table 9 shows distribution of annotations based on ICD-11 content model elements. The results showed that Investigation Findings, and Signs and Symptoms are the two most commonly used element types in diagnostic criteria description. The results are consistent with the analysis we did for the QDM elements in a previous study [26].

Table 9 Distribution of annotations based on ICD-11 Content Model Elements
Full size table

Translation algorithms evaluation

To extract elements in each HQMF template, we developed a collection of JAVA-based XML parsing and mapping algorithms. The algorithms automatically extract elements from HQMF templates and convert them into corresponding DCDO elements. As the evaluation results, all 6 HQMF templates are successfully parsed and populated into their corresponding DCDO ontologies. Human-based review confirmed that the elements in the templates are correctly represented in the target ontology.

For the rule generation algorithm evaluation, in total, 15 SWRL rules were generated from 15 QDM/HQMF-based individual criteria. Table 10 shows a list of the 15 QDM/HQMF-based criteria and the syntactic validation results using the Protégé SWRL validation tool. Of them, 14 rules (93.3 %) passed the rule validation whereas one rule (6.7 %) failed to pass. Human-based review analysis found that the failure was caused by an invalid expression ‘[copies]/mL’ that contains special characters ‘[’ and ‘]’. Human-based review also confirmed the semantic correctness of all 15 generated rules.

Table 10 A list of 15 QDM/HQMF-based criteria and the validation results
Full size table

Implementation of a translation pipeline prototype

For implementing our rule generation algorithms, we assembled a computational pipeline (See Fig. 4). A prototype of a web-based interface is developed for the pipeline as shown in Fig. 5. The prototype allows users to upload a QDM/HQMF file and the DCUO file, and generate a collection of corresponding SWRL rules.

Fig. 4
figure 4

A Pipeline of SWRL Rule Generation

Full size image
Fig. 5
figure 5

A Prototype Implementation of a HQMF to SWRL Translation Pipeline with a Web Interface

Full size image

Discussion

There are three main contributions in this study. First, we created two types of ontologies (DCUO and DCDO) to build a flexible knowledge representation framework for representing clinical diagnostic criteria. Second, we developed automatic rule translation methods that are built on standard data model and data structure. This will ensure that the system is extensible and can be used to enable extensive support for representation and computation of diversified diagnostic criteria. Third, system architecture supports reuse of existing standards from the perspectives of information model, terminology services and technical interface.

In this study, we developed a modular architecture to support the authoring and formalization of diagnostic criteria knowledge leveraging Semantic Web OWL and SWRL technologies. Semantic Web technologies provide a scalable framework for standards-based knowledge representation and reasoning and could support the diagnostic criteria representation in a machine-readable and interpretable way. The diagnostic criteria upper ontology and domain-specific ontology are all represented in OWL which provides a foundation for coding SWRL rules. And the rules generated from QDM HQMF-based criteria are formalized and represented in SWRL that leverages the full reasoning power of OWL DL when invoking a rule engine.

For the DCUO building module, we integrated the elements of the ICD-11 content model and the QDM model based on the investigation of the concept and attribute distribution of real-world diagnostic criteria. The elements used to build DCUO are evaluated by our analysis on a number of randomly selected diagnostic criteria collected from a variety of domains. Through a manual integration, we built a fundamental knowledge organization schema that can be used to support representing diagnostic criteria for a particular domain. Current editing work is performed in the Protégé editor environment. We plan to release the DCUO ontology through the National Center for Biomedical Ontology BioPortal [30] for the community-based review and feedback.

For the rule translation engine module, the QDM-based HQMF templates are used as an intermediate standard interface that supports the communication between DCUO and those elements (e.g., individuals, standard codes and logic rules) that exist in the HQMF XML diagnostic criteria. All the rule atoms are parsed and extracted from an HQMF XML file and composed into the SWRL rules, and a DCDO is populated from the instance data encapsulated in the HQMF XML file. These generated rules and DCUO could be aggregated and used for reasoning against patient data for a particular disease in the future. Currently, our rules are evaluated on a particular QDM datatype (i.e., Laboratory Test, Result) that involves 6 HQMF templates, and the results show that the accuracy of the translation is above 90 %. Using the same principle, we consider that the HQMF parsing algorithms could achieve similar performance on the QDM datatypes in other QDM categories such as Symptom, Patient Characteristic, Diagnostic Study.

From the perspective of data standardization, following the rationale of the ICD-11 content model, the full range of different values for a given parameter would be predefined using standard terminologies and ontologies. In this study, the QDM-based criteria extracted from the CQMs took advantage of the predefined value sets in the National Library of Medicine Value Set Authority Center (VSAC)Footnote 1. During our translation work, the value set metadata are automatically parsed and extracted from the HQMF XML file. Considering current VSAC does not include all the value sets associated with diagnostic criteria, our system architecture will support the extension of value set definitions in the future. In addition, we also plan to extend the web-based application functionalities as follows: 1) Ontology display and update; 2) Diagnostic criteria authoring by clinicians and domain experts, including value set services invoking and semi-automatic workflow for criteria editing.

There are a number of limitations in this study since the present study is mainly focused the feasibility of our proposed architecture. First, the DCUO (Diagnostic Criteria Upper Ontology) was reviewed for consensus and quality assurance only by a relatively small group (i.e., four authors). In the future, a rigorous ontology evaluation by a panel of experts from relevant domains will be useful in achieving consensus in terms of the vocabulary, syntax, structure, semantics, representation and context of the DCUO. We plan to use ontology evaluation methods as described by Vrandečić [31]. Second, we have not considered all complex conditions and details in the modeling of diagnostic criteria. For instance, the following problems need to be further considered.

  • In the QDM model, the semantics of some templates are not expressed explicitly. For example, the QDM element ‘Patient Characteristic Birth Date’ is used to represent the numeric value comparison of the variable “Patient Age” (e.g. <low value=’18’ unit=’a’ inclusive=’true’/>), assuming the value of the variable “Patient Age” could be derived from the ‘Patient Characteristic, Birth Date’.

  • In the present study, we have implemented translation algorithms only on a limited number (n = 6) of HQMF templates and the preliminary evaluation demonstrated that the translation performed is reasonably well. However, in total, there are 186 HQMF templates from diverse domains and these HQMF templates are updated continuously, so maintaining the transportability and reusability of the translation algorithms will be a challenge.

  • For the diagnostic criteria rule generation using SWRL, the inclusion criteria are well supported by the built-in rule grammars, such as: comparison, mathematical functions, booleans, string and date/time. We understand that some of exclusion criteria could not be explicitly expressed in SWRL due to that negated atoms or disjunctions are not supported in SWRL.

In the future, we plan to improve our work from the following aspects: 1) to improve the system functions such as the DCDO enrichment, rule generation and computerized criteria display and execution; 2) to enhance diagnostic criteria annotations using the natural language processing (NLP) so that large amount number of diagnostic criteria text can be transformed into QDM-based structured format in a semi-automatic approach; 3) to execute diagnostic criteria against large scale patient data for target diseases.

Conclusions

In this study, we developed a modular architecture for the creation of rule-based diagnostic criteria. We demonstrated the feasibility of prototyping a number of key components of our proposed architecture for diagnostic criteria knowledge modeling and reasoning. It remains a very complex field to explore and more semantic and syntactic features dealing with complexity of diagnostic criteria need to be further studied. Our efforts provide useful insight into how to develop a scalable, semantic-oriented and standards-based solution to support diagnostic criteria formalization and computerization.

Notes

  1. https://vsac.nlm.nih.gov/

Abbreviations

HQMF:

Health quality measure format

ICD:

International classification of diseases

QDM:

Quality data model

SWRL:

Semantic web rule language

WHO:

World Health Organization

References

  1. Yager J, Mcintyre JS. DSM-5 clinical and public health committee: challenges and considerations. Am J Psychiatr. 2014;171(2):142–4.

    Article  PubMed  Google Scholar 

  2. Haug PJ, Ferraro JP, Holmen J, Wu X, Mynam K, Ebert M, et al. An ontology-driven, diagnostic modeling system. J Am Med Inform Assoc. 2013;20(e1):e102–10. doi:10.1136/amiajnl-2012-001376.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Donfack Guefack V, Bertaud Gounot V, Duvauferrier R, Bourde A, Morelli J, Lasbleiz J. Ontology driven decision support systems for medical diagnosis - an interactive form for consultation in patients with plasma cell disease. Stud Health Technol Inform. 2012;180:108–12.

    PubMed  Google Scholar 

  4. Bertaud-Gounot V, Duvauferrier R, Burgun A. Ontology and medical diagnosis. Inform Health Soc Care. 2012;37(2):51–61.

    Article  PubMed  Google Scholar 

  5. Organization WH. ICD-11 Alpha Content Model Reference Guide, 11th Revision. Geneva, Switzerland: World Health Organization; 2011.

    Google Scholar 

  6. CMS. Quality Data Model,Version 4.2. 2015. https://ecqi.healthit.gov/system/files/qdm_4_2_aug_2015.pdf. Accessed 22 Feb 2016.

  7. Electronic Health Records (EHR) Incentive Programs. https://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/index.html. Accessed 28 Feb 2016.

  8. Kallem C. Transforming clinical quality measures for EHR use. NQF refines emeasures for use in EHRs and meaningful use program. J AHIMA. 2010;82(11):52–3.

    Google Scholar 

  9. National Quality Forum. HQMF Templates for QDM December 2013. http://www.healthit.gov/sites/default/files/qdm_hqmf_templates_dec2013.pdf. Accessed 18 Oct 2016.

  10. W3C. OWL Web Ontology Language Overview. https://www.w3.org/TR/owl-features/. Accessed 22 Feb 2016.

  11. Horrocks I, Patel-Schneider PF, Boley H, Tabet S, Grosof B, Dean M. SWRL: A semantic web rule language combining OWL and RuleML. W3C Member Submission. 2004;21:79.

    Google Scholar 

  12. Trivedi MH, Kern JK, Marcee A, Grannemann B, Kleiber B, Bettinger T, et al. Development and implementation of computerized clinical guidelines: Barriers and solutions. Method Inform Med. 2002;41(5):435–42.

    CAS  Google Scholar 

  13. Lloyd TE, Mammen AL, Amato AA, Weiss MD, Needham M, Greenberg SA. Evaluation and construction of diagnostic criteria for inclusion body myositis. Neurology. 2014;83(5):426–33.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Peleg M, Tu S, Bury J, Ciccarese P, Fox J, Greenes RA, et al. Comparing computer-interpretable guideline models: a case-study approach. J Am Med Inform Assoc. 2003;10(1):52–68.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Peleg M. Computer-interpretable clinical guidelines: a methodological review. J Biomed Inform. 2013;46(4):744–63. doi:10.1016/j.jbi.2013.06.009.

    Article  PubMed  Google Scholar 

  16. Isern D, Moreno A. Computer-based execution of clinical guidelines: a review. Int J Med Inform. 2008;77(12):787–808. doi:10.1016/j.ijmedinf.2008.05.010.

    Article  PubMed  Google Scholar 

  17. Boxwala AA, Peleg M, Tu S, Ogunyemi O, Zeng QT, Wang D, et al. GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines. J Biomed Inform. 2004;37(3):147–61. doi:10.1016/j.jbi.2004.04.002.

    Article  PubMed  Google Scholar 

  18. De Clercq PA, Blom JA, Korsten HH, Hasman A. Approaches for creating computer-interpretable guidelines that facilitate decision support. Artif Intell Med. 2004;31(1):1–27.

    Article  PubMed  Google Scholar 

  19. Luo Z, Yetisgen-Yildiz M, Weng C. Dynamic categorization of clinical research eligibility criteria by hierarchical clustering. J Biomed Inform. 2011;44(6):927–35. doi:10.1016/j.jbi.2011.06.001.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Weng C, Wu X, Luo Z, Boland MR, Theodoratos D, Johnson SB. EliXR: an approach to eligibility criteria extraction and representation. J Am Med Inform Assoc. 2011;18 Suppl 1:i116–24. doi:10.1136/amiajnl-2011-000321.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Li D, Endle CM, Murthy S, Stancl C, Suesse D, Sottara D, et al. Modeling and executing electronic health records driven phenotyping algorithms using the NQF quality data model and JBoss(R) drools engine. AMIA Annu Symp Proc. 2012;2012:532–41.

    PubMed  PubMed Central  Google Scholar 

  22. Richesson RL, Krischer J. Data standards in clinical research: gaps, overlaps, challenges and future directions. J Am Med Inform Assoc. 2007;14(6):687–96. doi:10.1197/jamia.M2470.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Jiang G, Solbrig HR, Chute CG. Using semantic web technology to support icd-11 textual definitions authoring. J Biomed Semantics. 2013;4:11.

    Article  PubMed  PubMed Central  Google Scholar 

  24. CMS. QDM. https://ecqi.healthit.gov/qdm. Accessed 22 Feb 2016.

  25. Thompson WK, Rasmussen LV, Pacheco JA, Peissig PL, Denny JC, Kho AN, et al. An evaluation of the NQF Quality data model for representing electronic health record driven phenotyping algorithms. AMIA Annu Symp Proc. 2012;2012:911–20.

    PubMed  PubMed Central  Google Scholar 

  26. Jiang G, Solbrig HR, Pathak J, Chute CG. Developing a Standards-based Information Model for Representing Computable Diagnostic Criteria: A Feasibility Study of the NQF Quality Data Model. MedInfo (in press) 2015.

  27. Protege. http://protege.stanford.edu/. Accessed 22 Feb 2016.

  28. SWRL Language FAQ. https://github.com/protegeproject/swrlapi/wiki/SWRLLanguageFAQ. Accessed 18 Oct 2016.

  29. eCQM Library. https://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/eCQM_Library.html. Accessed 22 Feb 2016.

  30. BioPortal - National Center for Biomedical Ontology. http://bioportal.bioontology.org/. Accessed 23 Feb 2016.

  31. Vrandečić D. Ontology Evaluation. Chapter in Handbook on Ontologies. Part of the series International Handbooks on Information Systems pp 293-313. Springer Berlin Heidelberg. 2009. DOI:10.1007/978-3-540-92673-3_13.

Download references

Acknowledgments

This work is supported in part by funding from: caCDE-QA (U01 CA180940), PhEMA (R01 GM105688) and a Mayo-WHO Contract 200822195-1.

Funding

This work is supported in part by funding from: caCDE-QA (U01 CA180940), PhEMA (R01 GM105688) and a Mayo-WHO Contract 200822195-1.

Availability of data and material

The materials of this paper are all open accessible, the ontology and code are accessed at https://github.com/QDM4DC/HQMF2SWRL.

Authors’ contributions

NH, GJ conceived and designed the study NH and GJ drafted the manuscript; NH performed the data collection and transformation; NH performed the initial evaluation and the other three authors verified the evaluation results. All authors contributed expertise and edits. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Author information

Authors and Affiliations

  1. Department of Health Sciences Research, Mayo Clinic, 200 First Street, SW, Rochester, MN, 55905, USA

    Na Hong & Guoqian Jiang

  2. Institute of Medical Information, Chinese Academy of Medical Sciences, Beijing, China

    Na Hong

  3. Weill Cornell Medical College, Cornell University, New York, NY, USA

    Jyotishman Pathak

  4. School of Medicine, Johns Hopkins University, Baltimore, MD, USA

    Christopher G. Chute

Authors
  1. Na Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jyotishman Pathak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Christopher G. Chute
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guoqian Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guoqian Jiang.

Additional files

Additional file 1:

QDM elements used to build an AMI DCDO. An Excel spreadsheet file containing a list of QDM elements related to AMI diagnostic criteria, This is an example for illustrating the DCDO building. (XLSX 11 kb)

Additional file 2:

HQMF templates used for coding AMI diagnostic criteria. A MS Word file containing 3 types of HQMF template used for coding AMI diagnostic criteria. These structured templates are used to support the automation for populating of an AMI DCDO. (DOCX 15 kb)

Additional file 3:

An AMI DCDO in OWL. An OWL file representing a DCDO for AMI diagnostic criteria. (OWL 24 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hong, N., Pathak, J., Chute, C.G. et al. Developing a modular architecture for creation of rule-based clinical diagnostic criteria. BioData Mining 9, 33 (2016). https://doi.org/10.1186/s13040-016-0113-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13040-016-0113-5

Keywords

BioData Mining

ISSN: 1756-0381