Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Natural Language Processing”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 recordsLinked to original sources
PubMed1995

Current trends with natural language processing.

Natural Language Processing in the medical domain becomes more and more powerful, efficient, and ready to be used in daily practice. The needs for such tools are enormous in the medical field, due to the vast amount of written texts for medical records. In the authors' point of view, the Electronic Patient Record (EPR) is achieved neither with Information Systems of all kinds nor with commercially available word processing systems. Natural Language Processing (NLP) is one dimension of the EPR, as well as Image Processing and Decision Support Systems. Analysis of medical texts to facilitate indexing and retrieval is well known. The need for a generation tool is to produce progress notes from menu driven systems. The computer systems of tomorrow cannot miss any single dimension. Since 1988, we've been developing an NLP system; it is supported by the European program AIM (Advanced Informatics in Medicine) within the GALEN and HELIOS consortium and the CERS (Commission d'Encouragement á la Recherche Scientifique) in Switzerland. The main directions of development are: a medical language analyzer, a language generator, a query processor, and dictionary building tools to support the Medical Linguistic Knowledge Base (MLKB). The knowledge representation schema is essentially based on Sowa's conceptual graphs, and the MLKB is multilingual from its design phase; it currently incorporates the English and the French languages; it will also continue using German. The goal of this demonstration is to provide evidence of what exists today, what will be soon available, and what is planned for the long term. Complete sentences will be processed in real time, and the browsing capabilities of the MLKB will be exercised. In particular, the following features will be presented: Analysis of complete sentences with verbs and relatives, as extracted from clinical narratives, with special attention to the method of "proximity processing" as developed in our group and the rule based approach to language description to resolve the specific surface language problems as well as the language independent semantic situations. Comparison of results for English, French, and German sentences, showing the commonalities between these languages and, therefore, the re-usable features and the language specific aspects. Generation of noun phrases in English and French, showing the opportunities for translation between these two languages. Application of the analyzer to build a knowledge representation of ICD under the form of conceptual graphs and presentation of the possibilities of a natural language encoding of diagnosis. Strategies for query processing through a sample of abdominal ultrasonography reports, which have been analyzed and stored under the form of conceptual graphs. Feeding in and browsing of the Medical Linguistic Knowledge Base and other Dictionary Building Tools, using the perspective of an international initiative to converge towards a multilingual universal solution, valid for the medical domain. The demonstration platform is Microsoft Windows 4 on a PC, with Microsoft Visual Basic as the GUI and Quintus Prolog as NLP tools language. The same programs were originally developed for Unix-based workstations and are available on multiple platforms under Motif and X11. .

European Union↗
PubMed1995

New trends in natural language processing: statistical natural language processing.

The field of natural language processing (NLP) has seen a dramatic shift in both research direction and methodology in the past several years. In the past, most work in computational linguistics tended to focus on purely symbolic methods. Recently, more and more work is shifting toward hybrid methods that combine new empirical corpus-based methods, including the use of probabilistic and information-theoretic techniques, with traditional symbolic methods. This work is made possible by the recent availability of linguistic databases that add rich linguistic annotation to corpora of natural language text. Already, these methods have led to a dramatic improvement in the performance of a variety of NLP systems with similar improvement likely in the coming years. This paper focuses on these trends, surveying in particular three areas of recent progress: part-of-speech tagging, stochastic parsing, and lexical semantics.

Algorithms↗
PubMed2006

PhenoGO: assigning phenotypic context to gene ontology annotations with natural language processing.

Natural language processing (NLP) is a high throughput technology because it can process vast quantities of text within a reasonable time period. It has the potential to substantially facilitate biomedical research by extracting, linking, and organizing massive amounts of information that occur in biomedical journal articles as well as in textual fields of biological databases. Until recently, much of the work in biological NLP and text mining has revolved around recognizing the occurrence of biomolecular entities in articles, and in extracting particular relationships among the entities. Now, researchers have recognized a need to link the extracted information to ontologies or knowledge bases, which is a more difficult task. One such knowledge base is Gene Ontology annotations (GOA), which significantly increases semantic computations over the function, cellular components and processes of genes. For multicellular organisms, these annotations can be refined with phenotypic context, such as the cell type, tissue, and organ because establishing phenotypic contexts in which a gene is expressed is a crucial step for understanding the development and the molecular underpinning of the pathophysiology of diseases. In this paper, we propose a system, PhenoGO, which automatically augments annotations in GOA with additional context. PhenoGO utilizes an existing NLP system, called BioMedLEE, an existing knowledge-based phenotype organizer system (PhenOS) in conjunction with MeSH indexing and established biomedical ontologies. More specifically, PhenoGO adds phenotypic contextual information to existing associations between gene products and GO terms as specified in GOA. The system also maps the context to identifiers that are associated with different biomedical ontologies, including the UMLS, Cell Ontology, Mouse Anatomy, NCBI taxonomy, GO, and Mammalian Phenotype Ontology. In addition, PhenoGO was evaluated for coding of anatomical and cellular information and assigning the coded phenotypes to the correct GOA; results obtained show that PhenoGO has a precision of 91% and recall of 92%, demonstrating that the PhenoGO NLP system can accurately encode a large number of anatomical and cellular ontologies to GO annotations. The PhenoGO Database may be accessed at the following URL: http://www.phenoGO.org

Computational Biology↗
PubMed2004

A comparison of semantic categories of the ISO reference terminology models for nursing and the MedLEE natural language processing system.

Natural language processing (NLP) systems have demonstrated utility in parsing narrative texts for purposes such as surveillance and decision support. However, there has been little work related to NLP of nursing narratives. The purpose of this study was to compare the semantic categories of a NLP system (Medical Language Extraction and Encoding [MedLEE] system) with the semantic domains, categories, and attributes of the International Standards Organization(ISO) reference terminology models for nursing diagnoses and nursing actions. All but two MedLEE diagnosis and procedure-related semantic categories mapped to ISO models. In some instances, we found exact correspondence between the semantic structures of MedLEE and the ISO models. In other situations (e.g. aspects of site or location), the ISO model was not as granular as MedLEE. For clinical procedure and non-invasive examination, two ISO nursing action model components (action and target) were required to represent the MedLEE semantic category. The ISO model requires additional specification of selected semantic categories for the abstract semantic domains in order to achieve the objective of using NLP to parse and encode data from nursing narratives. Our analysis also suggests areas for extension of MedLEE.

Natural Language Processing↗
PubMed2000

A broad-coverage natural language processing system.

Natural language processing systems (NLP) that extract clinical information from textual reports were shown to be effective for limited domains and for particular applications. Because an NLP system typically requires substantial resources to develop, it is beneficial if it is designed to be easily extendible to multiple domains and applications. This paper describes multiple extensions of an NLP system called MedLEE, which was originally developed for the domain of radiological reports of the chest, but has subsequently been extended to mammography, discharge summaries, all of radiology, electrocardiography, echocardiography, and pathology.

Decision Making, Computer-Assisted↗
PubMed2005

Extracting information on pneumonia in infants using natural language processing of radiology reports.

Natural language processing (NLP) is critical for improvement of the healthcare process because it can encode clinical data in patient documents. Many clinical applications such as decision support require coded data to function appropriately. However, in order to be applicable for healthcare, performance must be adequate. A valuable automated application is the detection of infectious diseases, such as surveillance of pneumonia in newborns (e.g., neonates) because the disease produces significant rates of morbidity and mortality, and manual surveillance is challenging. Studies have demonstrated that automated surveillance using NLP is a useful adjunct to manual surveillance and an effective tool for infection control practitioners. This paper presents a study evaluating the feasibility of an NLP-based monitoring system to screen for healthcare-associated pneumonia in neonates. We estimated sensitivity, specificity, and positive predictive value by comparing results with clinicians' judgments. Sensitivity was 71% and specificity was 99%. Our results demonstrated that the automated method was feasible.

Database Management Systems↗
PubMed2005

ISO reference terminology models for nursing: applicability for natural language processing of nursing narratives.

Natural language processing (NLP) systems have demonstrated utility in parsing narrative texts for purposes such as surveillance and decision support. However, there has been little work related to NLP of nursing narratives. The purpose of this study was to compare the semantic categories of a NLP system (Medical Language Extraction and Encoding [MedLEE] system) with the semantic domains, categories, and attributes of the International Standards Organization (ISO) reference terminology models for nursing diagnoses and nursing actions. All but two MedLEE diagnosis and procedure-related semantic categories mapped to ISO models. In some instances, we found exact correspondence between the semantic structures of MedLEE and the ISO models. In other situations (e.g. aspects of Site or Location), the ISO model was not as granular as MedLEE. For clinical procedure and non-invasive examination, two ISO nursing action model components (Action and Target) mapped to a single MedLEE semantic category. The ISO models are applicable to NLP of nursing narratives. However, the ISO models require additional specification of selected semantic categories for the abstract semantic domains in order to achieve the objective of using NLP to parse and encode data from nursing narratives. Our analysis also suggests areas for extension of MedLEE particularly in regard to represent nursing actions.

Diagnosis, Computer-Assisted↗
PubMed2005

Classifying free-text triage chief complaints into syndromic categories with natural language processing.

OBJECTIVE: Develop and evaluate a natural language processing application for classifying chief complaints into syndromic categories for syndromic surveillance. INTRODUCTION: Much of the input data for artificial intelligence applications in the medical field are free-text patient medical records, including dictated medical reports and triage chief complaints. To be useful for automated systems, the free-text must be translated into encoded form. METHODS: We implemented a biosurveillance detection system from Pennsylvania to monitor the 2002 Winter Olympic Games. Because input data was in free-text format, we used a natural language processing text classifier to automatically classify free-text triage chief complaints into syndromic categories used by the biosurveillance system. The classifier was trained on 4700 chief complaints from Pennsylvania. We evaluated the ability of the classifier to classify free-text chief complaints into syndromic categories with a test set of 800 chief complaints from Utah. RESULTS: The classifier produced the following areas under the ROC curve: Constitutional = 0.95; Gastrointestinal = 0.97; Hemorrhagic = 0.99; Neurological = 0.96; Rash = 1.0; Respiratory = 0.99; Other = 0.96. Using information stored in the system's semantic model, we extracted from the Respiratory classifications lower respiratory complaints and lower respiratory complaints with fever with a precision of 0.97 and 0.96, respectively. CONCLUSION: Results suggest that a trainable natural language processing text classifier can accurately extract data from free-text chief complaints for biosurveillance.

Bayes Theorem↗
PubMedDate not supplied

Automated diagnostic indexing by natural language processing.

Developing tools for natural language understanding by computers represents an important and intense field of research. This paper describes a system developed for interpreting medical natural language in the domain of symptoms and diagnoses from complete discharge summaries and locating the correspondent category into the International Classification of Diseases, through indexing by the Systematized Nomenclature of Medicine. The indexing program makes use of the MEID dictionary and some auxiliary semantic databases for identifying adjectival forms, synonyms, hypernyms and other semantic relations while searching for the longest consistent match into SNOMED. A further subdivision of the SNOMED structure was also proposed in order to find the hierarchically superior representative of a conceptual class when this association is not assigned by the related SNOMED code number. The system can be used by any language that possesses a translation of SNOMED and ICD. The knowledge base was built using a conversion file that maps the terms of the nomenclature into the classification, which can be improved by learning from users.

Abstracting and Indexing↗
PubMed2000

Coding neuroradiology reports for the Northern Manhattan Stroke Study: a comparison of natural language processing and manual review.

Automated systems using natural language processing may greatly speed chart review tasks for clinical research, but their accuracy in this setting is unknown. The objective of this study was to compare the accuracy of automated and manual coding in the data acquisition tasks of an ongoing clinical research study, the Northern Manhattan Stroke Study(NOMASS). We identified 471 neuroradiology reports of brain images used in the NOMASS study. Using both automated and manual coding, we completed a standardized NOMASS imaging form with the information contained in these reports. We then generated ROC curves for both manual and automated coding by comparing our results to the original NOMASS data, where study in investigators directly coded their interpretations of brain images. The areas under the ROC curves for both manual and automated coding were the main outcome measure. The overall predictive value of the automated system (ROC area 0.85, 95% CI 0.84-0.87) was not statistically different from the predictive value of the manual coding (ROC area 0.87, 95% CI 0.83-0.91). Measured in terms of accuracy, the automated system performed slightly worse than manual coding. The overall accuracy of the automated system was 84% (CI 83-85%). The overall accuracy of manual coding was 86% (CI 84-88%). The difference in accuracy between the two methods was small but statistically significant (P = 0.026). Errors in manual coding appeared to be due to differences between neurologists' and nueroradiologists' interpretation, different use of detailed anatomic terms, and lack of clinical information. Automated systems can use natural language processing to rapidly perform complex data acquisition tasks. Although there is a small decrease in the accuracy of the data as compared to traditional methods, automated systems may greatly expand the power of chart review in clinical research design and implementation.

Brain↗
PubMed2005

Automated detection of adverse events using natural language processing of discharge summaries.

OBJECTIVE: To determine whether natural language processing (NLP) can effectively detect adverse events defined in the New York Patient Occurrence Reporting and Tracking System (NYPORTS) using discharge summaries. DESIGN: An adverse event detection system for discharge summaries using the NLP system MedLEE was constructed to identify 45 NYPORTS event types. The system was first applied to a random sample of 1,000 manually reviewed charts. The system then processed all inpatient cases with electronic discharge summaries for two years. All system-identified events were reviewed, and performance was compared with traditional reporting. MEASUREMENTS: System sensitivity, specificity, and predictive value, with manual review serving as the gold standard. RESULTS: The system correctly identified 16 of 65 events in 1,000 charts. Of 57,452 total electronic discharge summaries, the system identified 1,590 events in 1,461 cases, and manual review verified 704 events in 652 cases, resulting in an overall sensitivity of 0.28 (95% confidence interval [CI]: 0.17-0.42), specificity of 0.985 (CI: 0.984-0.986), and positive predictive value of 0.45 (CI: 0.42-0.47) for detecting cases with events and an average specificity of 0.9996 (CI: 0.9996-0.9997) per event type. Traditional event reporting detected 322 events during the period (sensitivity 0.09), of which the system identified 110 as well as 594 additional events missed by traditional methods. CONCLUSION: NLP is an effective technique for detecting a broad range of adverse events in text documents and outperformed traditional and previous automated adverse event detection methods.

Academic Medical Centers↗
PubMed1990

Automated access to a large medical dictionary: online assistance for research and application in natural language processing.

Online dictionaries can be important tools for research and application in natural language processing. This paper describes work with a machine-readable version of "Dorland's Illustrated Medical Dictionary". First the characteristics of the dictionary are briefly described, and then the complex process of converting the tape to an online interactive dictionary is discussed. The results of several experiments in automatically deriving information from the online dictionary are presented, and the paper ends with a discussion of the use of the online dictionary as a tool in the development of a natural language processing system designed for the biomedical domain.

Abstracting and Indexing↗
PubMed1996

Integrating data from natural language processing into a clinical information system.

Demographic data extracted from discharge summaries by natural language processing was compared to data gathered by a conventional hospital admitting system. Discrepancies in data were noted in names, age, sex, race, and ethnicity. Some differences are attributable to errors in collection: interaction with patient, dictation, transcription, and data entry. Very few differences were due to errors in natural language processing. Other differences can be used to critique existing data, or to enhance data with more detailed information. Discrepancies in data as elementary as patient demographics raise the issue of resolving conflicts when neither source of data is known to be more reliable. Clinical repositories can represent conflicting data from multiple sources, but clinical information systems must bear the cost of increased complexity in the application programs that will use the data.

Evaluation Studies as Topic↗
PubMed1994

Natural language processing of medical texts within the HELIOS environment.

A large number of hospital applications are potentially interested in natural language processing since they currently heavily depend on an efficient use of a huge amount of textual information. The need for systems that are able to accept multiple European languages is of paramount interest, as language barriers can be a strong impediment for large-scale communication in Europe, in particular regarding telemedicine. In the context of the AIM project HELIOS, the Natural Language Processing (NLP) component offers a large variety of medical services according to natural language free input. It allows the multilingual analysis of medical texts (currently in English, French and German) and the storage of the meaning of these texts under a deep knowledge representation that can be queried whenever it is needed. In addition, it provides facilities to handle knowledge source embedded into the conceptual typologies and into the dictionaries. This article aims at describing all these functionalities and their integration into the environment of the HELIOS project.

Artificial Intelligence↗
PubMed1996

Natural language processing in medicine: an overview.

An overview is given of natural language processing applications in medicine. An attempt has been made to enumerate the most important and known international projects and to summarize their goals, principles, methods and results. A section is devoted to projects involving the Dutch language. A more general discussion about the two fundamental approaches concerning medical language understanding is provided. An extensive bibliography may be useful for those wishing to explore this research domain.

Humans↗
PubMed2002

Use of natural language processing to translate clinical information from a database of 889,921 chest radiographic reports.

PURPOSE: To evaluate translation of chest radiographic reports by using natural language processing and to compare the findings with those in the literature. MATERIALS AND METHODS: A natural language processor coded 10 years of narrative chest radiographic reports from an urban academic medical center. Coding for 150 reports was compared with manual coding. Frequencies and co-occurrences of 24 clinical conditions (diseases, abnormalities, and clinical states) were estimated. The ratio of right to left lung mass, association of pleural effusion with other conditions, and frequency of bullet and stab wounds were compared with independent observations. The sensitivity and specificity of the system's pneumothorax coding were compared with those of manual financial coding. RESULTS: The system coded 889,921 reports on 251,186 patients. On the basis of manual coding of 150 reports, the processor's sensitivity (0.81) and specificity (0.99) were comparable to those previously reported for natural language processing and for expert coders. The frequencies of the selected conditions ranged from 0.22 for pleural effusion to 0.0004 for tension pneumothorax. The database confirmed earlier observations that lung cancer occurs in a 3:2 right-to-left ratio. The association of pleural effusion with other conditions mirrored that in the literature. Bullet and stab wounds decreased during 10 years at a rate consistent with crime statistics. A review of pneumothorax cases showed that the database (sensitivity, 1.00; specificity, 0.996) was more accurate than financial discharge coding (sensitivity, 0.17; P =.002; specificity, 0.996; not significant). CONCLUSION: Internal and external validation in this study confirmed the accuracy of natural language processing for translating chest radiographic narrative reports into a large database of information.

Databases, Factual↗
PubMed1997

Identification of findings suspicious for breast cancer based on natural language processing of mammogram reports.

There is need for encoded data for computerized clinical decision support, but most such data are unavailable as they are in free-text reports. Natural language processing offers one alternative for encoding such data. MedLEE is a natural language processing system which is in routine use for encoding chest radiograph and mammogram reports. In this paper, we study MedLEE's ability to identify mammogram findings suspicious for breast cancer by comparing MedLEE's encoding with a logbook of all suspicious findings maintained by the mammography center. While MedLEE was able to identify all the suspicious findings, it varied in the level of granularity, particularly about the location of the suspicious finding. Thus, natural language processing is a useful technique for encoding mammogram reports in order to detect suspicious findings.

Breast Neoplasms↗