Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Software Validation”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24Linked to original sources

Exploiting the past and the future in protein secondary structure prediction.

MOTIVATION: Predicting the secondary structure of a protein (alpha-helix, beta-sheet, coil) is an important step towards elucidating its three-dimensional structure, as well as its function. Presently, the best predictors are based on machine learning approaches, in particular neural network architectures with a fixed, and relatively short, input window of amino acids, centered at the prediction site. Although a fixed small window avoids overfitting problems, it does not permit capturing variable long-rang information. RESULTS: We introduce a family of novel architectures which can learn to make predictions based on variable ranges of dependencies. These architectures extend recurrent neural networks, introducing non-causal bidirectional dynamics to capture both upstream and downstream information. The prediction algorithm is completed by the use of mixtures of estimators that leverage evolutionary information, expressed in terms of multiple alignments, both at the input and output levels. While our system currently achieves an overall performance close to 76% correct prediction--at least comparable to the best existing systems--the main emphasis here is on the development of new algorithmic ideas. AVAILABILITY: The executable program for predicting protein secondary structure is available from the authors free of charge. CONTACT: pfbaldi@ics.uci.edu, gpollast@ics.uci.edu, brunak@cbs.dtu.dk, paolo@dsi.unifi.it.

Algorithms↗

Polymer chromosome models and Monte Carlo simulations of radiation breaking DNA.

MOTIVATION: Chromatin breakage by ionizing radiation is relevant to studies of carcinogenesis, tumor radiotherapy, biodosimetry and molecular biology. This article focuses on computer analysis of chromosome irradiation in mammlian cells. METHODS: Polymer physics and Monte Carlo numerical methods are used to develop a coarse-grained computational approach. Chromatin is modeled as a random walk on a cubic lattice, and the radiation tracks hitting the chromatin are modeled as straight lines hitting lattice sites. Each track can make a cluster of DSBs on a chromosome. RESULTS: The results obtained replace conjectured DNA fragment-size distribution functions in the recently developed RLC formalism by more mechanistically motivated distributions. The discrete lattice algorithm reproduces features of current radiation experiments relevant to chromatin on large scales. It approximates the continuous formalism and experimental data with adequate precision. It was also found that assuming either fixed chromatin with correlations among different clusters of DSBs or moving chromatin with no such correlations gives virtually identical numerical predictions.

Algorithms↗

MaxSub: an automated measure for the assessment of protein structure prediction quality.

MOTIVATION: Evaluating the accuracy of predicted models is critical for assessing structure prediction methods. Because this problem is not trivial, a large number of different assessment measures have been proposed by various authors, and it has already become an active subfield of research (Moult et al. (1997,1999) and CAFASP (Fischer et al. 1999) prediction experiments have demonstrated that it has been difficult to choose one single, 'best' method to be used in the evaluation. Consequently, the CASP3 evaluation was carried out using an extensive set of especially developed numerical measures, coupled with human-expert intervention. As part of our efforts towards a higher level of automation in the structure prediction field, here we investigate the suitability of a fully automated, simple, objective, quantitative and reproducible method that can be used in the automatic assessment of models in the upcoming CAFASP2 experiment. Such a method should (a) produce one single number that measures the quality of a predicted model and (b) perform similarly to human-expert evaluations. RESULTS: MaxSub is a new and independently developed method that further builds and extends some of the evaluation methods introduced at CASP3. MaxSub aims at identifying the largest subset of C(alpha) atoms of a model that superimpose 'well' over the experimental structure, and produces a single normalized score that represents the quality of the model. Because there exists no evaluation method for assessment measures of predicted models, it is not easy to evaluate how good our new measure is. Even though an exact comparison of MaxSub and the CASP3 assessment is not straightforward, here we use a test-bed extracted from the CASP3 fold-recognition models. A rough qualitative comparison of the performance of MaxSub vis-a-vis the human-expert assessment carried out at CASP3 shows that there is a good agreement for the more accurate models and for the better predicting groups. As expected, some differences were observed among the medium to poor models and groups. Overall, the top six predicting groups ranked using the fully automated MaxSub are also the top six groups ranked at CASP3. We conclude that MaxSub is a suitable method for the automatic evaluation of models.

Algorithms↗

BALL--rapid software prototyping in computational molecular biology. Biochemicals Algorithms Library.

MOTIVATION: Rapid software prototyping can significantly reduce development times in the field of computational molecular biology and molecular modeling. Biochemical Algorithms Library (BALL) is an application framework in C++ that has been specifically designed for this purpose. RESULTS: BALL provides an extensive set of data structures as well as classes for molecular mechanics, advanced solvation methods, comparison and analysis of protein structures, file import/export, and visualization. BALL has been carefully designed to be robust, easy to use, and open to extensions. Especially its extensibility which results from an object-oriented and generic programming approach distinguishes it from other software packages. BALL is well suited to serve as a public repository for reliable data structures and algorithms. We show in an example that the implementation of complex methods is greatly simplified when using the data structures and functionality provided by BALL.

Algorithms↗

APDB: a novel measure for benchmarking sequence alignment methods without reference alignments.

MOTIVATION: We describe APDB, a novel measure for evaluating the quality of a protein sequence alignment, given two or more PDB structures. This evaluation does not require a reference alignment or a structure superposition. APDB is designed to efficiently and objectively benchmark multiple sequence alignment methods. RESULTS: Using existing collections of reference multiple sequence alignments and existing alignment methods, we show that APDB gives results that are consistent with those obtained using conventional evaluations. We also show that APDB is suitable for evaluating sequence alignments that are structurally equivalent. We conclude that APDB provides an alternative to more conventional methods used for benchmarking sequence alignment packages.

Algorithms↗

Artificial gene networks for objective comparison of analysis algorithms.

MOTIVATION: Large-scale gene expression profiling generates data sets that are rich in observed features but poor in numbers of observations. The analysis of such data sets is a challenge that has been object of vigorous research. The algorithms in use for this purpose have been poorly documented and rarely compared objectively, posing a problem of uncertainty about the outcomes of the analyses. One way to objectively test such analysis algorithms is to apply them on computational gene network models for which the mechanisms are completely know. RESULTS: We present a system that generates random artificial gene networks according to well-defined topological and kinetic properties. These are used to run in silico experiments simulating real laboratory microarray experiments. Noise with controlled properties is added to the simulation results several times emulating measurement replicates, before expression ratios are calculated. AVAILABILITY: The data sets and kinetic models described here are available from http://www.vbi.vt.edu/~mendes/AGN/as biochemical dynamic models in SBML and Gepasi formats.

Algorithms↗

Evaluation of ontology development tools for bioinformatics.

Ontologies are being used nowadays in many areas, including bioinformatics. To assist users in developing and maintaining ontologies a number of tools have been developed. In this paper we compare four such tools, Protégé-2000, Chimaera, DAG-Edit and OilEd. As test ontologies we have used ontologies from the Gene Ontology Consortium. No system is preferred in all situations, but each system has its own strengths and weaknesses.

Computational Biology↗

In silico analysis reveals substantial variability in the gene contents of the gamma proteobacteria LexA-regulon.

MOTIVATION: Motif-prediction algorithm capabilities for the analysis of bacterial regulatory networks and the prediction of new regulatory sites can be greatly enhanced by the use of comparative genomics approaches. In this study, we make use of a consensus-building algorithm and comparative genomics to conduct an in-depth analysis of the LexA-regulon of gamma proteobacteria, and we use the inferred results to study the evolution of this regulatory network and to examine the usefulness of the control sequences and gene contents of regulons in phylogenetic analysis. RESULTS: We show, for the first time, the substantial heterogeneity that the LexA-regulon of gamma proteobacteria displays in terms of gene content and we analyze possible branching points in its evolution. We also demonstrate the feasibility of using regulon-related information to derive sound phylogenetic inferences. AVAILABILITY: Complementary analysis data and both the source code and the Windows-executable files of the consensus-building software are available at http://www.cnm.es/~ivan/RCGScanner/

Algorithms↗

Normality of oligonucleotide microarray data and implications for parametric statistical analyses.

MOTIVATION: Experimental limitations have resulted in the popularity of parametric statistical tests as a method for identifying differentially regulated genes in microarray data sets. However, these tests assume that the data follow a normal distribution. To date, the assumption that replicate expression values for any gene are normally distributed, has not been critically addressed for Affymetrix GeneChip data. RESULTS: The normality of the expression values calculated using four different commercial and academic software packages was investigated using a data set consisting of the same target RNA applied to 59 human Affymetrix U95A GeneChips using a combination of statistical tests and visualization techniques. For the majority of probe sets obtained from each analysis suite, the expression data showed a good correlation with normality. The exception was a large number of low-expressed genes in the data set produced using Affymetrix Microarray Suite 5.0, which showed a striking non-normal distribution. In summary, our data provide strong support for the application of parametric tests to GeneChip data sets without the need for data transformation.

Algorithms↗

SaRAD: a Simple and Robust Abbreviation Dictionary.

MOTIVATION: Due to recent interest in the use of textual material to augment traditional experiments it has become necessary to automatically cluster, classify and filter natural language information. RESULTS: The Simple and Robust Abbreviation Dictionary (SaRAD) provides an easy to implement, high performance tool for the construction of a biomedical symbol dictionary. The algorithms, applied to the MEDLINE document set, result in a high quality dictionary and toolset to disambiguate abbreviation symbols automatically.

Abbreviations as Topic↗

Comparative analysis of algorithms for signal quantitation from oligonucleotide microarrays.

MOTIVATION: Recent years' exponential increase in DNA microarrays experiments has motivated the development of many signal quantitation (SQ) algorithms. These algorithms perform various transformations on the actual measurements aimed to enable researchers to compare readings of different genes quantitatively within one experiment and across separate experiments. However, it is relatively unclear whether there is a 'best' algorithm to quantitate microarray data. The ability to compare and assess such algorithms is crucial for any downstream analysis. In this work, we suggest a methodology for comparing different signal quantitation algorithms for gene expression data. Our aim is to enable researchers to compare the effect of different SQ algorithms on the specific dataset they are dealing with. We combine two kinds of tests to assess the effect of an SQ algorithm in terms of signal to noise ratio. To assess noise, we exploit redundancy within the experimental dataset to test the variability of a given SQ algorithm output. For the effect of the SQ on the signal we evaluate the overabundance of differentially expressed genes using various statistical significance tests. RESULTS: We demonstrate our analysis approach with three SQ algorithms for oligonucleotide microarrays. We compare the results of using the dChip software and the RMAExpress software to the ones obtained by using the standard Affymetrix MAS5 on a dataset containing pairs of repeated hybridizations. Our analysis suggests that dChip is more robust and stable than the MAS5 tools for about 60% of the genes while RMAExpress is able to achieve an even greater improvement in terms of signal to noise, for more than 95% of the genes.

Algorithms↗

How predictable is orthognathic surgery?

There are a number of increasingly sophisticated techniques available for orthognathic treatment planning. All are based on the determination of the skeletal pattern and the position of the dentition. However, they all suffer from difficulties associated with predicting the soft tissue profile. The aim of this retrospective cephalometric investigation was, therefore, to compare the ability to predict accurately the outcome of orthognathic treatment using the 'hand planning' technique and the orthognathic planning and analysis (OPAL) computer program, with an emphasis on the soft tissue profile. Seventy adult subjects were divided into two groups not specific for gender or age: the Class III patients had undergone bimaxillary surgery and the Class II patients sagittal split mandibular advancement. In each group, the pre-treatment and post-debond lateral cephalograms were utilized to calculate the actual orthodontic and surgical movements. These values were then used to produce a prediction using both the hand planning technique and the OPAL program. The resultant predictions were digitized using a customized computer program and compared with the actual outcome. The results show that there was marked individual variation when planning by hand and using the OPAL program. In the mandibular surgery group, hand planning and OPAL were of similar accuracy and few points differed significantly between prediction and outcome. However, for the bimaxillary group, a number of points showed bias and the hand planning technique appeared to be more accurate than the OPAL program, particularly in the region of the lips. Although the usefulness of predictions is acknowledged, these results suggest that they should be used with a certain amount of caution.

Adult↗

A prospective controlled trial of computerized decision support for lipid management in primary care.

OBJECTIVES: This study aimed to assess the uptake and effect in primary care of a computerized decision support system (DSS) for the management of hyperlipidaemia. METHOD: A prospective controlled trial was conducted in 25 practices covering a population of 150,000 in the city of Birmingham. The Primed system, a specialist developed, rule based DSS for general practice, was introduced prospectively after a 3-month baseline data collection. The main outcome measures were nine months' data on prescribing of lipid lowering agents; use of laboratory tests; and referrals to secondary care for the investigation of hyperlipidaemia. RESULTS: System use was lower than expected. A shift was observed towards requests for appropriate follow-up of previously abnormal lipid results and a greater emphasis on full lipid profiles, in line with the DSS guidelines. Referrals showed a 55% decrease on those expected (NS). The prescribing evaluation revealed a large variation between practices, but no significant alteration following system use. Views of users favoured decision support as a concept, but criticised technical problems with the system. CONCLUSIONS: Greater integration of DSS software and practice based data handling systems is needed. The mode of data capture, and hence both the content and form of knowledge representation, in DSS must take greater account of the primary care consultation process if such systems are to be of use to practitioners.

Attitude to Computers↗

Towards improvement of the accuracy and completeness of medication registration with the use of an electronic medical record (EMR).

BACKGROUND: Approximately 80% of GPs use a GP information system (GIS) and an electronic medical record (EMR) in their daily practice. To reap the full benefits of an EMR for patient care, post-graduate education and research, the data input must be well structured and accurately coded. OBJECTIVES: The quality and user-friendliness of the software positively influence the completeness and reliability of the data recorded in the GIS. To assess this in actual practice, this study examined whether or not an increase occurred in the accuracy and completeness of indication-related medication registration after the GIS's software package was upgraded. METHOD: GPs recorded data for the Registration Network Groningen (RNG) concerning four medication groups: insulin, trimethoprim, the contraceptive pill and beta-blocking agents. The completeness and accuracy of the registered data were assessed both before and after the change to the new software package. The completeness is evaluated on the basis of the indications missing for the prescribed medications. To assess accuracy, a check was made to determine whether the indications corresponded to those deemed relevant for that particular medication according to National Pharmaceutical Guidelines. RESULTS: The percentage of missing indications decreased notably, especially in the chronically prescribed medication groups. For insulin, the percentage decreased from 40.5 to 3% and for the contraceptive pill from 34.5 to 1%. For trimethoprim, the percentage decreased from 10 to 1%, and for beta-blocking agents from 22 to 1.5%. Of the indications present, the percentage of relevant indications showed a slight increase, with the largest increase observed for the contraceptive pill where the percentage rose from 86 to 96%. CONCLUSIONS: The completeness of recorded indications improved considerably after the change of software. This is due mostly to the efforts of the GPs, their practice assistants and the support of the RNG organization involved in the conversion procedure. Accuracy improved slightly, especially due to the software modifications which ensured that non-existent codes could not be entered. To summarize, with increased user-friendliness of the software, combined with the training of motivated GPs, the quality of recorded data improved.

Adrenergic Antagonists↗

An adaptive, object oriented strategy for base calling in DNA sequence analysis.

An algorithm has been developed for the determination of nucleotide sequence from data produced in fluorescence-based automated DNA sequencing instruments employing the four-color strategy. This algorithm takes advantage of object oriented programming techniques for modularity and extensibility. The algorithm is adaptive in that data sets from a wide variety of instruments and sequencing conditions can be used with good results. Confidence values are provided on the base calls as an estimate of accuracy. The algorithm iteratively employs confidence determinations from several different modules, each of which examines a different feature of the data for accurate peak identification. Modules within this system can be added or removed for increased performance or for application to a different task. In comparisons with commercial software, the algorithm performed well.

Algorithms↗

Review of methods and computer codes for interpretation of bioassay data.

Internal dose determination is an essential component of individual monitoring programmes for workers or members of the public exposed to radionuclides, and methods and computer programs are required for dose assessment. A recent international European Radiation Dosimetry Group (EURADOS) intercomparison has shown unacceptably large ranges in the results assessment. An ICRP working party has been initiated to consider what guidance ICRP can give on the use of models and interpret bioassay data in terms of intake/dose. In this field, six codes for bioassay data interpretation, which implement the current ICRP publication 78 biokinetic models, have been reviewed against several criteria with different levels of importance: minor criteria such as the practical use of the code and the graphical capabilities, and major criteria such as the choice of available parameters, peculiarities of data fitting and interpretation, the choice of biokinetic models and the use of uncertainties. All these criteria were assessed using one artificial set of data and two examples extracted from the previous international EURADOS intercomparison.

Administration, Oral↗

Reproducibility and accuracy of angle measurements obtained under static conditions with the Motion Analysis video system.

The development of computerized and semi-automated motion analysis systems has made the study of human motion more widely available in research and clinical settings. Although many of these systems are currently used by physical therapists, the accuracy and reproducibility of some of these systems in estimating joint angles have not been reported. In this study, the accuracy and reproducibility of angle measurements obtained by use of the Motion Analysis video system were evaluated under static conditions using a standard goniometer. Reflective markers placed on a goniometer were recorded by two video cameras at 17 angles, from 20 to 180 degrees, in 10-degree increments. Recordings of the goniometer were made at three locations within the field of view of the cameras. The intraclass correlation coefficient for each location tested was .99. Average within-trial variability was less than 0.4 degree at all locations. A linear regression of the system-calculated angles and reference angles for all locations had slopes near unity (ie, 1) and intercepts that were not statistically different from zero. A preliminary evaluation of the system under dynamic conditions revealed that distances were slightly underestimated, regardless of where the movement occurred within the calibration cube.

Algorithms↗

Evaluating computerized health information systems: hardware, software and human ware: experiences from the Northern Province, South Africa.

Despite enormous investment world-wide in computerized health information systems their overall benefits and costs have rarely been fully assessed. A major new initiative in South Africa provides the opportunity to evaluate the introduction of information technology from a global perspective and assess its impact on public health. The Northern Province is implementing a comprehensive integrated hospital information system (HIS) in all of its 42 hospitals. These include two mental health institutions, eight regional hospitals (two acting as a tertiary complex with teaching responsibilities) and 32 district hospitals. The overall goal of the HIS is to improve the efficiency and effectiveness of health (and welfare) services through the creation and use of information, for clinical, administrative and monitoring purposes. This multi-site implementation is being undertaken as a single project at a cost of R130 million (which represents 2.5 per cent of the health and welfare budget on an annual basis). The implementation process commenced on 1 September 1998 with the introduction of the system into Mankweng Hospital as the pilot site and is to be completed in the year 2001. An evaluation programme has been designed to maximize the likelihood of success of the implementation phase (formative evaluation) as well as providing an overall assessment of its benefits and costs (summative evaluation). The evaluation was designed as a form of health technology assessment; the system will have to prove its worth (in terms of cost-effectiveness) relative to other interventions. This is more extensive than the traditional form of technical assessment of hardware and software functionality, and moves into assessing the day-to-day utility of the system, the clinical and managerial environment in which it is situated (humanware), and ultimately its effects on the quality of patient care and public health. In keeping with new South African legislation the evaluation process sought to involve as many stakeholders as possible at the same time as creating a methodologically rigorous study that lived within realistic resource limits. The design chosen for the summative assessment was a randomized controlled trial (RCT) in which 24 district hospitals will receive the HIS either early or late. This is the first attempt to carry out an RCT evaluation of a multi-site implementation of an HIS in the world. Within this design the evaluation will utilize a range of qualitative and quantitative techniques over varying time scales, each addressing specific aims of the evaluation programme. In addition, it will attempt to provide an overview of the general impact on people and organizations of introducing high-technology solutions into a relatively unprepared environment. The study should help to stimulate an evaluation culture in the health and welfare services in the Northern Province as well as building the capacity to undertake such evaluations in the future.

Computers↗