Search PubMed⌕ Search

Biomedical subjects

Steve A. Billings

Publications and source records attributed to Steve A. Billings.

4 recordsLinked to original sources

Dual-orthogonal radial basis function networks for nonlinear time series prediction.

A new structure of Radial Basis Function (RBF) neural network called the Dual-orthogonal RBF Network (DRBF) is introduced for nonlinear time series prediction. The hidden nodes of a conventional RBF network compare the Euclidean distance between the network input vector and the centres, and the node responses are radially symmetrical. But in time series prediction where the system input vectors are lagged system outputs, which are usually highly correlated, the Euclidean distance measure may not be appropriate. The DRBF network modifies the distance metric by introducing a classification function which is based on the estimation data set. Training the DRBF networks consists of two stages. Learning the classification related basis functions and the important input nodes, followed by selecting the regressors and learning the weights of the hidden nodes. In both cases, a forward Orthogonal Least Squares (OLS) selection procedure is applied, initially to select the important input nodes and then to select the important centres. Simulation results of single-step and multi-step ahead predictions over a test data set are included to demonstrate the effectiveness of the new approach.

Journal Article↗

On-line identification of nonlinear systems using Volterra polynomial basis function neural networks.

An on-line identification scheme using Volterra polynomial basis function (VPBF) neural networks is considered for nonlinear control systems. This comprises a structure selection procedure and a recursive weight learning algorithm. The orthogonal least-squares algorithm is introduced for off-line structure selection and the growing network technique is used for on-line structure selection. An on-line recursive weight learning algorithm is developed to adjust the weights so that the identified model can adapt to variations of the characteristics and operating points in nonlinear systems. The convergence of both the weights and the estimation errors is established using a Lyapunov technique. The identification procedure is illustrated using simulated examples.

Journal Article↗

Radial Basis Function Network Configuration Using Mutual Information and the Orthogonal Least Squares Algorithm.

Input nodes of neural networks are usually predetermined by using a priori knowledge or selected by trial and error. For example, in pattern recognition applications the input nodes are usually the given pattern features and in system identification applications the past input and output data are often used as inputs to the network. Some of the input variables may be irrelevant to the task in hand and therefore may cause a deterioration in network performance. Some may be redundant and may increase the complexity of the network and consume expensive computation time. In the present study, the mutual information between the input variables and the output of the network is used to select a suboptimal set of input variables for the network. The variables are selected according to the information content relevant to the output. Variables which have a higher mutual information with the output and lower dependence on other selected variables are used as network inputs. The algorithms are derived based on heuristics and performance is assessed by using radial basis function (RBF) networks trained with the orthogonal least squares algorithm (OLS), which selects the hidden layer nodes of the network according to the error reduction ratios on the network output. Both real and simulated data sets are used to demonstrate the effectiveness of the new algorithms. Copyright 1996 Elsevier Science Ltd.

Journal Article↗

On-line Supervised Adaptive Training Using Radial Basis Function Networks.

A new recursive supervised training algorithm is derived for the radial basis neural network architecture. The new algorithm combines the procedures of on-line candidate regressor selection with the conventional Givens QR based recursive parameter estimator to provide efficient adaptive supervised network training. A new concise on-line correlation based performance monitoring scheme is also introduced as an auxiliary device to detect structural changes in temporal data processing applications. Practical and simulated examples are included to demonstrate the effectiveness of the new procedures. Copyright 1996 Elsevier Science Ltd.

Journal Article↗