Biomedical subjects
Publications and source records attributed to Antony Browne.
To give an adequate explanation of cognition and perform certain practical tasks, connectionist systems must be able to extrapolate. This work explores the relationship between input representation and extrapolation, using simulations of multilayer perceptrons trained to model the identity function. It has been discovered that representation has a marked effect on extrapolation.
A novel method of analysing the systematic structure formed inside a feedforward neural network is developed. This method is applied to the task of understanding how a network is performing unification on distributed representations. Systematic structure is detected by examining inter-representational distances, rather than by attempting to detect the vectorial similarities sought by previously described techniques. The method described can be applied to the detection of systematic structure in other networks using distributed representations.