Search PubMed⌕ Search

Biomedical subjects

Mitsuo Kawato

Publications and source records attributed to Mitsuo Kawato.

At least 37 records · Page 2Linked to original sources

Chaos may enhance information transmission in the inferior olive.

Despite unique well characterized neuronal properties, such as extensive electrical coupling and low firing rates, the role of the inferior olive (IO), which is the source of the climbing fiber inputs to cerebellar Purkinje cells, is still controversial. We propose that the IO stochastically recodes the high-frequency information carried by its synaptic inputs into stochastic, low-rate spikes in its climbing fiber output. Computer simulations of realistic IO networks showed that moderate electrical coupling produced chaotic firing, which maximized the input-output mutual information. This "chaotic resonance" may allow rich error signals to reach individual Purkinje cells, even at low firing rates, allowing efficient cerebellar learning.

Animals↗

A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task.

Humans can acquire appropriate behaviors that maximize rewards on a trial-and-error basis. Recent electrophysiological and imaging studies have demonstrated that neural activity in the midbrain and ventral striatum encodes the error of reward prediction. However, it is yet to be examined whether the striatum is the main locus of reward-based behavioral learning. To address this, we conducted functional magnetic resonance imaging (fMRI) of a stochastic decision task involving monetary rewards, in which subjects had to learn behaviors involving different task difficulties that were controlled by probability. We performed a correlation analysis of fMRI data by using the explanatory variables derived from subject behaviors. We found that activity in the caudate nucleus was correlated with short-term reward and, furthermore, paralleled the magnitude of a subject's behavioral change during learning. In addition, we confirmed that this parallelism between learning and activity in the caudate nucleus is robustly maintained even when we vary task difficulty by controlling the probability. These findings suggest that the caudate nucleus is one of the main loci for reward-based behavioral learning.

Adult↗

Functional magnetic resonance imaging examination of two modular architectures for switching multiple internal models.

An internal model is a neural mechanism that can mimic the input-output properties of a controlled object such as a tool. Recent research interests have moved on to how multiple internal models are learned and switched under a given context of behavior. Two representative computational models for task switching propose distinct neural mechanisms, thus predicting different brain activity patterns in the switching of internal models. In one model, called the mixture-of-experts architecture, switching is commanded by a single executive called a "gating network," which is different from the internal models. In the other model, called the MOSAIC (MOdular Selection And Identification for Control), the internal models themselves play crucial roles in switching. Consequently, the mixture-of-experts model predicts that neural activities related to switching and internal models can be temporally and spatially segregated, whereas the MOSAIC model predicts that they are closely intermingled. Here, we directly examined the two predictions by analyzing functional magnetic resonance imaging activities during the switching of one common tool (an ordinary computer mouse) and two novel tools: a rotated mouse, the cursor of which appears in a rotated position, and a velocity mouse, the cursor velocity of which is proportional to the mouse position. The switching and internal model activities temporally and spatially overlapped each other in the cerebellum and in the parietal cortex, whereas the overlap was very small in the frontal cortex. These results suggest that switching mechanisms in the frontal cortex can be explained by the mixture-of-experts architecture, whereas those in the cerebellum and the parietal cortex are explained by the MOSAIC model.

Adult↗

Random presentation enables subjects to adapt to two opposing forces on the hand.

Studies have shown that humans cannot simultaneously learn opposing force fields or opposing visuomotor rotations, even when provided with arbitrary contextual information, probably because of interference in their working memory. In contrast, we found that subjects can adapt to two opposing force fields when provided with contextual cues and can consolidate motor memories if random and frequent switching occurs. Because significant aftereffects were seen, this study suggests that multiple internal models can be acquired simultaneously during learning and predictively switched, depending only on contextual information.

Cues↗

A computational model of spatio-temporal dynamics in depth filling-in.

We present a computational model based on the heat conduction equation, which can well explain human performance of depth interpolation. The model assumes that the depth information is locally represented and spatial integration is made by iterative processing of mutual interaction of neighbors. It reconstructs a dynamically transforming surface which is in good agreement with the results of psychophysical experiments on depth perception of untextured (uniform-colored) surface moving in depth. The model can also explain a temporal-frequency property of human percept. We conclude that the local ambiguity, which is quite common in everyday visual scenes, is solved by an interpolation mechanism based on iterative local interaction of locally represented visual information.

Depth Perception↗

Reinforcement learning with via-point representation.

In this paper, we propose a new learning framework for motor control. This framework consists of two components: reinforcement learning and via-point representation. In the field of motor control, conventional reinforcement learning has been used to acquire control sequences such as cart-pole or stand-up robot control. Recently, researchers have become interested in hierarchical architecture, such as multiple levels, and multiple temporal and spatial scales. Our new framework contains two levels of hierarchical architecture. The higher level is implemented using via-point representation, which corresponds to macro-actions or multiple time scales. The lower level is implemented using a trajectory generator that produces primitive actions. Our framework can modify the ongoing movement by means of temporally localized via-points and trajectory generation. Successful results are obtained in computer simulation of the cart-pole swing up task.

Computer Simulation↗

A via-point time optimization algorithm for complex sequential trajectory formation.

In our previous research, we proposed a method for the reproduction of complex movement trajectories and robot arm control that could mimic fast, skilled human movements. That method is based on bi-directional theory and uses a representation of a set of via-points as boundary conditions or control variables to perform robot arm trajectory control. The via-points are extracted from human movement data and the resultant via-point representation is able to regenerate handwritten characters, control a Kendama toy, and perform a tennis serve. The via-point information contains both spatial and temporal information, that is, the position on the trajectory and the time of passing through the via-point position, respectively. Trajectory generation is performed using the trajectory formation model based on the optimal criterion, namely, the smoothness criterion, for which the boundary conditions are both the position and the timing of the via-point information. However, generating a smooth trajectory at different movement speeds is quite difficult if the time of passing through the via-point position is unknown or different from the extracted via-point time. In this paper, we therefore propose a new algorithm which can determine temporal via-point information. Our proposed algorithm can generate roughly the same trajectory as the measured human trajectory from only the spatial information of via-point locations. The optimality and the convergence of the new algorithm are investigated theoretically, and the trajectory generated by the algorithm is shown in numerical experiments. It is shown that starting from arbitrary temporal information the proposed algorithm can produce an appropriate trajectory.

Algorithms↗

Hierarchical Bayesian estimation for MEG inverse problem.

Source current estimation from MEG measurement is an ill-posed problem that requires prior assumptions about brain activity and an efficient estimation algorithm. In this article, we propose a new hierarchical Bayesian method introducing a hierarchical prior that can effectively incorporate both structural and functional MRI data. In our method, the variance of the source current at each source location is considered an unknown parameter and estimated from the observed MEG data and prior information by using the Variational Bayesian method. The fMRI information can be imposed as prior information on the variance distribution rather than the variance itself so that it gives a soft constraint on the variance. A spatial smoothness constraint, that the neural activity within a few millimeter radius tends to be similar due to the neural connections, can also be implemented as a hierarchical prior. The proposed method provides a unified theory to deal with the following three situations: (1) MEG with no other data, (2) MEG with structural MRI data on cortical surfaces, and (3) MEG with both structural MRI and fMRI data. We investigated the performance of our method and conventional linear inverse methods under these three conditions. Simulation results indicate that our method has better accuracy and spatial resolution than the conventional linear inverse methods under all three conditions. It is also shown that accuracy of our method improves as MRI and fMRI information becomes available. Simulation results demonstrate that our method appropriately resolves the inverse problem even if fMRI data convey inaccurate information, while the Wiener filter method is seriously deteriorated by inaccurate fMRI information.

Algorithms↗

Activation of the human superior temporal gyrus during observation of goal attribution by intentional objects.

Previous functional imaging experiments in humans showed activation increases in the posterior superior temporal gyrus and sulcus during observation of geometrical shapes whose movements appear intentional or goal-directed. We modeled a chase scenario between two objects, in which the chasing object used different strategies to reach the target object: The chaser either followed the target's path or appeared to predict its end position. Activation in the superior temporal gyrus of human observers was greater when the chaser adopted a predict rather than a follow strategy. Attending to the chaser's strategy induced slightly greater activation in the left superior temporal gyrus than attending to the outcome of the chase. These data implicate the superior temporal gyrus in the identification of objects displaying complex goal-directed motion.

Adult↗

The neural computation of the aperture problem: an iterative process.

The aperture problem is defined as one of integrating motion information from inside and outside of the aperture, and determination of the true direction of motion of a line. Much is known about it and many models have been proposed for its neural mechanisms. However, it is still a matter of debate whether the brain solves the problem by using only feed-forward neural connections, also known as the one-shot algorithm, or by using the iterative algorithm while utilizing feedback as well as horizontal neural connections. Here we show unequivocal evidence for the latter model. The model was tested using critically designed psychophysical experiments and the results were perfectly in line with the psychophysical performance of the observers.

Algorithms↗

Functional significance of stiffness in adaptation of multijoint arm movements to stable and unstable dynamics.

This study compared the mechanisms of adaptation to stable and unstable dynamics from the perspective of changes in joint mechanics. Subjects were instructed to make point to point movements in force fields generated by a robotic manipulandum which interacted with the arm in either a stable or an unstable manner. After subjects adjusted to the initial disturbing effects of the force fields they were able to produce normal straight movements to the target. In the case of the stable interaction, subjects modified the joint torques in order to appropriately compensate for the force field. No change in joint torque or endpoint force was required or observed in the case of the unstable interaction. After adaptation, the endpoint stiffness of the arm was measured by applying displacements to the hand in eight different directions midway through the movements. This was compared to the stiffness measured similarly during movements in a null force field. After adaptation, the endpoint stiffness under both the stable and unstable dynamics was modified relative to the null field. Adaptation to unstable dynamics was achieved by selective modification of endpoint stiffness in the direction of the instability. To investigate whether the change in endpoint stiffness could be accounted for by change in joint torque or endpoint force, we estimated the change in stiffness on each trial based on the change in joint torque relative to the null field. For stable dynamics the change in endpoint stiffness was accurately predicted. However, for unstable dynamics the change in endpoint stiffness could not be reproduced. In fact, the predicted endpoint stiffness was similar to that in the null force field. Thus, the change in endpoint stiffness seen after adaptation to stable dynamics was directly related to changes in net joint torque necessary to compensate for the dynamics in contrast to adaptation to unstable dynamics, where a selective change in endpoint stiffness occurred without any modification of net joint torque.

Adaptation, Physiological↗

Modular organization of internal models of tools in the human cerebellum.

Human capabilities in manipulating many different tools with dexterity suggest modular neural organization at functional levels, but anatomical modularity underlying the capabilities has yet to be demonstrated. Although modularity in phylogenetically older parts of the cerebellum is well known, comparable modularity in the lateral cerebellum for cognitive functions remains unknown. We investigated these issues by functional MRI (fMRI) based on our previous findings of a cerebellar internal model of a tool. After subjects intensively learned to manipulate two novel tools (the rotated mouse whose cursor appeared at a rotated position, and the velocity mouse whose cursor velocity was proportional to the mouse position), they could easily switch between the two. The lateral and posterior cerebellar activities for the two different tools were spatially segregated, and their overlaps were <10%, even at low statistical thresholds. Activities of the rotated mouse were more anterior and lateral than the velocity mouse activities. These results were consistent with predictions by the MOdular Selection And Identification Controller (MOSAIC) model that multiple internal models compete to partition sensory-motor experiences and their outputs are linearly combined for a particular context.

Adult↗

A unifying computational framework for motor control and social interaction.

Recent empirical studies have implicated the use of the motor system during action observation, imitation and social interaction. In this paper, we explore the computational parallels between the processes that occur in motor control and in action observation, imitation, social interaction and theory of mind. In particular, we examine the extent to which motor commands acting on the body can be equated with communicative signals acting on other people and suggest that computational solutions for motor control may have been extended to the domain of social interaction.

Humans↗

Spatio-temporal dynamics of depth propagation on uniform region.

The depth of each point on a binocularly presented untextured horizontal bar is physically ambiguous except for the two vertical edges at both ends, since the correspondence between left and right images is not unique on such a uniform region. These depths, however, are unambiguously perceived, and this suggests the existence of some mechanism that interpolates the depth information from the two ends toward the center. Temporal properties of this integration process were examined by a phase-matching task, which allowed us to measure the phase of the perceived depth at the center of a horizontal bar when disparities at the ends were sinusoidally oscillated. We found that the perceived depth at the center of the bar was slightly temporally delayed for 7-60 ms relative to the physical depth at the ends. The difference increased with the length of the bar, decreased as the vertical position of the bar became farther from the fixation point, and increased in the presence of occluders. This finding indicates that depth information is propagated over an object to solve this ambiguity by using a time-consuming process. Accordingly, we suggest that depth propagation is accomplished by spatially local diffusion-like interactions of locally represented depth information.

Analysis of Variance↗

Internal forward models in the cerebellum: fMRI study on grip force and load force coupling.

Internal models are neural mechanisms that can mimic the input-output or output-input properties of the motor apparatus and external objects. Forward internal models predict sensory consequences from efference copies of motor commands. There is growing acceptance of the idea that forward models are important in sensorimotor integration as well as in higher cognitive function, but their anatomical loci and neural mechanisms are still largely unknown. Some of the most convincing evidence that the central nervous system (CNS) makes use of forward models in sensory motor control comes from studies on grip force-load force coupling. We first present a brief review of recent computational and behavioral studies that provide decisive evidence for the utilization of forward models in grip force-load force coupling tasks. Then, we used functional magnetic resonance imaging (fMRI) to measure the brain activity related to this coupling and demonstrate that the cerebellum is the most likely site for forward models to be stored.

Adult↗

Acquisition and contextual switching of multiple internal models for different viscous force fields.

Humans can learn an enormous number of motor behaviors in different environments. To explain this, the MOSAIC model proposes that multiple internal models are acquired in the brain, which can be switched. However, previous behavioral studies that examined arm-movement adaptations to multiple environments reported a rather limited learning capability. Hitherto, humans have been believed incapable of learning two opposite viscous force fields, which are both dynamic transformations and depend on the same state variable, presented in a random order with only a visual cue. In contrast, this study found that humans are capable of this. Elbow joint movements to specified targets were perturbed by either resistive or assistive viscous force fields generated by a single degree-of-freedom manipulandum. The resistive or assistive viscous force fields were cued by a blue or red color on a CRT screen, respectively. The squared distance between the end point and the target, and the variance of the joint angular velocities were used as kinematic performance indices. These movement errors decreased significantly as a function of the training days. Aftereffects and learning consolidation were demonstrated in the random presentation of the two force fields. Consequently, humans were able to learn the multiple and distinct internal models of the two force fields and appropriately switch them even for a random presentation cued only by color after several days of training. This study suggests that none of the previously proposed conditions for multiple internal model learning are necessary prerequisites, and indicates that the difficulty in learning is determined by the balance between the effectiveness of contextual information and the similarity of force fields.

Adaptation, Psychological↗

Inter-module credit assignment in modular reinforcement learning.

Critical issues in modular or hierarchical reinforcement learning (RL) are (i) how to decompose a task into sub-tasks, (ii) how to achieve independence of learning of sub-tasks, and (iii) how to assure optimality of the composite policy for the entire task. The second and last requirements are often under trade-off. We propose a method for propagating the reward for the entire task achievement between modules. This is done in the form of a 'modular reward', which is calculated from the temporal difference of the module gating signal and the value of the succeeding module. We implement modular reward for a multiple model-based reinforcement learning (MMRL) architecture and show its effectiveness in simulations of a pursuit task with hidden states and a continuous-time non-linear control task.

Learning↗

Attentional modulation of oscillatory activity in human visual cortex.

The effects of attentional modulation on activity within the human visual cortex were investigated using magnetoencephalography. Chromatic sinusoidal stimuli were used to evoke activity from the occipital cortex, with attention directed either toward or away from the stimulus using a bar-orientation judgment task. For five observers, global magnetic field power was plotted as a function of time from stimulus onset. The major peak of each function occurred at about 120 ms latency and was well modeled by a current dipole near the calcarine sulcus. Independent component analysis (ICA) on the non-averaged data for each observer also revealed one component of calcarine origin, the location of which matched that of the dipolar source determined from the averaged data. For two observers, ICA revealed a second component near the parieto-occipital sulcus. Although no effects of attention were evident using standard averaging procedures, time-varying spectral analyses of single trials revealed that the main effect of attention was to alter the level of oscillatory activity. Most notably, a sustained increase in alpha-band (7-12 Hz) activity of both calcarine and parieto-occipital origin was evident. In addition, calcarine activity in the range of 13-21 Hz was enhanced, while calcarine activity in the range of 5-6 Hz was reduced. Our results are consistent with the hypothesis that attentional modulation affects neural processing within the calcarine and parieto-occipital cortex by altering the amplitude of alpha-band activity and other natural brain rhythms.

Adult↗