Journal of Software Engineering and Applications
Vol.09 No.07(2016), Article ID:68623,20 pages
10.4236/jsea.2016.97023

Neural and Spinal Modules in Implementation of a Simple Ballistic Movement

Hooshang Hemami1, Behzad Dariush2

1Department of Electrical and Computer Engineering, The Ohio State University, Columbus, USA

2Honda Research Institute, Mountain View, USA

Copyright © 2016 by authors and Scientific Research Publishing Inc.

This work is licensed under the Creative Commons Attribution International License (CC BY).

http://creativecommons.org/licenses/by/4.0/

Received 24 March 2016; accepted 16 July 2016; published 19 July 2016

ABSTRACT

A simple ballistic movement and two of its attributes (namely, reversal in time and synchronization with external events) are formulated. A three-dimensional, three-link musculoskeletal arm is subjected to a fast ballistic type movement. The central components of the movement from hippocampal, cerebellar, basal ganglia and reticular formation structures that may be involved in timing are identified. The role of agonist muscles and spinal reflexes in the execution of ballistic movements (namely, in fast starts and fast stops) is discussed. The needed three time intervals are constructed in real time and can be coordinated with external events. Delaying or advancing in time, synchronization, time scaling and inverting events in time relative to the movement is formulated. Digital computer simulations are presented to test the behavior of the formulated neural and spinal processing and demonstrate the behavior of the arm under such control.

Keywords:

Arm Model, Ballistic Movement, Event Timing, Neural Modules and Spinal Reflex

1. Introduction

This paper is involved with the formulation of rudimentary quick human movements. Examples can be cited in softball [1] [2] , kicking a soccer ball [3] - [5] , jumping off the ground [6] - [8] and performing a back somersault [9] - [11] . These movements are also referred to as ballistic movements [12] [13] . The ballistic movement, as formulated here, may be triggered by and synchronized with external events, may have to be reversed in time [14] [15] , and requires three consecutive phases in time. The three time intervals and the required central processing in each are vital to the execution of the movement. The timing and time event processing [16] - [19] may be carried out in the hippocampus [20] [21] , the cerebellum [22] , basal ganglia, and the reticular formation [23] .

The dynamics can be derived using different principles [24] [25] . Substantial research that merits a review of its own has been carried out by Soechting and colleagues [26] - [29] on the human arm. Iqbal and Roy [30] present a sagittal neuromusculoskeletal system. Simpler systems also have been proposed [31] . Three degrees of freedom are assumed at every joint here. More physiologically realistic constraints at the elbow and the wrist [32] [33] could be considered and related to experimental observations [34] [35] .

The three-link arm is equipped with 15 pairs of muscles and has already been used in some upper extremity research [36] - [38] . A virtual neuromusculoskeletal system is considered in [39] . A model, suitable for simu- lation has been formulated [40] . A model, emphasizing joint coordination, is presented in [41] . Studies of fingers, the palm of the hand, and forearm are carried out in [42] . Mathematical investigations of the arm and the kinematic issues are respectively addressed in [43] [44] . More physiologically accurate moment arms of the muscles, muscle masses, and muscle lengths and moment arms are respectively investigated in [45] - [47] .

The underlying philosophy of control presented here is to centrally command the arm to execute a specific maneuver. Further, it is intended that the three-link model be a building block in larger skeletal systems that would be composed of many such three-link modules. This philosophy of modeling and control merits further study of its own and is not undertaken here.

The ballistic movement from one equilibrium point to a second is brought about by an initial phase of acceleration, a second phase of coasting and a third phase of deceleration and stop. Co-activation [48] guarantees stability. Smoothness of motion and fast stop are implemented by spinal reflexes. Similar strategies of control are cited in the robotic field [38] and for anthropomorphic robots [49] . A number of hypotheses [30] [50] , experimentally-based observations [51] , and animal observations [52] - [54] support the model presented here.

In the present paper, the trajectory of the desired movement of the arm is articulated in the Central Nervous System (CNS) by specifying the nine Bryant angles [55] - [57] as functions of time. Further, the shape of the trajectories here is consistent with Kornhuber’s [51] [58] hypotheses that simple point-to-point movements are ramp type and that the basal ganglia is responsible for the synthesis of the linear trajectories [55] [59] [60] . As stated before, three phases of central and peripheral activity are required. A simple cerebellum model [61] takes care of programming the turning on and off the agonist and antagonist activations [62] and the necessary spinal reflexes [63] . Simple models of the needed basal ganglia and the cerebellum are presented. Specifically, the presentation here is consistent with Evarts’ formulation [64] [65] (namely, the attention set and attention mechanisms [66] ).

Timing is a major component of the implementation of fast movements, motivated by internal events or conditioned by external events, in activities such as sports. More complex related events in the CNS are storage and recall of information, delaying or advancing events in time, synchronizing, time scaling and reversing events in time. Three-phase timed events in tapping, stepping and rocking [67] , are part of a longer sequence in dance. Other examples are compression or expansion of signals in time, i.e, speeding up a movement or slowing it down. A timed event may be part of a pattern generator or an oscillator.

In a dynamic system, described by an Artificial Neural Network (ANN) or a differential equation [68] , a set of programmable gains control the behavior of the system as in cardiac myocytes [68] [69] and ( [70] , page 250). A majority of such motor functions in living systems are described qualitatively, e.g., ( [54] , Figs 41-14 and 42-5). Examples of conditioning and measurement of duration of events that need to be timed and the neural processing needed for timed events are presented in [71] [72] . A description of the conditioned reflex is provided in ( [20] , chapter 10) and in ( [73] , chapter 13).

Chemical agents and neuro-transmitters induce the needed gain changes in many instances. Serotonin is one agent known to increase the duration of action potentials in abdominal and pleural sensory neurons of Aplysia ( [70] , page 250). It inhibits and delays repolarization due to potassium channels. Serotonin may further decrease a voltage-dependent delayed rectifying potassium current and thus prolong the action potential ( [70] , page 254).

Internal timed events are involved in motor learning, natural reflexes, and tight input-output coupling [34] [52] [74] [75] . Psycho-physical experiments [76] point to processing in the CNS that is governed by laws of physics [77] [78] . Arbib ( [79] , page 53) discusses leaky integrators as more realistic physical models of neurons. In Arbib’s view, a neuron circuit with a long time constant becomes an approximate integrator and, hence, a basic memory element. Doeringer and Hogan [50] have estimated the neural transmission delay in the spinal reflex loop of the upper extremity to be in the order of 30 ms, with a transfer function that has a frequency range of zero to less than 2 Hz. An inverse compensator is proposed for the delay, a form of predictor [80] . Predictors are also discussed in ( [81] , page 62) and [82] .

A single trajectory of force or motion [54] [77] can be stored in a tapped delay line [83] [84] , compatible with the structure of short-term memory ( [20] [77] , page 86 and chapter 9). The fading away of the information can be modeled as attenuation in a lossy delay line. Larger units of the CNS function can be envisioned that are involved in signal generation and processing. Time scaling and piece-wise linear signals are examples. Time scaling involves producing a slower or faster movement.

Timed events are also involved when the CNS has to relate internal decisions to external events. Timing [85] - [87] relative to an external cue or alarm could involve associative learning ( [54] , Chapter 65). Timing is also involved in mechanisms of attention [64] , preparation for a movement or in a motor set [73] . The role of the hippocampus in time reversal of movement has been noted [20] [21] , According to Foster and Wilson [14] , while rats rest after running a maze, their brains replay the movements in reverse. The idea of reversing events in time is a case of spatial synchronization of internal action with external events that is expounded later in Section 4 of the paper.

There are cases in the CNS where different sensory neurons fire in synchrony ( [54] , chapter 30, and [88] ). A simple example of this is the eye-blink experiment [89] . In this experiment [20] [90] , blowing a puff of air in a rabbit’s eye will cause the rabbit to blink [90] . Grethe and Thompson [90] review and compare models of this synchronization. Tapped delay lines of different lengths [78] [91] [92] were proposed. Artificial Neural Net- works (ANNs) can mimic the coincidence model of Buhusi and Meck [93] , granule cells begin to oscillate at the start of the conditioned stimulus, and then the outputs of these granule cells are recorded at the time of the stimulus. Nicholls et al. ( [94] , page 552) discuss, for medullary neurons that generate the respiratory rhythm in neonatal opossum, the location of synapses and the incremental time delays that are important in temporal processing and signal shaping. Simultaneous patterns may have to be recalled from storage or from pattern generators ( [70] , chapter 17). Two alternative schemes to generate patterns are by linear filters and neural oscillators [60] [68] [95] - [97] . The transient outward current in the bag cell neuron is shown to contain one exponential function of time with a time constant of 76 ms, and, under the influence of cyclic AMP, to contain a second exponential of a much faster decay (and, hence, a rationale for a second order system). Neuro-trans- mitters change the shape of an action potential ( [70] , page 249), suggesting the possibility of filtering and pro- cessing mechanisms that are implicit. In this case, that mechanism was the narrowing of the action potential pulse in the dorsal root ganglion of a chick. Other patterns are involved in voluntary movements or in elicited maneuvers [98] [99] or slipping and sliding [100] [101] .

For ease of presentation, afferent and efferent neural transmission delays are ignored in this paper [102] [103] . Spinal reflex delays are included because they are crucial to the stability of the ballistic movement. Spinal reflexes and spinal cord injury [104] - [106] , as a whole, merit more serious consideration that is not warranted here. A rudimentary spinal reflex for controlling forces of contact in pushing or pulling is considered in [107] . A simple spinal reflex is modeled here and more physiologically accurate models [80] [108] [109] remain to be included and investigated in the future. Similarly, it is assumed that gravity is fully compensated and does not affect the motion directly [110] . All discussions, models and formulas derived and developed here are limited to the simple ballistic movement and should not be construed to represent universal models of the cerebellum, the basal ganglia, the reticular formation, or the hippocampus.

The structure of the paper is as follows. The dynamics and control of the three-segment arm are briefly discussed in Section 2. The modeling of fast movements is presented in Section 3. The timing issues and central neural structures for the ballistic movement, its reversal in time and conditioning are presented in Section 4. Simulations of a movement (similar to one in throwing a softball) with and without delays in the spinal reflex path are presented in Section 5. Discussions and conclusions follow in Section 6.

2. Arm Dynamics and Stability

The derivation of the dynamics of the three-link arm system are briefly sketched here. The formulation starts with the free body equations. The 18-dimensional vector Z represents the nine translational position states and the nine rotational Bryant angles. The arm is assumed to be connected to an stationary torso (the inertial coordinate system) and, as a consequence, all translational degrees of freedom are eliminated to derive the systems equations in terms of the rotational degrees of freedom. The 18-dimensional state space equations of the system are symbolically written here:

(1)

(2)

There are four nine-vector terms of the second equation. All muscular inputs are included in vector. The are two nonlinear terms: and. The centrifugal term is and the gravity term is. The steps in the definition and the derivation of these vectors are given in [8] [66] .

Stability is achieved by the simultaneous co-activation of agonist-antagonist pairs of muscles by at least three pairs at every joint [111] - [113] . The co-activation produces sufficient position and velocity feedback to bring about stability in the vicinity of the vertical equilibrium position. It can be shown that with no limitation on the amplitudes of the feedback, the system can be globally stabilized [114] . Similarly, for finite feedback amplitudes, the size of the domain of stability can be estimated. For this purpose, Lyapunov functions as the sum of the translational and rotational kinetic energies of both the passive and active tissues and the gravitational energy are considered. The system is stable when the loss of potential energy due to the motion of the system is more than compensated by the energy stored in the elastic structure of the system and sufficient loss occurs in the system.

3. Ballistic Movement

Point-to-point movements can be slow or fast. Slow movements, where the trajectory of motion is defined by linear segments between the initial and final positions, have been considered before [115] . Relatively fast move- ments are discussed in [1] [116] . Hannford and Stark [117] have discussed three actuation phases for such movement. In the beginning phase, initial velocities launch the system. In the middle phase, the system coasts. In the final phase, the movement is quickly brought to a halt. The three phases [118] . are considered below.

3.1. Initial Phase of Acceleration

Suppose the initial stationary position of the arm is specified by. Let the initial desired angular velocity be [119] . Suppose the input is a nine-vector of impulsive moment of forces with magnitude. From Equa- tion (3), it follows that

For the three sagittal angular velocities

the computed vector of impulses is

The individual positive impulses correspond to an active agonist. The negative impulses correspond to anta- gonist activity. Zero impulse corresponds to zero activity in the first phase. Other more accurate pulses could be selected based on Fourier studies of the EMG signals [119] . Realistic Hill effect damping is modeled in the muscle dynamics and provides negative intrinsic velocity feedback in the system. The gain of this feedback is assumed constant, but it could be varied and differently programmed.

The implementation of this phase by a central controller is conducted by either of two approaches:

・ By providing ramp type angular inputs during interval T and maintaining the stiffness of all muscles constant, or

・ By programming a linearly rising stiffness during interval T.

These impulses as torques are produced by constant stiffness. Therefore, the angular inputs are impulses. The position angular impulses can be implemented in three ways: by setting initial velocities as a theoretical refer- ence frame, by implementing the impulse as a finite square pulse over a finite period of time T or by triangular pulses over the same interval. The triangular pulse starts with a finite slope and abruptly drops to zero at time T. For a unit impulse, the area of the pulse is unity and, consequently, the slope is. The choice of the pulse is consistent with Kornhuber’s results [51] [58] that the CNS signals are ramp-like. The time interval T is a parameter and can be adjusted to arrive at physically acceptable muscular forces and joint moments of force ( [1] , Table 11.1, page 188).

3.2. The Coasting Phase

The second phase of the fast movement is coasting, where both the agonists and the antagonists are turned off. There are no angular inputs to the system in this phase, but, for stability purposes, precise velocity feedback is necessary to prevent tremors and oscillations. The linear velocity feedback is implemented by a spinal reflex loop where afferent spindle signals are involved [62] [63] [80] . There is a finite neural transmission delay here. The CNS, through spinal control signals, must precisely regulate the minimal velocity feedback for stability purposes. This velocity feedback cannot depend on the general friction losses in the system and, depending on the characteristics of the desired movement, is learned and regulated by cerebellar control.

3.3. The Stopping Phase

The stopping phase is characterized by centrally defined and programmed input angles. These angles define the terminal position. Co-activation of agonist and antagonist muscles implement the necessary position feedback. The needed precise velocity feedbacks are implemented by spindle feedback and spinal reflexes. The latter velocity feedback loops also involve afferent and efferent transmission delays.

The strategy articulated above is consistent with some of the later studies of slow and ballistic movements [2] . It is worth repeating that in the present formulation, co-contraction takes place only in the stopping phase of movement. At the same time, the issues of the involvement of the motor cortex and motor memory in execution of ballistic movements constitute challenging research problems for the future [120] and ( [55] , pages 440-441). An alternative movement to consider would be the underhand fast pitch in softball, where two phases of accele- ration and stopping may suffice.

4. Timing and Neural Implementation

Three timing issues involved in the movement are presented here and the possible neural involvement of the hippocampus, the reticular formation, the basal ganglia and the cerebellum are delineated. The three timing issues are:

・ reversal of motion timing,

・ parallel event timing, and

・ serial event timing.

For ease of presentation and communication, the functions are illustrated with simple daily events.

4.1. Reversal in Time

The hippocampus is reported to be involved in reversal of motion in animals. Running a movie projector back- ward produces a reversed motion in time. For translational reverse motion (locomotion) in humans or animals, the trajectories of one point should be stored and then reproduced backwards. More importantly, the central control sequences also have to be executed to fit the reverse translational movement.

The point of reference for this purpose is the human head, where the vestibular otolith organs measure the linear acceleration of the head. The hippocampal neural network for reversing the trajectories and the control of movement is shown in Figure 1. Vision and other sensory inputs or external cues are ignored in this paper. The vestibular linear acceleration signals from the otolith must be integrated twice to produce the trajectories of the translational motion. These position trajectories are stored in memory structures that are capable of reflecting the trajectories in time. These memory and processing structures are analogous to putting an ordered sequence of objects in a basket (what goes in last comes out first.) The needed control sequences for the reverse motion are more complicated and do not necessarily correspond to the reverse of the stored control signals.

The memory structure, mentioned above, may be involved in parallel timing and conditional reflexes, where internal events may have to be timed and synchronized with external events, as is discussed below. These

Figure 1. Hippocampal processing for motion reversal. The signals are: S1: otolith linear accelerations, S2: translational velocities, S3: position trajectories, and S4: generated backward trajectories. The processors are I1: time integrator, P1: LIFO processing, and P2: control processing. The commands are C1: to initiate reverse motion, and C4: to output reverse motion.

memory structures also have applications in computer design and programming, and are subsumed under the name Last-In-First-Out (LIFO) stacks. One major use of LIFOs is in multi-level interrupt implementation where, under a higher priority interrupting task, all the registers (states) of the computer are pushed into a stack and wait to be popped after the higher priority task is completed. Human CNS interrupt systems have not been studied in detail at this time. In current computer design all such processing is discrete and an external synchro- nous clock orchestrates all events and steps (stack processing).

An analog version of the implementation of the needed memory structure may take place in the reticular formation where “transmission delay lines” store the trajectories as they flow from the cortex outwards. Upon command C1, they transfer all the information in parallel to an inward-flowing transmission delay line that reverses the trajectory. This process can be imagined as a reflection of the time trajectory about a vertical time line at the moment for reversal. Delay line information and storage also can model procedural memory or short- term memory. Capacity and information loss are two characteristic attributes. The implementation is by neural networks [121] . Newer information will push out older information and short-term memory experiences loss of information over time.

A variation of reverse motion is in periodic movements [122] and dance, where the reverse trajectory may not necessarily be a reflection of the forward trajectory [37] [66] . In this case, an internal clock or the extracted beat of the music (period of beat = T) sets up a clock with period T. The period of the periodic dance motion will be a fixed integer multiple of T. The clock cycle T is used in the basal ganglia for construction of “ramp-like” segments of the motion in successive T intervals [60] . The neural element for one such trajectory construction is sketched later in the paper. The periodic trajectory construction by the basal ganglia is shown in Figure 2.

4.2. Parallel Timing

The classical conditioning experiment [73] is discussed first. Only amplitude modulation is envisioned. The conditioning is represented as a 10-state discrete time event as described below.

・ State 0: The unconditioned stimulus begins and the system starts to measure the duration of the stimulus.

・ State 1: Puff of air is detected, ending the measurement and holding or storing.

・ State 2: Initiate closure of eyes and measure duration of it.

・ State 3: Eyes are closed. Hold or store.

・ State 4: Do subtraction:

.

・ State 5: Wait for next.

・ State 6: arrives and its duration is measured in.

・ State 7: Set equal to.

・ State 8: Initiate CS (closing of eyes).

・ State 9: Eyes are closed, Repeat the above 10-state cycle if necessary.

The discrete event system is shown in Figure 3.

Alternatively, suppose two internal events of different duration must end simultaneously (for example, due to different efferent delays in the execution path.) Suppose the time durations of the two signals are known. One

Figure 2. The design of periodic movements in the basal ganglia based on time intervals T. Alternatively, the trajectories could be recalled from storage in the cortex, but may have to be rescaled in time to fit the extracted beat.

Figure 3. The 10-state representation of a discrete time event for classical conditioning.

delays the faster event so that the terminal time of the two events coincide [102] [123] . Let both events be stored in tapped delay lines. One physiological analog is the parallel fibers in the internal cerebellum processing. A second example is the processing in the reticular formation. A more general case is the terminal synchronization of an arbitrary number of signals. The pairwise computations may not be efficient or quick enough for the CNS. An example of such large events is fixed action patterns ( [72] , Fig. 63.3). It is stated on page 989 that, “each species has a repertory of fixed action patterns generated by central programs.” Presumably, the shaping and timing of these patterns are learned. We only consider the timing issues here.

Two alternative neural structures for this purpose are stacks where concepts from clocked array processing are useful and internal cerebellum-like parallel structures and processing. Let there be n existing events, all having a starting point in time and a stopping point. The beginning point and end point of each event is well marked and known and

Let there be n LIFO stacks, the depth of all being longer than the longest of the n time events. The functioning here is formulated as a clocked discrete time system [84] . Let the depth of the stack be d. The state is of dimension at time k. Let the event vector X be of dimension n. The control signals are pop, push, and inhibit. The push and pop operations are the standard. The inhibition’s operation is more complex and state- dependent and is discussed in some detail below.

The state-space behavior of this linear system is described in words below and can be formulated in matrices:

・ If push and pop are both off, do nothing. The state remains as it was.

・ When push is on, the n values of the events are pushed onto the stack. This operation is continued until the longest event is stored.

・ After the longest event is stored, the pop signal comes on.

・ When pop is on, the immediate values of the top of the stack are extracted.

・ When is to be popped, the inhibition signal i becomes active and discourages any further popping on stack i.

So, the procedure of the stack system pushes all signals in and pops each until reaches the top of the stack. Therefore, once popping is stopped, all the events are synchronized with their last value on the top of the stack. With a second simple stack operation, all the signals, except the longest, are recovered with arbitrary delays in the beginning of each, so they are all synchronized at the end.

It is assumed here that all signals are amplitude modulated, are properly scaled and no time expansion or contraction is necessary. The only operation is that all signals are delayed such that the end of execution is the same for all of them. It is also assumed that the cerebellar parallel fibers are regularly tapped with control inputs and their values output at all the array. Each node also has a second output that identifies whether the node is the beginning or the end has the signal. Suppose the array is. Suppose the signals are all entered from the right so that all end markers are on the right side and all the beginning markers are on the left. The operation of synchronization starts with the following sequence of operations:

・ Step 1: Detect or identify the left-most marker (i.e., identification of the longest signal, say signal J). This operation is simplified by projecting all the n end signals on a parallel fiber that is not a data delay line, but a control delay line.

・ Step 2: Produce an output signal from the detector that inhibits channel j from any inputs but allows all the other channels to accept a zero signal as input.

・ Step 3: Repeat Step 2 above until a second channel’s end signal, say channel k overlaps. Now channel k is also inhibited from taking any more zero inputs. Also, channel 2 is now synchronized with channel j;

・ Step 4: Repeat step 2, except now both channels are inhibited from accepting inputs.

・ Step 5: Repeat inserting zeros until another channel is synchronized.

・ Step 6: Stop when the last channel is synchronized, and

・ Step 7: Empty the parallel fiber array from the left to some appropriate memory.

4.3. Sequential Timing

For the ballistic movement here, the control must be designed differently for three consecutive intervals of time of known durations. The production of these signals, produced in the basal ganglia and issued to the cerebellum in “climbing fibers”, is shown in Figure 4 where the input signal is unity. The output is proportional to time. Once the first interval is constructed, the circuit starts the second interval, and so forth. Sequential triggering of signals and chaining is one way to generate commands for complex movements. The same neural circuit could be used to measure duration of CS in the conditional reflex measurement. Another variation of this basal ganglia circuit is used for pattern generation [60] . The circuit demonstrates the flexibility of the CNS in using the same circuits with synaptic and interneuron control for a variety of goals and purposes ( [71] , Chapter 65). The process of measuring time durations in the basal ganglia can be compared with the stack-processing method of per- forming the same computations. Stack processing is much simpler, but not as versatile. It can be conjectured that perhaps the stack system is the processing unit in nature’s more primitive nervous systems. By changing the

Figure 4. Time measurement in the basal ganglia consisting of three circuits: gain control, integrator, and holding (short memory). The processing is initiated by the unconditioned stimulus and ends with the end of it which commands the holding operation of duration. When the input is equal to unity, the circuit measures time.

slope of the ramp signal, the duration of any event can be changed. A slope larger than unity produces a com- pressed signal, and a slope less than unity stretches the signal linearly in time.

5. Simulation of Ballistic Movement

The simulation has four components here: the basal ganglia for time and trajectory construction, the cerebellum for setting the gains, the musculoskeletal system and the spinal reflexes. The ramp-type trajectories for time measurement and pattern generation are constructed in the basal ganglia [60] and ( [55] , Table 23.1, page 448). The first phase of movement starts as output of a block. When the first phase is complete, a trigger starts the second phase and, subsequently, a third phase. Asynchronous “one-shot” electronic circuits without a clock could be used to measure the three time intervals.

The cerebellum is involved in the selection of the activation levels of the muscles in phase one, in inhibition of position-dependent forward activation and disinhibition of spinal reflexes in phase two, and in both co- activation and maintenance of precise spinal reflexes in phase three. These inhibitions and disinhibitions occur in the motor cortex for preprogrammed movements according to Evarts ( [65] , page 178), and also conform to the summary of functions of the cerebellar outputs as given by Brooks ( [73] , page 287). Other activities may be involved in this path to the cortex, as discussed by Ghez ( [124] , page 637).

From input position angles and known gains K, the cerebellum produces products. In a better model than this, the cerebellum would produce many output functions for a corresponding input signal. The following assumptions are made:

・ The basket, Golgi and stellate cells regulate internal gains and internal stability of the cerebellum.

・ The cerebellum is assumed as a memoryless algebraic function generator, consistent with Pellionisz and Llina’s hypotheses [125] - [127] , where there are outputs from Purkinje cells (or sums of Purkinje cell outputs) and two classes of inputs.

・ Climbing fibers as (possibly binary) discrete events and conditions are one input class.

・ Mossy fiber inputs are trajectories and other functions of time.

・ The possible addition (or summing) of Purkinje cell outputs to construct larger signals (in frequency), which may require delicate timing mechanisms, is also ignored. Simple amplitude addition is employed here.

The requirement that all the signal processing in the cerebellum be formulated in frequency domain and with pulse signals merits a challenging and independent study. It also requires that the Purkinje cell outputs involved for the same large function have differently timed windows such that their pulses add together in adjacent intervals of time. This mechanism allows construction of signals with large intensity. It could also explain the “inhibitory” nature of the Purkinje cells.

A sketch of the control activity of the three phases is shown in Figure 5.

We also note that reversing the control here does not reverse the movement. The movement is from a vertically extended position and takes place in the sagittal plane. Initially, all 18 positions and velocities are zero.

Figure 5. A block diagram sketching the control machinery involved in the neural control. All three phases have inputs constructed in the basal ganglia-ramp signals for the first phase and constant signals for phases two and three. The inhibitory and disinhibitory activation signals are issued by the cerebellum-inhibiting antagonists in phase one, inhibiting both agonists and antagonists in phase two, and dis-inhibiting both groups in phase three. The rest of the arm muscles and the torso are co-activated to maintain a steady arm and a stationary torso.

In the terminal state, the three sagittal (pitch) angles are, respectively, radians and the rest of the position states (roll and yaw angles) and all the velocities are zero. The stiffness matrix is constructed from nine pairs of single-joint and six pairs of biarticular muscles, and is assumed to be constant throughout the movement. It is given in the Appendix.

The initial phase is assumed to take 10 ms and the three sagittal angles, i.e., the three pitch angles of the upper arm, lower arm and hand are expected to rise to 5 rad./sec. The triangular pulse scheme is used for 10 ms to initiate the movement. The three angles, angular velocities and the negative feedback moments of forces at the joints are shown in Figure 6. The other six angles remain zero and are not plotted. If the rest of the body, i.e., the torso, etc. was modeled (under co-activation) it would provide a stable platform as an inertial coordinate system from which the arm’s movement is launched.

At t = 0.5 second, i.e, the end of the free coasting cycle, the three nonzero sagittal positions are

The three non-zero sagittal velocities are

As can be seen, only the sagittal pitch position and angles are non-zero. Suppose it is desired to stop the system at that state. For the last phase, co-activation is implemented and, further, spinal reflex feedback is used to slow the system to an over-damped halt with no terminal oscillations. The gain of the spinal reflex is 0.2 in the coasting phase and unity in the stopping phase. This means about one fifth of co-activation gains in coasting and unity in the stopping phase. The co-activation gains are kept constant in the simulation of the ballistic movement. The three angles, angular velocities, and the negative feedback moments of forces at the joints are shown in Figure 7.

Figure 6. The agonist impulsive phase 1 of the movement: the three pitch angles, angular velocities and joint damping due to Hill effect are shown as functions of time.

Figure 7. The whole ballistic movement: the three pitch angles, angular velocities and joint damping due to spinal reflexes (active in phases two and three) are shown as functions of time. No delay is included in the reflex paths.

In the next three simulations, neural transmission delays are added to the spinal reflex. In Figure 8, a delay of 5 ms is added in the neural path of the spinal reflex.

In Figure 9, the delay is increased to 10 ms. In Figure 10, the delay is kept at 10 ms, but the gain of the spinal reflex feedback loop is reduced by half for all three muscles involved.

6. Discussion and Conclusions

Neural modules were presented for the implementation of ballistic movements that may be reversed in time or conditioned and synchronized with external events. The role in the execution of movement of four central neural structures, hippocampus, the reticular formation, the basal ganglia and the cerebellum, was outlined.

The role of procedural memory was illustrated. Time scaling by basal ganglia circuits was demonstrated. Neural structures involved in time reversal of trajectories were discussed. Reversal of control sequences was not considered and remained a challenge for the future. Use of LIFO stacks for synchronization of large numbers of signals was formulated.

The point-to-point fast movement is implemented by assuming that the CNS has information about the nine Bryant angles at the initial and terminal position of the arm. Such information could be inferred by the CNS from the stretch responses of all the muscles that are relayed to the CNS at any position of the arm, and then kept, in an associative memory, with the visually encoded position of the arm. More research is necessary to establish the above hypotheses.

The central feed forward signals were the desired limb trajectories. The co-activation of 15 pairs of agonist- antagonist muscles produced the necessary muscular feedback. The tendons played a role here in controlling of their length allow control of stiffness.

Figure 8. The whole ballistic movement: the three pitch angles, angular velocities and joint damping due to spinal reflexes (active in phases two and three) are shown as functions of time. The delay in the reflex path is 5 ms.

Figure 9. The whole ballistic movement: the three pitch angles, angular velocities and joint damping due to spinal reflexes (active in phases two and three) are shown as functions of time. The delay in the reflex path is 10 ms. The gain of the reflex feedback loop is the same as the previous case.

Figure 10. The whole ballistic movement: the three pitch angles, angular velocities and joint damping due to spinal reflexes (active in phases two and three) are shown as functions of time. The neural delay in the reflex path is 10 ms, and the gain of the reflex feedback loop is half as much as for the previous figures.

It is instructive to compare the co-activation strategies of this paper with the ones attributed to the human system ( [73] , Fig. 4.11). The model here has to be contrasted with “length follow-up servo” as in ( [73] , Fig 4.11 A and B).

The gains of the feed forward path are set centrally, and not mediated by Golgi and afferent signals involved in feedback from the spinal cord ( [73] , Fig 4.11 C). Finally, precisely controlled spinal reflexes of velocity are needed in the third phase of the ballistic movement. The ballistic movement was specified and controlled in three phases of initial acceleration, coasting, and stopping. All three phases require construction of reference input trajectories in the basal ganglia and inhibition and disinhibition of muscular activities, prompted by the CNS and spinal reflexes by the cerebellum. Computer simulation showed how the system works, and the effect of delays in the spinal reflex loop was demonstrated.

Existing measurements could be used to tune the model parameters and improve the model and the simulation results. With recent posture estimation techniques [128] [129] , one could train or teach robots to play softball [130] . The performance of the above model can be improved [131] for human applications [132] - [134] and by anatomical accuracy [45] - [47] . More quantitative studies of the sensory and processing deficits, injuries and deficiencies could be undertaken [104] [106] [132] .

Acknowledgements

The authors are very grateful and indebted to Professor H. C. Ko, former chair and professor emeritus of the Electrical and Computer Engineering Department at The Ohio State University, for his generosity, vision, sustained support and encouragement of this work. We would like to acknowledge support of R. J. Garbacz, Lee Potter, Patrick Roblin and Vadim Utkin. We are indebted to Darla Peelle and David B. Ball for editorial assistance and inspiration.

Cite this paper

Hooshang Hemami,Behzad Dariush, (2016) Neural and Spinal Modules in Implementation of a Simple Ballistic Movement. Journal of Software Engineering and Applications,09,326-345. doi: 10.4236/jsea.2016.97023

References

  1. 1. Rasch, P.J. and Burke, R.K. (1978) Kinesiology and Applied Anatomy. 6th Edition, Lea and Febiger, Philadelphia.

  2. 2. Basmajian, J.V. (1978) Muscles Alive. The Williams and Wilkins Company, Baltimore.

  3. 3. Aagaard, P., Trolle, E.B., Simonsen, J., Bangsbo, J. and Klausen, K. (1993) High Speed Knee Extension Capacity of Soccer Players after Different Kinds of Strength Training. In: Reilly, T., Clarys, J. and Stibbe, A., Eds., Science and Football II, E & FN Spon, London, 92-94.

  4. 4. Chen, Z. and Hemami, M. (2007) Sliding Mode Control of Kicking a Soccer Ball in the Sagittal Plane. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 6, 1131-1139.
    http://dx.doi.org/10.1109/TSMCA.2007.906573

  5. 5. Dicks, M., Davids, K. and Button, C. (2010) Individual Differences in the Visual Control of Intercepting a Penalty Kick in Association Football. Human Movement Science, 29, 401-411.
    http://dx.doi.org/10.1016/j.humov.2010.02.008

  6. 6. Pandy, M.G., Zajac, F.E., Sim, E. and Levine, W.S. (1990) An Optimal Control Model for Maximum-Height Human Jumping. Journal of Biomechanics, 12, 1185-1198.
    http://dx.doi.org/10.1016/0021-9290(90)90376-E

  7. 7. Anderson, F.C. and Pandy, M.G. (1999) A Dynamic Optimization Solution for Vertical Jumping in Three Dimensions. Computer Methods in Biomechanics and Biomedical Engineering, 2, 201-231.
    http://dx.doi.org/10.1080/10255849908907988

  8. 8. Hemami, H. and Wyman, B.F. (2012) A Simple Strategy for Jumping Straight up. Mathematical Biosciences, 237, 28-37.
    http://dx.doi.org/10.1016/j.mbs.2012.03.003

  9. 9. Khosravi-Sichani, B. (1985) Control of Multi-Linkage Planar Systems in the Air and on the Ground. PhD Thesis, The Ohio State University.

  10. 10. Khosravi-Sichani, B., Yurkovich, S. and Hemami, H. (1987) Control of a Four-Link Biped in a Back Somersault Maneuver. IEEE Transactions on Systems, Man and Cybernetics, 17, 303-311.
    http://dx.doi.org/10.1109/TSMC.1987.4309042

  11. 11. Khosravi-Sichani, B., Hemami, H. and Yurkovich, S. (1992) Energy Transformations in Human Movement by Impact. Journal of Biomechanics, 25, 881-889.
    http://dx.doi.org/10.1016/0021-9290(92)90228-S

  12. 12. Mussa-Ivaldi, F.A., Hogan, N. and Bizzi, E. (1985) Neural Mechanisms, and Geometrical Factors Subserving Arm Posture in Humans. The Journal of Neuroscience, 5, 2732-2742.

  13. 13. Nikravesh, P.E. and Haug, E.J. (1983) Generalized Coordinate Partioning for Analysis of Mechanical Systems with Nonholonomic Constraints. Journal of Mechanisms, Transmissions, and Automation in Design, 105, 379-384.
    http://dx.doi.org/10.1115/1.3267371

  14. 14. Asanuma, H. and Rosen, I. (1972) Topographical Organization of Cortical Efferent Zones Projecting to Distal Forelimb Muscles in the Monkey. Experimental Brain Research, 14, 243-256.
    http://dx.doi.org/10.1007/BF00816161

  15. 15. Ajemian, R., Bullock, D. and Grossberg, S. (2000) Kinematic Coordinates in Which Motor Cortical Cells Encode Movement Direction. Journal of Neurophysiology, 84, 2191-2203.

  16. 16. Li, B. (2012) Human-Like Robotic Handwriting and Drawing. Master’s Thesis, The Ohio State University, Columbus.

  17. 17. Che, D. (2012) Toward Humanoid Choreography and Dance. Master’s Thesis, The Ohio State University, Columbus.

  18. 18. Li, B., Zheng, Y.-F., Hemami, H. and Che, D. (2013) Human-Like Robotic Hand-Writing and Drawing. Proceedings 2013 IEEE International Conference on Robotic and Automation, Karlsruhe, 6-10 May 2013, 1050-4729.

  19. 19. Pennestri, E., Stefanelli, R., Valentini, P.P. and Vita, L. (2007) Virtual Musculo-Skeletal Model for the Biomechanical Analysis of the Upper Limb. Journal of Biomechanics, 40, 1350-1361.
    http://dx.doi.org/10.1016/j.jbiomech.2006.05.013

  20. 20. Lemay, M. and Crago, P. (1996) A Dynamic Model for Simulating Movements of the Elbow, Forearm, and the Wrist. Journal of Biomechanics, 29, 1319-1330.
    http://dx.doi.org/10.1016/0021-9290(96)00026-7

  21. 21. Rau, G., Disselhorst-Klug, C. and Schmidt, R. (2000) Movement Biomechanics Goes Upwards: From the Leg to the Arm. Journal of Biomechanics, 33, 1207-1216.
    http://dx.doi.org/10.1016/S0021-9290(00)00062-2

  22. 22. Freund, J. and Takala, E. (2001) A Dynamic Model of the Forearm Including Fatigue. Journal of Biomechanics, 34, 597-605.
    http://dx.doi.org/10.1016/S0021-9290(01)00009-4

  23. 23. Raikova, R. (1998) A General Approach for Modeling and Mathematical Investigation of the Human Upper Limb. Journal of Biomechanics, 25, 857-867.
    http://dx.doi.org/10.1016/0021-9290(92)90226-Q

  24. 24. Williams, S., Schmidt, R., Disselhorst-Klug, C. and Rau, G. (2006) An Upper Body Model for the Kinematical Analysis of the Joint Chain of the Human Arm. Journal of Biomechanics, 39, 2419-2429.
    http://dx.doi.org/10.1016/j.jbiomech.2005.07.023

  25. 25. Pigeon, P., Yahia, L. and Feldman, A. (1996) Moment Arms and Lengths of Human Upper Limb Muscles as Functions of Joint Angles. Journal of Biomechanics, 29, 1365-1370.
    http://dx.doi.org/10.1016/0021-9290(96)00031-0

  26. 26. Pai, D. (2010) Muscle Mass in Musculoskeletal Models. Journal of Biomechanics, 43, 2093-2098.
    http://dx.doi.org/10.1016/j.jbiomech.2010.04.004

  27. 27. Rankin, J. and Neptune, R. (2012) Musculotendon Lengths and Moment Arms for a Three-Dimensional Upper-Extremity Model. Journal of Biomechanics, 45, 1739-1744.
    http://dx.doi.org/10.1016/j.jbiomech.2012.03.010

  28. 28. Morasso, P.G. and Schieppati, M. (1999) Can Muscle Stiffness Alone Stabilize Upright Standing? Journal of Neurophysiology, 82, 1622-1626.

  29. 29. Benati, M., Gaglio, S., Moraso, P., Tagliasco, V. and Zaccaria, R. (1980) Anthropomorphic Robotics. Biological Cybernetics, 38, 125-140.
    http://dx.doi.org/10.1007/BF00337402

  30. 30. Doeringer, J. and Hogan, N. (1998) Serial Processing in Human Movement Production. Neural Networks, 11, 1345-1356.
    http://dx.doi.org/10.1016/S0893-6080(98)00083-5

  31. 31. Miall, R.C. (1995) Motor Control, Biological and Theoretical. In: Arbib, M., Ed., The Handbook of Brain Theory and Neural Networks, the MIT Press, Cambridge, 597-600.

  32. 32. Michel, A.N. and Wang, K. (1995) Qualitative Theory of Dynamical Systems: The Role of Stability Preserving Mappings. Marcel Dekker, New York.

  33. 33. Buhusi, C.V. and Meck, W.H. (2005) What Makes Us Tick? Functional and Neural Mechanisms of Interval Timing. Nature Reviews Neuroscience, 6, 755-765.
    http://dx.doi.org/10.1038/nrn1764

  34. 34. Nicholls, J.G., Martin, A.R. and Wallace, B.G. (1992) From Neuron to Brain. 3rd Edition, Sinauer Associates Inc.

  35. 35. Wang, L. and Alkon, D.L. (1993) Artificial Neural Networks. IEEE Computer Society, Piscataway.

  36. 36. Kaczmarek, L.K. and Levitan, I.B. (1987) Neural Modulation: The Biochemical Control of Neuronal Excitability. Oxford University Press, New York.

  37. 37. Hemami, H., Clymer, B.D. and Hemami, M. (2012) Control and Synthesis of a Constrained Movement towards Rehabilitation Exercises. Integrated Computer-Aided Engineering, 19, 351-364.

  38. 38. McCollum, G., Horak, F.B. and Nashner, L.M. (1984) Parsimony in Neural Calculations for Postural Movements. In: Bloedel, J.R., Dichgans, J. and Precht, W., Eds., Cerebellar Functions, Springer-Verlag, Berlin, 52-66.
    http://dx.doi.org/10.1007/978-3-642-69980-1_4

  39. 39. Szturm, T. and Fallang, B. (1998) Effects of Varying Acceleration of Platform Translation and Toes-Uprotations on the Pattern and Magnitude of Balance Reactions in Humans. Journal of Vestibular Research, 8, 381-397.
    http://dx.doi.org/10.1016/S0957-4271(97)00087-6

  40. 40. Pai, Y.-C. and Iqbal, K. (1999) Simulated Movement Termination for Balance Recovery: Can Movement Strategies Be Sought to Maintain Stability in the Presence of Slipping or Forced Sliding? Journal of Biomechanics, 32, 779-786.
    http://dx.doi.org/10.1016/S0021-9290(99)00074-3

  41. 41. Pai, Y.-C. (1999) Induced Limb Collapse in a Sudden Slip during Termination of Sit to Stand. Journal of Biomechanics, 32, 1377-1382.
    http://dx.doi.org/10.1016/S0021-9290(99)00126-8

  42. 42. Hemami, H. and Ozbay, H. (2000) Modeling and Control of Biological Systems with Multiple Afferent and Efferent Transmission Delays. Journal of Robotic Systems, 17, 609-622.
    http://dx.doi.org/10.1002/1097-4563(200011)17:11<609::AID-ROB3>3.0.CO;2-V

  43. 43. Stroeve, S. (1996) Learning Combined Feedback and Feed forward Control of a Musculoskeletal System. Biological Cybernetics, 75, 73-83.
    http://dx.doi.org/10.1007/BF00238741

  44. 44. Audu, M.L., Kirsch, R.F. and Triolo, R.J. (2003) A Computational Technique for Determining the Ground Reaction Forces in Human Bipedal Stance. Journal of the Applied Biomechanics, 19, 361-371.

  45. 45. Audu, M.L., Kirsch, R.F. and Triolo, R.J. (2007) Experimental Verification of a Computational Technique for Determining the Ground Reaction Forces in Human Bipedal Stance. Journal of the Biomechanics, 40, 1115-1124.
    http://dx.doi.org/10.1016/j.jbiomech.2006.04.016

  46. 46. Gartman, S.J., Audu, M.L., Kirsch, R.F. and Triolo, R.J. (2008) Selection of Optimal Muscle Set for 16-Channel Standing Neuroprosthesis. Journal of Rehabilitation Research and Development, 45, 1007-1018.
    http://dx.doi.org/10.1682/JRRD.2007.10.0164

  47. 47. Hemami, H. and Dariush, B. (2012) Central Mechanisms for Force and Motion towards Computational Synthesis of Human Movement. Neural Networks, 36, 167-178.
    http://dx.doi.org/10.1016/j.neunet.2012.09.008

  48. 48. Gielen, C.C.A.M. and Houk, J.C. (1987) A Model of the Motor Servo: Incorporating Nonlinear Spindle Receptor and Muscle Mechanical Properties. Biological Cybernetics, 57, 217-231.
    http://dx.doi.org/10.1007/BF00338815

  49. 49. Houk, J., Singh, S., Fisher, C. and Barto, A. (1990) An Adaptive Sensorimotor Network Inspired by the Anatomy and Physiology of the Cerebellum. In Miller, W.T., Sutton, R.S. and Werbos, P.J., Eds., Neural Networks for Control, Chapter 15, MIT Press, Cambridge.

  50. 50. Kloosterman, M.G.M., Sboek, M. and Kouvenhoven, G.J. (2010) Influence of Gravity Compensation on Kinematics and Muscle Activation Patterns during Reach and Retrieval in Subjects with Cervical Spinal Cord Injury: An Explorative Study. Journal of Rehabilitation Research & Development, 47, 617-628.
    http://dx.doi.org/10.1682/JRRD.2010.02.0014

  51. 51. Bizzi, W., Chapple, E. and Hogan, N. (1982) Mechanical Properties of Muscle: Implications for Motor Control. Trends in Neuroscience, 5, 395-398.
    http://dx.doi.org/10.1016/0166-2236(82)90221-1

  52. 52. Hogan, N. (1984) Adaptive Control of Mechanical Impedance by Coactivation of Anagonist Muscles. IEEE Transactions on Automatic Control, 29, 681-691.
    http://dx.doi.org/10.1109/TAC.1984.1103644

  53. 53. Delp, S. and Zajac, F.E. (1992) Force- and Moment-Generating Capacity of Lower-Extremity Muscles before and after Tendon Lengthening. Clinical Orthopedics and Related Research, 284, 247-259.
    http://dx.doi.org/10.1097/00003086-199211000-00035

  54. 54. Hemami, H. and Utkin, V.I. (2002) On the Dynamics and Lyapunov Stability Of constrained and Embedded Rigid Bodies. International Journal of Control, 75, 408-420.
    http://dx.doi.org/10.1080/00207170110112232

  55. 55. Hemami, H., Tarr, E., Li, B., Krishnamurthy, A., Clymer, B. and Dariush, B. (2016) Mechanical Engineering Research, 6, 29-45.

  56. 56. Friedli, W.G., Hallett, M. and Simon, S.R. (1984) Postural Adjustments Associated with Rapid Voluntary Arm Movements, Electromyographic Data. Journal of Neurology, Neurosurgery, and Psychiatry, 47, 611-622.
    http://dx.doi.org/10.1136/jnnp.47.6.611

  57. 57. Hannaford, B. and Stark, L. (1984) Control Strategies for Neurologically Ballistic Movements. Proceeding of Annual International Conference of the IEEE Engineering in Medicine and Biology, IEEE, New York, 640-655.

  58. 58. Hannaford, B. and Stark, L. (1985) Roles of the Elements of the Triphasic Control Sugnal. Experimental Neurology, 90, 619-634.
    http://dx.doi.org/10.1016/0014-4886(85)90160-8

  59. 59. Hannaford, B. and Lehman, S. (1986) Short Time Fourier Analysis of the Electromyogram: Fast Movements and Constant Contraction. IEEE Transactions on Biomedical Engineering, 33, 1173-1181.
    http://dx.doi.org/10.1109/TBME.1986.325697

  60. 60. Muellbacher, W., Ziemann, U. and Wissel, J. (2002) Early Consolidation in Human Primary Motor Cortex. Nature, 415, 640-644.
    http://dx.doi.org/10.1038/nature712

  61. 61. Wang, D.L. (2003) Temporal Pattern Processing. In: Arbib, M., Ed., The Handbook of Brain Theory and Neural Networks, 2nd Edition, The MIT Press, Cambridge.

  62. 62. Williamson, M.M. (1998) Neural Control of Rhythmic Arm Movements. In: Neural Control and Robotics, Biology and Technology, Chapter 8, Pergammon, New York, 1379-1394.
    http://dx.doi.org/10.1016/s0893-6080(98)00048-3

  63. 63. Grethe, J.S. and Thompson, R.F. (2003) Cerebellum and Conditioning. In: Arbib, M., Ed., The Handbook of Brain Theory and Neural Networks, 2nd Edition, The MIT Press, Cambridge.

  64. 64. Fiala, J. C., Grossberg, S. and Bullock, D. (1996) Metabotropic Glutamate Receptor Activation in Cerebellar Purkinje Cells as Substrate for Adaptive Timing of the Classically Conditioned Eye-Blink Response. The Journal of Neuroscience, 16, 3760-3774.

  65. 65. Goddard, R., Boyer, K. and Hemami, H. (1992) Collision Strategies for Robotic Retreat and Resistance. In: Tzafestas, S., Ed., Microprocessors in Robotic and Manufacturing Systems, Chapter 8, Kluwer Academic Publishers, 177-215.

  66. 66. Nobre, A. and Reilly, J. (2004) Time Is of the Essence. Trends in Cognitive Sciences, 8, 387-389.
    http://dx.doi.org/10.1016/j.tics.2004.07.005

  67. 67. Macar, F., Anton, J., Bonnet, M. and Vidal, F. (2004) Timing Functions of the Supplementary Motor Area: An Event-Related Fmri Study. Cognitive Brain Research, 21, 206-215.
    http://dx.doi.org/10.1016/j.cogbrainres.2004.01.005

  68. 68. Gribova, A., Donchin, O., Bergman, H. and de Oliveira, S.C. (2002) Timing of Bimanual Movement in Human and Nonhuman Primates in Relation to Neuronal Activity in Primary Motor Cortex and Supplementary Motor Area. Experimental Brain Research, 146, 322-335.
    http://dx.doi.org/10.1007/s00221-002-1174-x

  69. 69. Mayhan, R.J. (1984) Discrete-Time and Continuous-Time Linear Systems. Addison Wesley, Reading.

  70. 70. Kailath, T. (1984) Linear Systems. Prentice Hall Inc., Englewood Cliffs.

  71. 71. Paulin, M.G. (1998) A Method for Analysing Neural Computation Using Receptive Fields in State Space. Neural Networks, 11, 1219-1228.
    http://dx.doi.org/10.1016/S0893-6080(98)00061-6

  72. 72. Arbib, M.A., Erdi, P. and Szentagothai, J. (1998) Neural Organization, Structure, Function, and Dynamics. The MIT Press, Cambridge.

  73. 73. Houk, J.C., Crago, P.E. and Rymer, W.Z. (1981) Function of the Spindle Dynamics Response in Stiffness Regulation—A Predictive Mechanism Provided by Nonlinear Feedback. In: Taylor, H. and Prochazka, A., Eds., Muscle Receptors and Movement, MacMillan, London, 299-309.
    http://dx.doi.org/10.1007/978-1-349-06022-1_33

  74. 74. Arbib, M.A. (Ed.) (1995) The Handbook of Brain Theory and Neural Networks. The MIT Press, Cambridge.

  75. 75. Wolpert, D.M., Ghahramani, Z. and Jordan, M.I. (1995) An Internal Model for Sensorimotor Integration. Science, New Series, 269, 1880-1882.
    http://dx.doi.org/10.1126/science.7569931

  76. 76. Deutsch, S. and Deutsch, A. (1993) Understanding the Nervous System. IEEE Press, Piscataway.
    http://dx.doi.org/10.1109/9780470546864

  77. 77. Cooper, L.A. and Shepard, R.N. (1984) Turning Something over in the Mind. Scientific American, 251, 106-114.
    http://dx.doi.org/10.1038/scientificamerican1284-106

  78. 78. Caselli, P., Conforto, S., Schmid, M., Accornero, N. and DAlessio, T. (2006) Difference in Sensorimotor Adaptation to Horizontal and Vertical Mirror Distortions during Ballistic Arm Movements. Human Movement Science, 25, 310-325.
    http://dx.doi.org/10.1016/j.humov.2005.12.003

  79. 79. Rosen, I. and Asanuma, H. (1972) Peripheral Afferent Inputs to the Forelimb Area of the Monkey Motor Cortex: Input-Output Relations. Experimental Brain Research, 14, 257-273.
    http://dx.doi.org/10.1007/BF00816162

  80. 80. Brooks, V.B. (1986) The Neural Basis of Motor Control. Oxford University Press, New York.

  81. 81. Kupfermann, I. (1991) Learning and Memory. In: Principles of Neural Science, Elsevier, New York.

  82. 82. Kandel, E.R. (1991) Cellular Mechanisms of Learning and the Biological Basis of Individuality. In: Principles of Neural Science, 3rd Edition, Elsevier, New York, 1009-1031.

  83. 83. Levitan, I.B. and Kaczmarek, L.K. (1991) The Neuron, Cell and Molecular Biology. Oxford University Press, New York.

  84. 84. Hemami, H. and Stokes, B.T. (1983) Four Neural Circuit Models and Their Role in the Organization of Voluntary Movement. Biological Cybernetics, 49, 69-77.
    http://dx.doi.org/10.1007/BF00320387

  85. 85. Bay, J.S. and Hemami, H. (1987) Modeling of a Neural Pattern Generator with Coupled Nonlinear Oscillators. IEEE Transactions on Biomedical Engineering, 34, 297-306.
    http://dx.doi.org/10.1109/TBME.1987.326091

  86. 86. Jalics, L., Hemami, H., Clymer, B. and Groff, A. (1997) Rocking, Tapping, and Stepping: A Prelude to Dance. Autonomous Robots, 4, 227-242.
    http://dx.doi.org/10.1023/A:1008887808551

  87. 87. Hemami, H. and Zheng, Y.F. (2012) A Three-Link Module for Modular Dynamics and Control of High-Dimensional Humanoids. 2012 IEEE International Conference on Robotics and Automation, St. Paul, 14-18 May 2012, 3109-3115.
    http://dx.doi.org/10.1109/ICRA.2012.6224616

  88. 88. Evarts, E.V. (1979) Brain Mechanisms of Movement. Scientific American, 241, 164-179.
    http://dx.doi.org/10.1038/scientificamerican0979-164

  89. 89. Evarts, E., Shinoda, Y. and Wise, S. (1984) Neurophysiological Approaches to Higher Brain Functions. John Wiley and Sons, New York.

  90. 90. Prochazka, A. and Hulliger, M. (1983) Muscle Afferent Function and Its Significance for Motor Control Mechanisms during Voluntary Movements in Cat, Monkey, and Man. In: Desmedt, J.E., Ed., Motor Control Mechanisms in Health and Disease, Raven Press, New York.

  91. 91. Houk, J.C. and Rymer, W.Z. (1981) Neural Control of Muscle Length and Tension. In: Handbook of Physiology: The Nervous System II, American Physiological Society.

  92. 92. Thach Jr., W.T. (1980) The Cerebellum. In: Mountcastle, V.B., Ed., Medical Physiology, Chapter 31, the CV Mosby Company, Philadelphia, 837-858.

  93. 93. Hemami, H. and Moussavi, Z.M. (2014) A Model of the Basal Ganglia in Voluntary Movement and Postural Reactions. Computer Methods in Biomechanics and Biomedical Engineering, 17, 1432-1446.
    http://dx.doi.org/10.1080/10255842.2012.751983

  94. 94. Henneman, E. (1980) Motor Functions of the Brain Stem and Basal Ganglia. In: Mountcastle, V.B., Ed., Medical Physiology, Vol. 1, the CV Mosby Company, Saint Louis, 787-812.

  95. 95. Kornhuber, H.H. (1971) Motor Functions of Cerebellum and Basal Ganglia: The Cerebellocortical Saccadic (Ballistic) Clock, the Cerebellonuclear Hold Regulator, and the Basal Ganglia Ramp (Voluntary Speed Smooth Movement) Generator. Kybernetik, 8, 157-162.
    http://dx.doi.org/10.1007/BF00290561

  96. 96. Latash, M.L. (2008) Synergy. Oxford University Press, Oxford.
    http://dx.doi.org/10.1093/acprof:oso/9780195333169.001.0001

  97. 97. Zajac, F.E. (1993) Muscle Coordination of Movement: A Perspective. Journal of Biomechanics, 26, 109-124.
    http://dx.doi.org/10.1016/0021-9290(93)90083-Q

  98. 98. Shadmehr, R. and Wise, S.P. (Eds.) (2005) The Computational Neurobiology of Reaching and Pointing. MIT Press, Cambridge.

  99. 99. Kandel, E.R., Schwarrtz, J.H. and Jessell, T.M. (1991) Principles of Neural Science. 3rd Edition, Elsevier, New York.

  100. 100. Evarts, E.V. (1975) Changing Concepts of Central Control of Movement. Canadian Journal of Physiology and Pharmacology, 53, 191-201.
    http://dx.doi.org/10.1139/y75-028

  101. 101. Evarts, E.V., Bizzi, E., Burke, R.E., DeLong, M. and Thach Jr., W.T. (1971) Central Control of Movement. Neurosciences Research Program Bulletin, 9, 1-170.

  102. 102. Kornhuber, H.H. (1973) Cerebral Cortex, Cerebellum, and Basal Ganglia: An Introduction to Their Motor Functions. The Neurosciences, 3, 267-280.

  103. 103. Hemami, H., Barin, K. and Pai, Y.-C. (2006) Quantitative Analysis of a Sagittal Biped under Platform Disturbance. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 14, 470-480.
    http://dx.doi.org/10.1109/TNSRE.2006.886718

  104. 104. Iqbal, K. and Roy, A. (2009) A Novel Theoretical Framework for the Dynamic Stabilityanalysis, Movement Control, and Trajectory Generation in a Multisegment Biomechanical Model. Journal of Biomechanical Engineering, Transactions of the ASME, 131, 002-013.

  105. 105. Soechting, J. and Flanders, M. (1992) Moving in Three-Dimensional Space: Frames of Reference, Vectors and Coordinate Systems. Annual Review of Neuroscience, 15, 167-191.
    http://dx.doi.org/10.1146/annurev.ne.15.030192.001123

  106. 106. Spong, M.W. and Vidyasagar, M. (1989) Robot Dynamics and Control. John Wiley and Sons, Hoboken.

  107. 107. Vukobratovic, M. (1990) Biped Locomotion, Dynamics, Stability, Control and Applications. Springer-Verlag, Berlin.

  108. 108. Soechting, J.F. and Flanders, M. (1989) Errors in Pointing Are Due to Approximations in Sensorimotor Transformations. Journal of Neurophysiology, 2, 595-607.

  109. 109. Amirouche, F.M.L. (1992) Computational Methods in Multibody Dynamics. 2nd Edition, Prentice Hall, Englewood Cliffs.

  110. 110. Shabana, A.A. (1985) Viscoelastic Analysis of Multibody Systems Using the Finite Element Method. Journal of Sound and Vibration, 100, 271-284.
    http://dx.doi.org/10.1016/0022-460X(85)90420-1

  111. 111. Angevine Jr., J.B. and Cotman, C.W. (1981) Principles of Neuroanatomy. 2nd Edition, Oxford University Press, Oxford.

  112. 112. Garroute, B. (1981) Survey of Functional Neuroanatomy. Jones Medical Publications.

  113. 113. Davidson, T.J., Kloosterman, F. and Wilson, M.A. (2009) Hippocampal Replay of Extended Experience. Neuron, 63, 497-507.
    http://dx.doi.org/10.1016/j.neuron.2009.07.027

  114. 114. Eichenbaum, H. (2002) The Cognitive Neuroscience of Memory. Oxford University Press Inc., New York.
    http://dx.doi.org/10.1093/acprof:oso/9780195141740.001.0001

  115. 115. Hazeltine, E., Helmuth, L.L. and Ivry, R.R. (1997) Neural Mechanisms of Timing. Trends in Cognitive Sciences, 1, 163-169.
    http://dx.doi.org/10.1016/S1364-6613(97)01058-9

  116. 116. Medina, J.F., Garcia, K.S., Nores, W.L., Taylor, N.M. and Mauk, M.D. (2000) Timing Mechanisms in the Cerebellum: Testing Predictions of a Large Scale Computer Simulation. The Journal of Neuroscience, 20, 5516-5525.

  117. 117. Ivry, R.R., Spencer, R.M., Zelaznik, H.N. and Diedrichsen, J. (2002) The Cerebellum and Event Timing. Annals of the New York Academy of Sciences, 978, 302-317.
    http://dx.doi.org/10.1111/j.1749-6632.2002.tb07576.x

  118. 118. Llinas, R.R. (2011) Cerebellar Motor Learning versus Cerebellar Motor Timing: The Climbing Fibre Story. The Journal of Physiology, 589, 3423-3432.
    http://dx.doi.org/10.1113/jphysiol.2011.207464

  119. 119. Callister, R.J., Peterson, E.H. and Brichta, A.M. (1999) Neuromuscular Strategies Underlying Ballistic Movements. In: Binder, M.D., Ed., Peripheral and Spinal Mechanisms in the Neural Control of Movement, Elsevier, BV, Amsterdam, 233-243.
    http://dx.doi.org/10.1016/S0079-6123(08)62860-5

  120. 120. Foster, D.J. and Wilson, M.A. (2006) Reverse Replay of Behavioral Sequences in Hippocampal Place Cells during the Awake State. Nature, 440, 680-683.
    http://dx.doi.org/10.1038/nature04587

  121. 121. Liang, N., Yamashita, T., Ni, Z., Takahashi, M., Murakami, T., Yahagi, S. and Kasai, T. (2008) Temporal Modulations of Agonist and Antagonist Muscle Activities Accompanying Improved Performance of Ballistic Movements. Human Movement Science, 27, 12-28.
    http://dx.doi.org/10.1016/j.humov.2007.05.007

  122. 122. Hubbard, A.W. (1960) Homokinetics: Muscular Function in Human Movement. Harper and Brothers Publishers.

  123. 123. Kim, J. and Hemami, H. (1998) Coordinated Three-Dimensional Motion of the Head and Torso by Dynamic Neural Networks. IEEE Transactions on Systems, Man and Cybernetics, Part B, 28, 653-666.
    http://dx.doi.org/10.1109/3477.718516

  124. 124. Ghez, C. (1991) Voluntary Movement. In: Principles of Neural Science, 3rd Edition, Chapter 38, Elsevier, New York, 609-625.

  125. 125. Pellionisz, A. and Llinas, R. (1979) Brain Modeling by Tensor Network Theory and Computer Simulation. The Cerebellum: Distibuted Processor for Predictive Coordination. Neuroscience, 4, 323-350.
    http://dx.doi.org/10.1016/0306-4522(79)90097-6

  126. 126. Pellionisz, A. and Llinas, R. (1980) Tensorial Approach to the Geometry of Brain Function: Cerebellar Coordination via a Metric Tensor. Neuroscience, 5, 1125-1150.
    http://dx.doi.org/10.1016/0306-4522(80)90191-8

  127. 127. Pellionisz, A. and Llinas, R. (1982) Space-Time Representation in the Brain: The Cerebellum as a Predictive Space-Time Metric Tensor. Neuroscience, 7, 2949-2960.
    http://dx.doi.org/10.1016/0306-4522(82)90224-X

  128. 128. Dariush, B., Gienger, M., Arumbakkam, A., Zhu, Y., Jian, B., Fujimura, K. and Goerick, C. (2009) Online Transfer of Human Motion to Humanoids. International Journal of Humanoid Robotics, 6, 265-289.
    http://dx.doi.org/10.1142/S021984360900170X

  129. 129. Zhu, Y., Dariush, B. and Fujimura, K. (2010) Kinematic Self Retargeting: A Framework for Human Pose Estimation. Computer Vision and Image Understanding, 114, 1362-1375.
    http://dx.doi.org/10.1016/j.cviu.2009.11.005

  130. 130. Bastin, J., Calvint, S. and Montagne, G. (2006) Muscular Proprioception Contributes to the Control of Interceptine Actions. Journal of Experimental Psychology, Human Perception and Performance, 32, 964-972.
    http://dx.doi.org/10.1037/0096-1523.32.4.964

  131. 131. Cordo, P.J. and Gurfinkel, V.S. (2004) Motor Coordination Can Be Fully Understood Only by Studying Complex Movements. In: Mori, S., Stuart, D.G and Wiesendanger, M., Eds., Brain Mechanisms for the Integration of Posture and Movement, Elsevier, Amsterdam, 29-38.
    http://dx.doi.org/10.1016/S0079-6123(03)43003-3

  132. 132. Dariush, B., Parnianpour, M. and Hemami, H. (1998) Stability and Control Strategy of a Multi-Link Musculoskeletal Model with Applications in Fes (Functional Electrical Stimulation). IEEE Transactions on Biomedical Engineering, 45, 3-14.
    http://dx.doi.org/10.1109/10.650346

  133. 133. Delp, S.L. and Loan, J.P. (1995) A Software System to Develop and Analyze Models of Musculoskeletal Structures. Computers in Biology and Medicine, 25, 21-34.
    http://dx.doi.org/10.1016/0010-4825(95)98882-E

  134. 134. Patla, A., Frank, J. and Winter, D.A. (1990) Assessment of Balance Control in the Elderly: Major Issues. Physiotherapy Canada, 42, 89-97.
    http://dx.doi.org/10.3138/ptc.42.2.089

Appendix

A.1. Physical Parameters

The physical parameters used in the computer simulations are given in the table below.

A.2. Gains

The gain matrix for the simulations is given in table below. The linear viscosity, in the first phase, is assumed to be 1/8 of the stiffness for all actuators.