The feasibility of using an Artificial Neural Network (ANN) for controlling time- varying dynamical system is presented. The direct adjusting of neural controller by direct adaptive control (DAC) is available, by using the error between output of plant and desired input. The finite recurrent back propagation (FRBP) is used in the learning process, because the ability of this method to capture the nonlinearly and overcome the problem of time varying system. Hybrid controller structure used in this paper, where the parameters of classical controller are adjusted with time at specified freezing points for time varying dynamical system, and summed the outputs of two controllers and enter to the plant, identify of system by ANN to get the optimal initial condition for neuro controller. A single channel for Spacecraft model is used as an example in this paper, satisfactory results are obtained, which explain the ability of recurrent neural network (RNN) to identify time varying dynamical system and overcome for all its problem and explain the ability of this structure of hybrid neuro controller to use with time varying dynamical system.