Journal of Behavioral and Brain Science
Vol.05 No.03(2015), Article ID:54345,11 pages
10.4236/jbbs.2015.53006

Clustered c-Fos Activation in Rat Hippocampus at the Acquisition Stage of Appetitive Instrumental Learning

Olga E. Svarnik1, Yuri I. Alexandrov1, Konstantin V. Anokhin2,3

1Institute of Psychology, Russian Academy of Sciences, Moscow, Russia

2Department of Neuroscience, National Research Center “Kurchatov Institute”, Moscow, Russia

3P. K. Anokhin Institute of Normal Physiology, Russian Academy of Medical Sciences, Moscow, Russia

Email: yuraalexandrov@yandex.ru

Copyright © 2015 by authors and Scientific Research Publishing Inc.

This work is licensed under the Creative Commons Attribution International License (CC BY).

http://creativecommons.org/licenses/by/4.0/

Received 14 January 2015; accepted 26 February 2015; published 2 March 2015

ABSTRACT

To address the issue of how hippocampal neurons are involved into learning progress, we studied c-Fos expression in rat hippocampal subfields at different stages of appetitive instrumental learning. To model the first stage of learning, we pre-trained animals to approach the lever to obtain the food, and then made this behavior ineffective by not reinforcing it during the last session (“mismatch” group). Another group just acquired lever-pressing behavior at that day (“acquisition” group). Animals of the third group performed this well-trained behavior (“performance” group). The number of Fos-positive neurons in all hippocampal regions of the “mismatch” group animals was higher than in the ones of the home cage control group animals. The number of Fos-positive neurons was increased in CA1 and CA3 areas, but not in the dentate gyrus of both the “acquisition” and “performance” group animals as compared with the control group. We also found segmented c-Fos expression, which was more evident in “acquisition” group animals. Thus, our results suggest that during the first (mismatch) stage of learning hippocampal neurons are activated in an equally distributed manner. The following clustered pattern of activated CA1 neurons during the acquisition stage may reflect specialization of these neurons in respect to the specific lever-pressing behavior.

Keywords:

Fos, Hippocampus, Clusters, Neuron, Learning

1. Introduction

Most behaviors are not learned at once. Instrumental learning progress is often characterized by learning curves based on the success rate [1] . Such progress is mediated by discrete, functional reorganizations of neuronal groups subserving the learned behavior, which suggest existence of more or less distinct stages [2] . It is quite common to characterize these stages by a different number of mistakes [3] , but more detailed descriptions of each stage based on the underlying neuronal processes are still missing. Specifically, behavioral characteristics of each stage of instrumental learning should be related to patterns of neuronal activity that underlie this stage.

One process that takes place during learning is the development of neuronal activity selectively related to the learned behavior. Such experience-dependent “behavioral specialization” of neurons [4] is a stable characteristic [5] [6] , which have many examples [7] - [11] . Appearance of such specific activations might be already evident during the earliest newly learned behavioral acts [12] [13] . Such changes in neuronal activity were found just before, at, or immediately after the time when the correct behavior was learned [14] . Experience-dependent changes in activity of single neurons might result in the described phenomenon of correlated or synchronized activities between neurons [15] [16] and establishment of specific neuronal ensembles, groups or systems of coactive neurons where activities are specifically related to the learned task.

At the level of subcellular biochemical processes, newly synchronized neuronal activations may be accompanied by changes in neuronal gene transcription. Activation of gene transcription, specifically as well as immediate early gene (IEG) induction, is related to acquisition of new experience [17] - [21] . This allows using IEG expression imaging as a tool to map patterns of experience-dependent changes in neuronal activity across various brain regions [22] .

Neuronal activity changes related to acquisition of instrumental appetitive task have been found in several brain regions including hippocampus [23] [24] . Hippocampal neuronal activity plays a crucial role in establishment of action-outcome relationship during instrumental learning [25] [26] . Learning dynamics of an operant conditioning task has been shown to be correlated with changes of the intrinsic frequency and amplitude of hippocampal ripple oscillations associated with network synchronization [16] , which suggests the recruitment of hippocampal neurons into synchronized ensembles responsible for this learning. Differential involvement of hip- pocampal subfields into operant odor-discrimination learning has been shown to depend on the stage of the task [27] - [29] . However, hippocampal subfields consist of many different neurons that show differential involvement, for example, into the delayed-nonmatching-to-sample task [30] . To examine patterns of involvement of hippocampal neurons into the sequential stages of appetitive instrumental learning, we first pre-trained rats to approach the lever in order to receive food, and then during the final session modeled three consecutive stages of instrumental lever-pressing learning in three groups of animals. Animals of the first group (“mismatch” group) demonstrated mostly the previously acquired lever-approaching behavior, which was now ineffective because it was not reinforced. The “acquisition” group animals demonstrated initially scattered lever-pressing behavior. “Performance” group animals demonstrated over-trained lever-pressing behavior. Thus, the sequential stages of instrumental learning were the followings: mismatch of the previous experience, initial acquisition of new behavior and correct performance. We found that the overall pattern of hippocampal subfield activations was similar in all groups, but the pattern of neuronal activations inside the CA1 area depended on the learning stage.

2. Methods

2.1. Subjects

Twenty four male Long-Evans hooded rats (5 - 9 months old) were housed in individual cages. They were food deprived to 85% of their free-feeding body weight and maintained at this level throughout the experiment. Water was available ad libitum. All animal procedures in these studies were in accordance with the National Institutes of Health “Guidelines for the Care and Use of Animals for Experimental Procedures”, which were approved by the Russian Academy of Sciences.

2.2. Apparatus

All behavioral training took place in an operant chamber of 40 × 40 × 50 cm. The chamber was fitted with an automated plastic food-cup in the corner and a wall-mounted lever located in the other corner along the same wall. The food-cup and the lever were equipped with photodiodes. A button controlled by an experimenter was located outside of the cage and allowed filling the food-cup at any required time. Lever-presses and food-cup checks by an animal were registered by Ikegami data-recorder DTR 1204× (Nihon Kohden, Kogyo Co., Ltd., Tokyo, Japan).

2.3. Behavioral Training

Training was conducted daily in 30-min sessions. Animals were progressively shaped across days to acquire the definitive behavior [31] . The experimenter delivered a food reward to the subject for approaching the food-cup (two days), then for turning away from the food-cup toward the lever (two days), then for moving half a way toward the lever (two days), then for approaching the lever on the distance of less than 1 cm (two days). Thus, rats were initially pre-trained to approach a lever in order to receive a food from a feeder (Figure 1). On the last experimental day the first stage of learning was modeled by making this behavior ineffective (“mismatch” group, n = 5). Rats of the second group learned to press a lever (“acquisition” group, n = 7). Animals of the third group were trained for lever-pressing task over a period of five days and performed this well-trained behavior during the final experimental session (“performance” group, n = 6). Thus “acquisition” group animals were sacrificed for immunohistochemistry after their first lever-pressing session, and “performance” group animals were sacrificed after their fifth level-pressing session. In order to equalize the total number of sessions in the experimental chamber between all groups the first stage of training (approaching the food-cup) was prolonged up to five days for “mismatch” and “acquisition” group. Animals of the control group (n = 6) were kept in their home cages with free access to food and water and killed at the same time as trained animals. Behavioral measures included the number of presses completed and the number of food-cups checked, along with the timestamp of each event. To assess instrumental performance, percentage of correct trials (lever-press followed by food-cup check) was calculated as: % of correct trials = Number of lever-presses/Total number of food-cup checks × 100. Mann- Whitney rank sum test was used for analysis of variables between groups, and Wilcoxon test was used for analysis of variables inside groups. All statistical tests were performed in Statistica 5.0.

2.4. Immunohistochemistry

Seventy-five minutes after the final experimental session, animals were overdosed with halothane. Their brains were removed and frozen for analysis. Coronal 20 µm cryostat brain sections were taken through the hippocampus (−4.0 to −5.0 mm to bregma) [32] . The sections prepared for immunohistochemistry were dried overnight and fixed in 4% paraformaldehyde in 0.1 M phosphate-buffered saline (PBS), pH 7.4, for 15 min. Fixed sections were washed (3x5 min) in 0.1 M PBS and placed into a blocking solution (2.5% normal serum/0.1 M PBS) for 30 min. The sections were then incubated in Fos rabbit polyclonal antibody (“Calbiochem”, Ab-5, Cat. #PC38, USA), diluted 1:2000 with 0.1 M PBS, for 18 h. The sections were washed (6 × 5 min) with 0.3% Triton X-100 in 0.1 M PBS, and incubated with biotinylated goat anti-rabbit secondary antibody (“Vector Laboratories”, USA) diluted 1:300 in PBS for 2 h. They were then washed (5 × 5 min) and processed with the 1% streptavidin-biotin complex (PK-6101, “Vector Laboratories”, USA) for 1 h. After 4 × 5 min washes the sections were placed in a solution of 0.06% diaminobenzidine (DAB, Sigma, USA) and 0.003% H2O2 for 6 min. The sections were then washed in tap water, counterstained, dehydrated and coverslipped with the mounting medium. For Fos staining we used a conventional procedure as it is often used [33] [34] without fluorescent double-labe-

Figure 1. Training schedule illustrating stages of shaping protocol for animals of the three experimental groups: “mismatch” group (MG); “acquisition” group (AG); “performance” group (PG).

ling for Fos and mature neuron marker NeuN because Fos is known as a marker of neuronal activation [35] [36] , and it was shown in studies that all cells labeled for Fos also were labeled for NeuN, which supports that only neurons expressed Fos in brains during learning [37] .

2.5. Data Analysis

Images of the hippocampal slices were digitized at 20× magnification under Olympus BX-50 microscope (Japan) by WV-CP230 camera (Panasonic, Japan) and analyzed using AnalySis 3.0 image analysis software (SiS, Germany). The number of Fos-positive cells was counted in the hippocampal subfields CA1, CA3 and the dentate gyrus. Counts were taken from 10 consecutive sections in each rat. In this study we did not intend to provide principal neuronal numbers in the areas, so we used non-stereological approach, which is considered to be biased because of the appearance probability of objects in an image due to their size, shape and orientations [38] [39] . Such considerations are irrelevant for our study which allows comparing relative numbers of stained cells in the same structures of different group animals, whose brains underwent the identical procedure. Such conventional approaches are still widely used [33] - [40] . Counting was performed by an investigator blind to the experimental group assignment of animals. Kruskal-Wallis ANOVA median test and Mann-Whitney rank sum test for pairwise comparisons were used to compare the numbers of Fos-positive neurons between the groups. A probability level of <0.05 was accepted as statistically significant. All statistical tests were performed in Statistica 5.0.

3. Results

To reveal consecutive learning stages of appetitive instrumental skill acquisition we recorded rats’ behavior in the experimental chamber equipped with a lever situated on a distance from the feeder. The animals were progressively shaped across several sessions to acquire the behavior of lever-approaching (Figure 1). Behavior during the final training session was classified according to the following categories: previously learned, but recently ineffective behavior; effective lever-pressing behavior; explorative behavior. Combinations of these categories were used to distinguish “mismatch”, “acquisition” and “performance” stages of the instrumental behavior (Figure 2).

Rats of “mismatch” group demonstrated ineffective (i.e. unreinforced) lever-approaching behavior and explorative behavior. Rats of “acquisition” group demonstrated ineffective lever-approaching behavior, explorative behavior and effective (i.e. reinforced) behavior of lever-pressing. Rats of “performance” group demonstrated effective lever-pressing behavior. We analyzed the number of food-cup checks and the number of lever- presses in all the groups. During the final session, animals of “mismatch” group made 136 ± 9 food-cup checks (Figure 3(a)). These animals made significantly fewer food-cup checks than “acquisition” group animals did (Mann-Whitney, z = 3.36, P < 0.01) (Figure 4(a)). However, the number of food-cup checks during the first half of the session did not differ between “mismatch” group rats (88 ± 4) and “acquisition” group rats (110 ± 11) (Mann-Whitney, z = 1.99, P = 0.05). There were no significant differences in the number of food-cup checks between “performance” group (261 ± 33) and “acquisition” group (271 ± 21) animals.

Figure 2. Behavioral patterns of animals of the three experimental groups: “mismatch” group (MG); “acquisition” group (AG); “performance” group (PG) during the final training session.

(a)(b)(c)

Figure 3. Frequency of different behavioral acts (food-cup checking, lever-pressing) during the final training session of three representative animals out of the three experimental groups: “mismatch” group (a); “acquisition” group (b); “performance” group (c).

(a) (b)

Figure 4. Food-cup checking activity (a) and lever-pressing activity (b) during the final training session of animals of the three experimental groups: “mismatch” group (MG); “acquisition” group (AG); “performance” group (PG).

Rats of “acquisition” group learned the lever-pressing behavior (Figure 3(b)). This behavior developed after a period of unreinforced lever-approaching behavior. Rats of this group had a significant increase of lever-presses during the second half of this session (59.2% ± 8.1% correct trials) as compared to the first half (23.8±3.8%) (Wilcoxon, z = 2.52, P < 0.05). The mean percentage of correct trials for the rats of this group was 45.4% ± 6.2% (Figure 4(b)). Rats of “performance” group pressed the lever extensively (76.1% ± 3.7% presses) (Figure 3(c)) and made significantly more correct trials than “acquisition” group animals did (Mann-Whitney, z = 2.90, P < 0.01).

Induction of c-Fos expression in neurons was detected by immunohistochemistry. Home-caged “control” group animals had the low numbers of c-Fos-immunopositive neurons in CA1 (2.15 [1.2; 3.3] cells per mm2; all data presented as median [25th percentile; 75th percentile]), in CA3 (25.15 [10.4; 34.4]) and in the dentate gyrus (7.85 [4.6; 10.10]) (Figure 5). The number of Fos-positive neurons was significantly higher in CA3 area than in CA1 area of the hippocampus (Wilcoxon, z = 2.2, P = 0.02). “Mismatch” group animals had significant activation of c-Fos expression (as compared to the home cage control group) in all three regions of hippocampus: CA1 (51.2 [44.8 - 55.6] neurons), CA3 (57.2 [53.5; 57.3]) and the dentate gyrus (26.2 [23.0; 27.2]) (Mann-Whitney, z = 2.74, z = 2.56, z = 2.56 respectively, P ≤ 0.01). However, the density of Fos-positive neurons in the dentate gyrus was significantly lower than in areas CA1 or CA3 (Wilcoxon, z = 2.02, P = 0.04). “Acquisition” group animals had significantly more Fos-positive neurons (as compared to the home cage control group) in CA1 area of the hippocampus (21.3 [16.9; 78.2]) and in CA3 (54.9 [44.3; 96.4]) (Mann-Whitney, z = 2.86, z = 2.57 respectively, P ≤ 0.01) but not in the dentate gyrus (16.8 [9.8; 28.3]) (Mann-Whitney, z = 1.71, P = 0.09). “Performance” group animals had significantly more Fos-positive neurons (as compared to the home cage control group) in CA1 area of the hippocampus (54.5 [17.4; 107.4]) and in CA3 (47.9 [36.7; 125.5]) (Mann-Whitney, z = 2.56, z = 2.13 respectively, P ≤ 0.01) but not in the dentate gyrus (24.2 [12.55; 108.8]) (Mann-Whitney, z = 1.71, P = 0.09).

To further investigate differences between the consecutive stages of this learning we assessed homogeneity of variances between “mismatch” group and “acquisition” group by using Levene test for equality of variances. Variances were not equal across the groups (F = 4670; df1 = 1; df2 = 20; P = 0.043).

Analysis of consecutive brain sections showed that CA1 region contained segments (200 - 500 µm) that had no c-Fos-positive neurons albeit Fos-positive cells were evident in the cortex above the hippocampus area in all the brain sections (Figure 6). Such segmented c-Fos expression was found in 6 out of 7 “acquisition” group animals and only in 1 rat out of 5 in “mismatch” group. Half of the animals of “performance” group had such segmented activity in CA1 region of the hippocampus. Neither of the groups had such segmented c-Fos activity in CA3 region or the dentate gyrus.

Figure 5. Density of Fos-positive neurons in CA1, CA3 and the dentate gyrus (DG) of the control group (CG), “mismatch” group (MG), “acquisition” group (AG) and “performance” group (PG) animals.

Figure 6. Photomicrographs of consecutive brain sections showing Fosimmunoreactive neurons of a representative “acquisition” group animal. Coronal sections of 20 µm thickness. Intersection interval―100 µm. CA1, CA1 area of the hippocampus; PtA, parietal association cortex.

4. Discussion

The results described above demonstrated that distribution of Fos-activated neurons in the hippocampus depended on the learning stage of the appetitive instrumental behavior. We modeled the earliest stage of learning in our experiments (“mismatch” group) by making previously reinforced and effective behavior non-reinforced and ineffective. Fos induction in neurons was already evident at this earliest stage of learning. The mismatch stage is usually characterized by memory retrieval, which may induce reconsolidation and extinction [41] [42] . Fos expression was shown both during extinction [43] and reconsolidation [44] . Retrieval of operant skill memory in our case was manifested in those types of behavior (approaching the lever and the food-cup checking) that were acquired during the intermediate stages of previous shaping. The set of neurons activated during learning and the one reactivated during memory retrieval are shown to be largely overlapping [45] . Contextual modulation of neuronal activity was demonstrated after extinction of fear memory [46] . All these findings suggest that during performance of previously acquired behavior task-related neurons are getting reactivated and might be recruited into newly formed groups subserving newly learned behavior. Our results described above demonstrate that “mismatch” and “acquisition” stages of learning are characterized by neuronal Fos-expression in all three hippocampal subfields in a similar manner. Thus not the new skill acquisition results in neuronal Fos induction but rather extinction, re-learning or reorganization of the previous experience. Nowadays the fact that learning is not happening on tabula rasa and based on previous memory gets more and more attention [47] [48] . Reorganization of previous experience is manifested as explorative behavior which includes also ineffective behavior elements. Ineffective behavior during the first trials of learning might lead to neuronal changes, e.g. changes in “neuronal phenotype” [49] and create “the potential” for formation of the following memory [50] . Neuronal gene expression changes during the first stage of learning might only prime the subsequent long-term changes and form a background for the following selection of specific neuronal groups as proposed by the selection theories of learning [4] [51] .

We have demonstrated that the number of Fos-positive neurons after “mismatch” stage is similar across different individuals, unlike the situation after “acquisition” stage. This may imply that memory retrieval is a similar process among individuals given that they leaned similar behavior, but acquisition of a new memory differs due to different exploration trials or trial-and-error behavior that animals perform during acquisition stage. Skill memories of different individuals might become similar due to the process of consolidation over time, which is thought to begin shortly after learning [52] [53] . Consolidation or reorganization of acquired memory was also shown to happen during sleep [54] [55] . It has been demonstrated that proportion of neurons responsive to the imprinting stimulus reaches a maximum the day after training, and that sleep is necessary for this maximum to be achieved [56] . Thus the process of consolidation leads to the reorganization of neuronal ensembles. Such reorganization could develop in a similar way across the animals of “mismatch” group due to the identity of their training history. Patterns of task-related neuronal activations in the cortex were shown to depend on the previous training history [12] [57] . All the mentioned data and our results are in a line with suggestion that during the first stage of learning―“mismatch” stage―previously learned behaviors and previously acquired neuronal ensembles are temporary reorganized; this process was called “accommodative reconsolidation” [58] .

Not all the stages of learning were characterized by clustered c-Fos induction in hippocampal neurons. Our data demonstrated that clustering was the most evident during “acquisition” stage of learning. At this stage the first correct trials could be achieved by recruitment of suitable neurons in a new neuronal group. Clustered organization is one of the general principles of brain functioning. The brain is not homogeneous in its nature. It is organized in such a way that similar cells tend to segregate together [59] . This general principle allows considering the brain as a set of more or less discrete, so called, structures based on morphological characteristics of cells: cortices, nuclei, layers etc. However, none of brain structures really works as a unit and usually exhibits regionally differentiated activation or even clustered activation. Functional clusters might be found inside the structures: body representations in the primary motor cortex and the primary somatosensory cortex [60] , ocular dominance columns and orientation columns in the primary visual cortex [61] and others. Clustering of functional cell types is not limited to the primary sensory areas. It has been demonstrated that hippocampal neurons are distributed in functional segments along the length of the hippocampus; moreover such segmentation appears to depend on task-related specificity of neurons [30] . How, when and why such functional clusters are formed remains poorly understood. A more detailed understanding of functional clusters formation would provide important insight into general principles of brain functions.

The appearance of clustered activation of CA1 neurons mostly during “acquisition” stage might reflect the behavioral specialization of these neurons in respect to the specific lever-pressing behavior. Such data suggest that different CA1 neurons may play different roles in pattern completion (retrieval) and pattern separation (new encoding) processes similar to the dentate gyrus neurons [62] . It has been shown that CA1 area of the hippocampus contains many neurons whose activity is related to performance of an instrumental appetitive skill and alcohol-acquisition skill [23] . Because the number of Fos-positive neurons in CA1 area did not differ between “mismatch” and “acquisition” groups, it suggests that process of Fos-expression in some of CA1 neurons was deactivated, which resulted in the appearance of areas that did not contained Fos-positive neurons after the “acquisition” stage. It was shown that the number of neurons containing Fos protein was reduced within the first 30 minutes after the end of light exposure [63] . Little is known about the processes of c-fos mRNA and Fos protein decay in neurons. However, some of the mechanisms of Fos degradation in cells in vitro have been suggested [64] . It might be proposed that coordinated activation of a suitable neuronal group should lead to the active process of Fos deactivation in the neurons.

5. Conclusion

Thus, in this research we investigated how hippocampal neurons were getting sequentially involved into instrumental learning. We found that the overall pattern of hippocampal subfield activations was similar in all groups―“models” of sequential stages of instrumental learning, but the pattern of neuronal activations inside the CA1 area depended on the learning stage. This pattern was mostly characterized by clustering of Fos-positive neurons.

References

  1. Buitrago, M.M., Ringer, T., Schulz, J.B., Dichgans, J. and Luft, A.R. (2004) Characterization of Motor Skill and Instrumental Learning Time Scales in a Skilled Reaching Task in Rat. Behavioural Brain Research, 155, 249-256. http://dx.doi.org/10.1016/j.bbr.2004.04.025
  2. Karni, A., Meyer, G., Rey-Hipolito, C., Jezzard, P., Adams, M.M., Turner, R. and Ungerleider, L.G. (1998) The Acquisition of Skilled Motor Performance: Fast and Slow Experience-Driven Changes in Primary Motor Cortex. Proceedings of the National Academy of Sciences of the United States of America, 95, 861-868. http://dx.doi.org/10.1073/pnas.95.3.861
  3. Zielinski, K. (1993) Intertrial Responses in Defensive Instrumental Learning. Acta Neurobiologiae Experimentalis (Wars), 53, 215-229.
  4. Shvyrkov, V.B. (1986) Behavioral Specialization of Neurons and the System-Selection Hypothesis of Learning. In: Klix, F. and Hagendorf, H., Eds., Human Memory and Cognitive Capabilities: Mechanisms and Performances, Elsevier Science Publishers, Amsterdam, 599-611.
  5. Thompson, L.T. and Best, P.J. (1990) Long-Term Stability of the Place-Field Activity of Single Units Recorded from the Dorsal Hippocampus of Freely Behaving Rats. Brain Research, 509, 299-308. http://dx.doi.org/10.1016/0006-8993(90)90555-P
  6. Gorkin, A.G. and Shevchenko, D.G. (1991) The Stability of Units Behavioral Specialization. Neuroscience and Behavioral Physiology, 21, 222-229. http://dx.doi.org/10.1007/BF01191659
  7. Alexandrov, Yu.I., Grechenko, T.N., Gavrilov, V.V., Gorkin, A.G., Shevchenko, D.G., Grinchenko, Yu.V., et al. (2000) Formation and Realization of Individual Experience: A Psychophysiological Approach. In: Miller, R., Ivanitsky, A.M. and Balaban, P.M., Eds., Conceptual Advances in Russian Neuroscience: Complex Brain Functions, Harwood Academic Publishers, Amsterdam, 181-200.
  8. Brosch, M., Selezneva, E. and Scheich, H. (2005) Nonauditory Events of a Behavioral Procedure Activate Auditory cortex of Highly Trained Monkeys. The Journal of Neuroscience, 25, 6797-6806. http://dx.doi.org/10.1523/JNEUROSCI.1571-05.2005
  9. Mruczek, R.E. and Sheinberg, D.L. (2007) Activity of Inferior Temporal Cortical Neurons Predicts Recognition Choice Behavior and Recognition Time during Visual Search. The Journal of Neuroscience, 27, 2825-2836. http://dx.doi.org/10.1523/JNEUROSCI.4102-06.2007
  10. Matsumora, T., Koida, K. and Komatsu, H. (2008) Relationship between Color Discrimination and Neural Responses in the Inferior Temporal Cortex of the Monkey. The Journal of Neuroscience, 100, 3361-3374. http://dx.doi.org/10.1152/jn.90551.2008
  11. MacDonald, C.J., Lepage, K.Q., Eden, U.T. and Eichenbaum, H. (2011) Hippocampal “Time Cells” Bridge the Gap in Memory for Discontiguous Events. Neuron, 71, 737-749. http://dx.doi.org/10.1016/j.neuron.2011.07.012
  12. Alexandrov, Y.I. (2008) How We Fragment the World: The View from Inside versus the View from Outside. Social Science Information, 47, 419-457. http://dx.doi.org/10.1177/0539018408092580
  13. Suzuki, W.A. (2008) Associative Learning Signals in the Brain. Progress in Brain Research, 169, 305-320. http://dx.doi.org/10.1016/S0079-6123(07)00019-2
  14. Cahusac, P.M., Rolls, E.T., Miyashita, Y. and Niki, H. (1993) Modification of the Responses of Hippocampal Neurons in the Monkey during the Learning of a Conditional Spatial Response Task. Hippocampus, 3, 29-42. http://dx.doi.org/10.1002/hipo.450030104
  15. Ahissar, E., Vaadia, E., Ahissar, M., Bergman, H., Arieli, A. and Abeles, M. (1992) Dependence of Cortical Plasticity on Correlated Activity of Single Neurons and on Behavioral Context. Science, 257, 1412-1415. http://dx.doi.org/10.1126/science.1529342
  16. Ponomarenko, A.A., Li, J.S., Korotkova, T.M., Huston, J.P. and Haas, H.L. (2008) Frequency of Network Synchroni- zation in the Hippocampus Marks Learning. European Journal of Neuroscience, 27, 3035-3042. http://dx.doi.org/10.1111/j.1460-9568.2008.06232.x
  17. Anokhin, К.V. and Rose, S.P. (1991) Learning-Induced Increase of Immediate Early Gene Messenger RNA in the Chick Forebrain. European Journal of Neuroscience, 3, 162-167. http://dx.doi.org/10.1111/j.1460-9568.1991.tb00076.x
  18. Lanahan, A. and Worley, P. (1998) Immediate-Early Genes and Synaptic Function. Neurobiology of Learning and Memory, 70, 37-43. http://dx.doi.org/10.1006/nlme.1998.3836
  19. Svarnik, O.E., Alexandrov, Y.I., Gavrilov, V.V., Grinchenko, Y.V. and Anokhin, K.V. (2005) Fos Expression and Task-Related Neuronal Activity in Rat Cerebral Cortex after Instrumental Learning. Neuroscience, 136, 33-42. http://dx.doi.org/10.1016/j.neuroscience.2005.07.038
  20. Suge, R., Kato, H. and McCabe, B.J. (2010) Rapid Induction of the Immediate Early Gene c-fos in a Chick Forebrain System Involved in Memory. Experimental Brain Research, 200, 183-188. http://dx.doi.org/10.1007/s00221-009-2006-z
  21. Miyashita, T., Kubik, S., Haghighi, N., Steward, O. and Guzowski, J.F. (2009) Rapid Activation of Plasticity-Associated Gene Transcription in Hippocampal Neurons Provides a Mechanism for Encoding of One-Trial Experience. Journal of Neuroscience, 29, 898-906. http://dx.doi.org/10.1523/JNEUROSCI.4588-08.2009
  22. Guzowski, J.F. (2002) Insights into Immediate-Early Gene Function in Hippocampal Memory Consolidation Using Antisense Oligonucleotide and Fluorescent Imaging Approaches. Hippocampus, 12, 86-104. http://dx.doi.org/10.1002/hipo.10010
  23. Alexandrov, Y.I., Grinchenko, Y.V., Shevchenko, D.G., Averkin, R.G., Matz, V.N., Laukka, S., et al. (2013) The Effect of Ethanol on the Neuronal Subserving of Behavior in the Hippocampus. Journal of Behavioral and Brain Science, 3, 107-130. http://dx.doi.org/10.4236/jbbs.2013.31011
  24. Pickering, C., Avesson, L., Lindblom, J., Liljequist, S. and Schioth, H.B. (2007) To Press or Not to Press? Differential Receptor Expression and Response to Novelty in Rats Learning an Operant Response for Reward. Neurobiology of Learning and Memory, 87, 181-191. http://dx.doi.org/10.1016/j.nlm.2006.08.005
  25. Corbit, L.H. and Balleine, B.W. (2000) The Role of the Hippocampus in Instrumental Conditioning. Journal of Neuroscience, 20, 4233-4239.
  26. Cheung, T.H. and Cardinal, R.N. (2005) Hippocampal Lesions Facilitate Instrumental Learning with Delayed Reinforcement but Induce Impulsive Choice in Rats. BMC Neuroscience, 6, 36. http://dx.doi.org/10.1186/1471-2202-6-36
  27. Hess, U.S., Lynch, G. and Gall, C.M. (1995) Changes in c-Fos mRNA Expression in Rat Brain during Odor Discrimination Learning: Differential Involvement of Hippocampal Subfields CA1 and CA3. Journal of Neuroscience, 15, 4786-4795.
  28. Hess, U.S., Lynch, G. and Gall, C.M. (1995) Regional Patterns of c-Fos mRNA Expression in Rat Hippocampus Following Exploration of a Novel Environment versus Performance of a Well-Learned Discrimination. Journal of Neuroscience, 15, 7796-7809.
  29. Gall, C.M., Hess, U.S. and Lynch, G. (1998) Mapping Brain Networks Engaged by, and Changed by, Learning. Neurobiology of Learning and Memory, 70, 14-36. http://dx.doi.org/10.1006/nlme.1998.3835
  30. Hampson, R.E., Simeral, J.D. and Deadwyler, S.A. (1999) Distribution of Spatial and Nonspatial Information in Dorsal Hippocampus. Nature, 402, 610-614. http://dx.doi.org/10.1038/45154
  31. Kelly, M.P. and Deadwyler, S.A. (2003) Experience-Dependent Regulation of the Immediate-Early Gene Arc Differs across Brain Regions. Journal of Neuroscience, 23, 6443-6451.
  32. Paxinos, G. and Watson, C. (1997) The Rat Brain in Stereotaxic Coordinates. Academic Press, New York.
  33. Lee, M.Y., Chiang, C.C., Chiu, H.Y., Chan, M.H. and Chen, H.H. (2014) N-Acetylcysteine Modulates Hallucinogenic 5-HT2A Receptor Agonist-Mediated Responses: Behavioral, Molecular, and Electrophysiological Studies. Neuropharmacology, 81, 215-223. http://dx.doi.org/10.1016/j.neuropharm.2014.02.006
  34. Lkhagvasuren, B., Oka, T., Nakamura, Y., Hayashi, H., Sudo, N. and Nakamura, K. (2014) Distribution of Fos-Immu- noreactive Cells in Rat Forebrain and Midbrain Following Social Defeat Stress and Diazepam Treatment. Neuroscience, 272, 34-57. http://dx.doi.org/10.1016/j.neuroscience.2014.04.047
  35. Takahashi, T., Zhu, Y., Hata, T., Shimizu-Okabe, C., Suzuki, K. and Nakahara, D. (2009) Intracranial Self-Stimulation Enhances Neurogenesis in Hippocampus of Adult Mice and Rats. Neuroscience, 158, 402-411. http://dx.doi.org/10.1016/j.neuroscience.2008.10.048
  36. Wanner, S.P., Yoshida, K., Kulchitsky, V.A., Ivanov, A.I., Kanosue, K. and Romanovsky, A.A. (2013) Lipopolysaccharide-Induced Neuronal Activation in the Paraventricular and Dorsomedial Hypothalamus Depends on Ambient Temperature. PLoS ONE, 8, e75733. http://dx.doi.org/10.1371/journal.pone.0075733
  37. Fanous, S., Guez-Barber, D.H., Goldart, E.M., Schrama, R., Theberge, F.R., Shaham, Y., et al. (2013) Unique Gene Alterations Are Induced in FACS-Purified Fos-Positive Neurons Activated during Cue-Induced Relapse to Heroin Seeking. Journal of Neurochemistry, 124, 100-108. http://dx.doi.org/10.1111/jnc.12074
  38. Mayhew, T.M. and Gundersen, H.J. (1996) “If You Assume, You Can Make an Ass Out of U and Me”: A Decade of the Disector for Stereological Counting of Particles in 3D Space. Journal of Anatomy, 188, 1-15.
  39. Jinno, S. and Kosaka, T. (2006) Cellular Architecture of the Mouse Hippocampus: A Quantitative Aspect of Chemically Defined GABAergic Neurons with Stereology. Neuroscience Research, 56, 229-245. http://dx.doi.org/10.1016/j.neures.2006.07.007
  40. Bechtholt-Gompf, A.J., Walther, H.V., Adams, M.A., Carlezon Jr., W.A., Ongür, D. and Cohen, B.M. (2010) Blockade of Astrocytic Glutamate Uptake in Rats Induces Signs of Anhedonia and Impaired Spatial Memory. Neuropsychopharmacology, 35, 2049-2059. http://dx.doi.org/10.1038/npp.2010.74
  41. Suzuki, A., Josselyn, S.A., Frankland, P.W., Masushige, S., Silva, A.J. and Kida, S. (2004) Memory Reconsolidation and Extinction Have Distinct Temporal and Biochemical Signatures. Journal of Neuroscience, 24, 4787-4795. http://dx.doi.org/10.1523/JNEUROSCI.5491-03.2004
  42. Stollhoff, N., Menzel, R. and Eisenhardt, D. (2008) One Retrieval Trial Induces Reconsolidation in an Appetitive Learning Paradigm in Honeybees (Apis mellifera). Neurobiology of Learning and Memory, 89, 419-425. http://dx.doi.org/10.1016/j.nlm.2007.10.003
  43. Mickley, G.A., Hoxha, Z., Bacik, S., Kenmuir, C.L., Wellman, J.A., Biada, J.M., et al. (2007) Spontaneous Recovery of a Conditioned Taste Aversion Differentially Alters Extinction-Induced Changes in c-Fos Protein Expression in Rat Amygdala and Neocortex. Brain Research, 1152, 139-157. http://dx.doi.org/10.1016/j.brainres.2007.03.050
  44. Strekalova, T., Zörner, B., Zacher, C., Sadovska, G., Herdegen, T. and Gass, P. (2003) Memory Retrieval after Contextual Fear Conditioning Induces c-Fos and JunB Expression in CA1 Hippocampus. Genes, Brain and Behavior, 2, 3-10. http://dx.doi.org/10.1034/j.1601-183X.2003.00001.x
  45. Reijmers, L.G., Perkins, B.L., Matsuo, N. and Mayford, M. (2007) Localization of a Stable Neural Correlate of Associative Memory. Science, 317, 1230-1233. http://dx.doi.org/10.1126/science.1143839
  46. Hobin, J.A., Goosens, K.A. and Maren, S. (2003) Context-Dependent Neuronal Activity in the Lateral Amygdala Represents Fear Memories after Extinction. Journal of Neuroscience, 23, 8410-8416.
  47. McKenzie, S. and Eichenbaum, H. (2011) Consolidation and Reconsolidation: Two Lives of Memories? Neuron, 71, 224-233. http://dx.doi.org/10.1016/j.neuron.2011.06.037
  48. Tse, D., Takeuchi, T., Kakeyama, M., Kajii, Y., Okuno, H., Tohyama, C., et al. (2011) Schema-Dependent Gene Activation and Memory Encoding in Neocortex. Science, 333, 891-895. http://dx.doi.org/10.1126/science.1205274
  49. Kaczmarek, L. and Kaminska, B. (1989) Molecular Biology of Cell Activation. Experimental Cell Research, 183, 24- 35. http://dx.doi.org/10.1016/0014-4827(89)90415-1
  50. Clayton, D.F. (2000) The Genomic Action Potential. Neurobiology of Learning and Memory, 74, 185-216. http://dx.doi.org/10.1006/nlme.2000.3967
  51. Edelman, G.M. (1989) Neural Darwinism: The Theory of Neuronal Group Selection. Oxford University Press, Oxford.
  52. McGaugh, J.L. (2000) Memory―A Century of Consolidation. Science, 287, 248-251. http://dx.doi.org/10.1126/science.287.5451.248
  53. Dudai, Y. (2012) The Restless Engram: Consolidations Never End. Annual Review of Neuroscience, 35, 227-247. http://dx.doi.org/10.1146/annurev-neuro-062111-150500
  54. Stickgold, R. and Walker, M.P. (2005) Memory Consolidation and Reconsolidation: What Is the Role of Sleep? Trends in Neurosciences, 28, 408-415. http://dx.doi.org/10.1016/j.tins.2005.06.004
  55. Best, J., Diniz Behn, C., Poe, G.R. and Booth, V. (2007) Neuronal Models for Sleep-Wake Regulation and Synaptic Reorganization in the Sleeping Hippocampus. Journal of Biological Rhythms, 22, 220-232. http://dx.doi.org/10.1177/0748730407301239
  56. Jackson, C., McCabe, B.J., Nicol, A.U., Grout, A.S., Brown, M.W. and Horn, G. (2008) Dynamics of a Memory Trace: Effects of Sleep on Consolidation. Current Biology, 18, 393-400. http://dx.doi.org/10.1016/j.cub.2008.01.062
  57. Gorkin, A.G. and Shevchenko, D.G. (1996) Distinctions in the Neuronal Activity of the Rabbit Limbic Cortex under Different Training Strategies. Neuroscience and Behavioral Physiology, 26, 103-112. http://dx.doi.org/10.1007/BF02359413
  58. Alexandrov, Yu.I., Grinchenko, Y.V., Shevchenko, D.G., Averkin, R.G., Matz, V.N., Laukka, S., et al. (2001) A Subset of Cingulate Cortical Neurones Is Specifically Activated during Alcohol-Acquisition Behaviour. Acta Physiologica Scandinavica, 171, 87-97.
  59. Silberberg, G., Gupta, A. and Markram, H. (2002) Stereotypy in Neocortical Microcircuits. Trends in Neurosciences, 25, 227-230. http://dx.doi.org/10.1016/S0166-2236(02)02151-3
  60. Wang, Y., Gupta, A., Toledo-Rodriguez, M., Wu, C.Z. and Markram, H. (2002) Anatomical, Physiological, Molecular and Circuit Properties of Nest Basket Cells in the Developing Somatosensory Cortex. Cerebral Cortex, 12, 395-410. http://dx.doi.org/10.1093/cercor/12.4.395
  61. Peters, A. and Yilmaz, E. (1993) Neuronal Organization in Area 17 of Cat Visual Cortex. Cerebral Cortex, 3, 49-68. http://dx.doi.org/10.1093/cercor/3.1.49
  62. Nakashiba, T., Cushman, J.D., Pelkey, K.A., Renaudineau, S., Buhl, D.L., McHugh, T.J., et al. (2012) Young Dentate Granule Cells Mediate Pattern Separation, whereas Old Granule Cells Facilitate Pattern Completion. Cell, 149, 188- 201. http://dx.doi.org/10.1016/j.cell.2012.01.046
  63. Zangenehpour, S. and Chaudhuri, A. (2002) Differential Induction and Decay Curves of c-fos and zif268 Revealed through Dual Activity Maps. Molecular Brain Research, 109, 221-225. http://dx.doi.org/10.1016/S0169-328X(02)00556-9
  64. Acquaviva, C., Bossis, G., Ferrara, P., Brockly, F., Jariel-Encontre, I. and Piechaczyk, M. (2002) Multiple Degradation Pathways for Fos Family Proteins. Annals of the New York Academy of Sciences, 973, 426-434. http://dx.doi.org/10.1111/j.1749-6632.2002.tb04677.x