This study investigated how using concept maps affects meaning formation and schemata organization of a biology course content. Here, high school students taking an introductory course on biology were required to provide conceptual definitions for ten course-relevant target concepts by using a natural semantic network technique. This allowed us to computer-simulate schemata behavior and select schemata-related concepts that were used to compare these word pairs against other semantic related concepts in a semantic priming study before and after the course. An experimental group used concept maps as a learning tool whereas the control did not. Results showed that semantic priming effects to schemata related concepts are obtained only for students who used concept maps as a learning tool. Implications of the study findings are discussed in the context of a formative learning approach.
Concept maps’ effectiveness as a visual learning tool for meaningful acquisition of organized knowledge has long been debated. For instance, there is empirical evidence showing that training and individual differences can be serious obstacles for concept map usability (Holley & Danserau, 1984;Martin, Martin, & Southworth, 2015). In addition, alternative learning techniques seem to outperform concept map techniques learning results (Karpicke & Blunt, 2011). On the other hand, there is a robust body of empirical research supporting concept map tools’ effectiveness (for a review, see McAleese, 1999;Farrand, Hussain, & Hennessy, 2002;Nesbit & Adesope, 2006, 2013;Schroeder, Nesbit, Anguiano, & Adesope, 2017).
Ignoring this hot debate, a broad variety of teachers from different academic fields, researchers, and educational technology developers (e.g., Liu & Lee, 2013;Wang & Dwyer, 2006) are using concept maps as a learning tool, claiming that these tools offer additional theoretical and practical advantages. First, these tools subscribe to a view of learning where assessment of what is learned by a student must reveal what a learner knows (formative learning) as opposed to evaluating what students do not know, which is the case in classical assessments and testing (summative learning; Arieli, 2013). Thus, it is assumed that graphically representing acquisition and organization of newly acquired knowledge into a general visual framework/structure empowers students with the conscious and controlled externalization of their knowledge in long-term memory through specific representational formats. A considerable number of concept map models have been developed to analyze different aspects of this student-controlled externalization of acquired knowledge (mental representation analysis), such as semantic networks (Clariana, 2010a, 2010b;Holley & Danserau, 1984)and comparable tools (concept mapping, tree diagrams, causal diagrams, etc.; Hyerle, 2009).
Second, mental representation analysis approaches are accompanied by cognitive methods and techniques to ensure that conceptual change due to learning has been really integrated into long-term memory. For example, authors of long-term knowledge retention studies argue that students tend to retain a reduced knowledge schema of previously tested knowledge only (e.g., Conway, Cohen, & Stanhope, 1991, 1992). On the other hand, Morales and colleagues (Gonzales et al., 2013; Morales & Lopez, 2016) have argued that, by using semantic priming studies (Mcnamara, 2005)it is possible to immediately identify if schemata-related concepts due learning exist in the lexicon after a course has ended (schemata priming effects). This is relevant, since learned concept organization produces long-term priming effects whenever newly acquired semantics-related concepts are integrated in long-term memory (Becker, Moscovitch, Behrman, & Joordens, 1997).
Taking together the constructive nature of concept mapping during learning (Jonassen, Beisner, & Yacci, 1993)as well as chronometric assessment of learning, a powerful formative approach for assessing and facilitating learning can be stablished. There is no need to continue comparing the most usable properties of concept mapping (formative learning information) against summative approaches of learning (e.g., achievement indexes).
Here, it is argued that, even when concept mapping has extensively been used to emphasize constructive aspects of knowledge acquisition in biology (e.g., cell biology, Allen & Tammer, 2003; biology research, Wallace, 1990; tertiary biology classes, Bunting, Coll, & Campbell, 2006; and other subjects, Kinchin, 2015; Lalor & Rainford, 2014), this academic endeavor remains incomplete, since no constructive/chronometric methodology has been considered to assure long-term retention of new knowledge due to concept mapping effects.
Next, we introduce a study considering a course on biology to put under constructive/chronometric scrutiny the effect of using the concept mapping as a learning tool in this academic field.
A cognitive constructive-chronometric assessment approach (Morales, Lopez, Castro, Villarreal, & Gonzales, 2017)was considered to determine the effect of using a concept mapping technique for long-term memory knowledge organization and meaning formation in a biology course.
In a typical constructive-chronometric study, students’ mental representations of course content are obtained using a natural semantic network. Here, they are required to define the target concepts that are related by a schema both before and at the end of a course. This technique has been tested and was shown to produce definitions of the represented objects that are based on their meaning, not on free associations or pure semantic category membership (Figueroa, Gonzales, & Solis, 1975). Furthermore, simulated schemata behavior is implemented by using these conceptual definitions to obtain schemata-related concepts that are used in word recognition studies to determine if students have successfully integrated new knowledge in long-term memory after the course. More details are introduced next.
The study sample comprised of 167 high school middle class students from the north of Mexico (Monterrey city) belonging to five groups taking an introductory course on biology. The teacher was the same for all groups. He was instructed to be aware of not to bias his instruction motivation due to concept mapping as a learning tool. The control group consisted of 64 students (39 females and 25 males), whereas the remaining 103 participants (61 females and 42 males) formed the experimental group. Their age ranged between 14 and 15 years old. Their age ranged between 19 and 21 years old. These students are representative of middle class high school students at the north of Mexico. No credits or economic remuneration provided for participation.
The concept map (Cmap) used in this study is under the Theory of Meaningful Learning precepts (ToML; Ausubel, Novak, & Hanesian, 1986) where Cmaps are considered as schematic devices for representing a set of concepts in a meaningful framework of propositions (Daley, Cañas, & Stark-Schweitzer, 2007). Here, the current study hypothesis assumes that a Cmap hierarchical conceptual structure (by using a constructive approach as suggested by Jonassen, Beisner, & Yacci, 1993;Jonassen, & Marra, 1994) is best to test long-term meaningful knowledge retention (for a debate on this topic see Dervensteva, Safayeni, 2004; see also the procedure section).
In order to visualize conceptual change due to learning, a computer software specialized in analysis of meaning formation through natural semantic nets EVCOG was used (Morales & Lopez, 2016;Morales & Santos, 2015). The cognitive technique called natural semantic network analysis (e.g., Torres & Garza, 2014) requires participants to provide single concept definers for target concepts of a course, in this case: SCIENCE, ECOLOGY, BIOCHEMICHALS, THEORY, ENERGY, METHODOLOGY, BIOLOGY, FOOD CHAIN, ENVIRONMENT, and LIVING BEINGS. These concepts were provided by the teacher as central and relevant to a school course regarding the schema of introduction to biology. As a result, a set of lists is obtained, each containing the ten highest pondered definers for the teacher’s target concepts. To achieve this, the following values are computed:
M value: The sum of the ranks is assigned by all participants to each definer concept. This is a relevant measure for each concept as a definition of the target concept.
SAM (Semantic Analysis of M value) group: The 10 highest-ranked definers with the highest M values for a target concept. This is the set of 10 definers that construct most of the meaning of the target concept in a network.
Some other values, such as the net density (G value) and richness of definers for each target (J value) are computed. This technique produces definitions (using single concept definers like nouns, adjectives, etc.). Moreover, this technique allows obtaining semantic concept representations from teachers and students, rather than from an idiosyncratic semantic net formed by a researcher or an expert.
Furthermore, a semantic net can be drawn if desired. In this study, the weight association between two concepts (W) is computed by applying the following derivative of the Bayesian formula:
Wij = − ln [ p ( X = 0 & Y = 1 ) p ( X = 1 & Y = 0 ) ] × [ p ( X = 1 & Y = 1 ) p ( X = 0 & Y = 0 ) ] 1 (1)
where X and Y represent the pair of concepts to be associated. In determining association values among concepts in a natural semantic network, the joint probability value p(X = 1 & Y = 0) can be obtained by computing how many times the definer X of a pair of concepts appeared in a list of definers in which Y did not appear, and the same for the other probability values. These association weight values were used as an input matrix to a Constrain Satisfaction Neural Net (CSNN) to simulate schemata behavior in the current study (Rumelhart, Smolensky, McClelland, & Hinton, 1986). Furthermore, a software implementation was developed for visualizing meaning formation through a GEPHI network analysis (GEPHI, 2017). Here, metrics for concept organization like net modality, cluster indexing, concept centrality, etc., can be obtained (Bersano, Schaefer, & Bustos, 2012).
Three groups of 38 students each were required to use a concept map technique as a learning tool through the course period (six months). Concept maps gathering requirements are shown in
Working phase, concept map type to develop, concept map component to emphasize, assessment instrument to evaluate a concept map and kind of assessment.
To obtain conceptual definitions to target concepts, participants were seated in front of a computer. The EVCOG system provided them with instructions on how to proceed through the definition task. Then a definition practice trial was presented to define a target concept (either apple or dog). This was followed by the study where target concepts were randomly presented. The maximum time allowed for the production of definers for each target concept was 60 seconds,
Phase I | |||||
---|---|---|---|---|---|
Topic: | Type of map | Instructions | Emphasis | Instrument | Evaluation |
What is science? Science in context Study of life Integrative activity of Phase I | Hierarchical organization Hierarchical organization Hierarchical organization Hierarchical organization | Session class 3 Session class 4 Session class 5 Session class 7 | Type of connectivity Principal concepts and propositions Information hierarchy Information containers, connection lines, propositions and Information hierarchy | Rubric 3 Rubric 4 Rubric 5 Rubric 7 | Co-assessment Self-evaluation Hetero-evaluation Hetero-evaluation |
Phase II | |||||
What is ecology? | Hierarchical organization | Session class 8 | Information hierarchy and visual representation | Rubric 8 | Co-assessment |
Energy producers and consumers | Hierarchical organization | Session class 9 | Visual representation and interpretation | Rubric 9 | Co-assessment |
Energy flow inside ecosystems | Spider | Session class 10 | Concept map variation attending connectivity among concepts | Rubric 10 | Hetero-evaluation |
Matter cycles | Hierarchical organization | Session class11 | Information hierarchy, connectivity, propositions and Information containers. | Rubric 11 | Self-evaluation |
Integrative activity of Phase II | Hierarchical organization | Session class13 | Information containers, connection lines, propositions and Information hierarchy | Rubric 13 | Hetero-evaluation |
while 30 seconds were allowed for the rating of the definers for each concept. Subjects took around 15 minutes to complete this process. At the end of the course, students were required to take a semantic priming to compare their recognition latencies to schemata related concepts against associative related word pairs and non-related word pairs.
Repeated measures ANOVA was carried on semantically-related word pairs. All participants were included, since each provided ≥ 90% correct latencies. As expected, the results showed a significant main effect for the group factor, F(1, 717) = 16.112, p = 0.00007, η2p = 0.021978.
A significant difference from both groups to recognize semantically related word pairs was obtained F(1,717) = 3.8504, p = 0.05011. Furthermore, a post hoc comparison analysis showed that only the experimental group displayed a significant difference F(1,717) = 3.61, p = 0.050, to discriminate schemata-related concepts (schemata priming) from other word pairs at the end of the course.
This result implies that students from the control group did not assimilate information in their long-term memory, since no evidence for schemata information being stored in the lexicon was found. In other words, successful students only learned to pass the course (all of them successfully passed the course). Now,
let us identify some conceptual changes due to learning (constructive evaluation) that might relate to this chronometric evaluation (Gonzalez, Lopez, & Morales, 2013).
From these conceptual groups (SAM groups), a weight association matrix among concepts can be generated by using Equation (1) presented in the introduction section. The EVCOG system allows the user to automatically generate this matrix and use it to produce visual graphs to conduct GEPHI analysis. Conceptual definitions for the control group are not presented due to space limitation, but GEPHI network graph representations obtained from both groups are presented in
This figure indicates that both groups had some knowledge of biology before starting the course, but some concepts were not integrated in their general knowledge schemas. It is assumed that some meaning underlies these conceptual organizations and the teacher’s goal is to impose an improved meaning of course contents through instruction that modifies conceptual change.
Furthermore,
At first glance,
So, what are the conceptual differences between the beginning and end of the course leading to long-term retention of knowledge in the experimental group?
It is evident that, after attending the course, the experimental group produced
a richer set of common definers. Thus, a richer structure underlying concept organization was stablished. The control group also presented a richer set of common definers at the end of the course: PLANTS (7), ANIMALS (5), LIFE (5), STUDY (3), SCIENCE (3), HUMANS (3), ECOLOGY (2), and FOOD (2).
Since both study groups had the same teacher and curriculum content, a similar structure and meaning was expected. However, the use of concept maps appeared to impose a different way to organize information, as shown in
Finally, it must be noted that schemata-related concepts to be compared in a semantic priming study at the end of the course, these concepts were selected from computer simulated schemata behavior (10 word pairs). Specifically, the matrix of connectivity among concepts used to build GEPHI net graphs at the end of the course was also used to simulate emergent schemata behavior in a constraint satisfaction neural net, as proposed by Rumelhart, Smolensky, McClelland, & Hinton (1986).
Notice that computer simulations of schemata behavior can produce a wider set of schemata related concepts.
ASSOCIATIVE | SCHEMATA | NON-RELATED | |||
---|---|---|---|---|---|
Prime | Target | Prime | Target | Prime | Target |
Bee | Bite | Nature | Recycling | Trigonometry | Spin |
Airplane | Pilot | Plants | Scientist | Soldier | Guitar |
Dentist | Tooth | Animals | Energy | Alcoholism | Materials |
Day | Night | Life | Pollution | Wine | Idea |
Globe | Hand | Ecosystem | Matter | Universe | Nervous |
Onion | Tears | Ecology | Science | Carbon | Presidency |
Cheese | Mouse | Humans | Chain | Regulation | Syncretism |
Web | Spider | Evolution | Water | Celebration | Language |
Tennis | Ball | Aliments | Herbivorous | Frog | Universe |
Cacke | Birthday | Chemistry | Carnivorous | Breast | Tree |
The aim of this study was to explore how concept mapping affects conceptual change due to learning. Current results support the idea that a cognitive constructive/chronometric approach to learning assessment might reveal not only if concept mapping of biology course contents is effective as a learning tool, but also whether it empowers a teacher with the capacity for discerning the way concept mapping imposes knowledge organization on the acquired conceptual changes.
Due to the concept mapping capacity to visually display conceptual changes, formative learning reports on what is learned are facilitated. For instance, note from
In any case, this kind of learning assessment of differences in meaning formation due to conceptual change are neither the goal nor at the reach of summative learning.
Finally, note that chronometric evaluation shown in
More research is needed to determine specific effects of using concept maps on acquiring mental representations of course content knowledge. For instance, selected concepts from schemata simulations can be identified in a concept map. Next time the same course is provided to a new student, these schemata-related concepts can be emphasized as relevant to map construction. The idea is to check if these kinds of manipulations affect schemata priming at the end of course.
The authors declare no conflicts of interest regarding the publication of this paper.
Urdiales-Ibarra, M. E., Lopez-Ramirez, E. O., Castro-Campos, C., Villarreal-Treviño, M. G., & Carrillo-Colon, J. E. (2018). Biology Schemata Knowledge Organization and Meaning Formation Due to Learning: A Constructive-Chronometric Approach to Concept Mapping Usability. Creative Education, 9, 2693-2706. https://doi.org/10.4236/ce.2018.916203