Diagnostic assessment strategies are used to enhance student achievement within several different subject areas. In this study, a diagnostic assessment program was designed and implemented with a group of students diagnosed with Dyscalculia. Students in both the control group and the treatment groups were given a pre-test and a post-test, and results from those tests were used to assess the effectiveness of the program. The findings revealed statistically significant differences between the control group and the treatment groups on the post-test, which indicated that the diagnostic assessment strategy was effective in improving dyscalculic students’ mathematical abilities. The design and implementation of the program, as well as the implications of the findings, are discussed in this article.
Diagnostic assessment strategies have widely been used to enhance student achievement across different subject areas [
The purpose of this study is to investigate the effect of implementing a diagnostic assessment strategy on students who are diagnosed with dyscalculia. The researchers aim at providing further evidence for the usefulness of such programs in the treatment of learning difficulties in general, and mathematics difficulties specifically.
The study attempted to answer the following research questions:
1) Is there a statistically significant difference between pre- and post-test scores for the treatment group?
2) Is there a statistically significant difference between pre- and post-test scores for the control group?
A range of terms for referring to developmental math disability has emerged, along with different criteria used to measure it. According to [
Researchers agree that dyscalculia appears as a problem in learning arithmetic facts and calculation procedures. The question which remains unanswered relates to the underlying deficits which cause these problems. Various candidates have been put forward, including dyslexic difficulties, memory difficulties, spatial difficulties and attentional difficulties. However, many of the studies which have been designed to relate these “underlying” abilities to dyscalculia have confounded them with numerical processing abilities [
Researchers have continuously studied the possibilities and different instructional strategies that can be used in order to assist the learning process of students with mathematical learning difficulties. For example, [
Other researchers utilized computer assisted training to dyscalculic students as the intervention method [
In this article, the researchers report the findings of implementing a diagnostic assessment teaching strategy in order to improve the mathematical and numeracy skills of students diagnosed with dyscalculia.
The study was implemented in the context of the public school system is the Kingdom of Saudi Arabia. Three elementary schools were randomly selected from a pool of 20 elementary schools within the Eastern Province, which include a resource room for children with special needs. Public schools in KSA offer accommodations for students with diagnosed special needs through resource rooms within the same school building. Students are pulled out of regular classrooms and placed in resource rooms for individual instruction in the content area in which they have learning difficulties.
The research design for this study is an experimental design in which two groups were randomly selected. The first group (Group A) was assigned to the treatment (Diagnostic Assessment Program), and the second group (Group B) was assigned as the control group. The treatment group included 26 students from two different schools, who had been diagnosed by the ministry of Education in Saudi Arabia with severe learning difficulties in mathematics (Dyscalculia), and each group was utilized as a separate treatment group to measure if any individual differences might affect the outcome of the treatment and the control group included 15 students from one school who were also diagnosed with dyscalculia.
Resource room teachers in the schools that were assigned as the treatment groups underwent a training program for two weeks on the implementation of the Diagnostic Assessment strategy. Teachers, who teach the control group, did not receive any specific training. All groups were given a pre-test and a post-test (Diagnostic Assessment of Basic Mathematics Skills).
The program was designed on the basis of the common core standards for mathematics, which are applied in a majority of KSA schools. Those Standards or dimensions include: 1) Number recognition (D1) and Number Sense (D2), Ordering Numbers (D3), and Rounding (D4). 2) Basic Arithmetic which includes addition (D5), subtraction (D6), multiplication (D7) and division (D8).
Students are given a lesson for each learning objective, as well as a diagnostic assessment at the end of each lesson in order to measure their mastery of the learning objective. If students demonstrated 80% mastery of the lesson’s objective, the teacher would then move on to the next lesson. However, if students were not able to achieve the desired level of mastery for that lesson, the teacher would then design and deliver a second lesson on the same learning objective using different teaching strategies as well as different learning materials for the lesson based on the feedback from the diagnostic assessment results.
The assessment utilized in this study is a self-designed assessment that measures basic mathematical skills for the elementary school levels. The forty test items were designed based on a thorough analysis of the curriculum as well as comparison with several other tests and assessments utilized by schools within Saudi Arabia, as well as standardized international assessments of basic mathematical skills. Twenty items were developed for each of the learning objectives that cover: 1) Number recognition and Number Sense, Ordering Numbers, and Rounding. 2) Basic Arithmetic which includes addition, subtraction, multiplication and division. The test is designed to identify the strengths and weaknesses of students with regards to specific learning objectives or mathematical skills. The test also helps identify whether a student has achieved the minimum mastery level in order to build or construct further mathematical concepts that will be taught in future units of instruction. Items are graded on a True/False basis, where correct answers received one point and incorrect answers received zero points.
To validate the instrument, the Diagnostic Assessment of Basic Mathematics Skills (DABMS) was evaluated by a panel of five university professors at Dammam University and two school teachers in order to check each item on the test and verify that they measure the targeted mathematical skills and are directly related to the learning objectives specified in the program description.
Group | Size (N) | Percentage |
---|---|---|
Treatment Group one | 14 | 34% |
Treatment Group two | 12 | 29% |
Control Group | 15 | 37% |
Standard | Learning Objective | Sub-Objective | Teaching Methods | Assessment Method |
---|---|---|---|---|
Number Recognition | Recognize Numbers and be able to read them | ・ Students will be able to read one digit numbers. ・ Students will be able to read Two Digit numbers. ・ Students will be able to read three digit numbers. | ・ Use of manipulatives (Coins, objects). ・ Smart-board interactive activities. ・ Flash Cards. | Mastery-based Assessment at the end of each lesson to measure the mastery level of the learning objective using written and verbal tests. |
Ordering numbers | Students will be able to order a set of number from highest to lowest and from lowest to highest. | ・ Students will be able to order numbers from highest to lowest. ・ Students will be able to order numbers from lowest to highest. | ・ Use online activities and games designed for this lesson. (Forest ordering game) ・ Flash cards. | Mastery-based Assessment at the end of each lesson to measure the mastery level of the learning objective using written and verbal tests. |
Rounding | ・ Students will be able to round numbers. | ・ Students will be able to round numbers to the nearest ten. ・ Students will be able to round numbers to the nearest 100. | ・ In-Class group activities using paper worksheets. ・ Interactive games played as a group on the smart-board. | Mastery-based Assessment at the end of each lesson to measure the mastery level of the learning objective using written and verbal tests. |
To test the reliability of the instrument, the researchers implemented the test on a group of students (N = 31) twice with a period of three weeks in between the test and re-test. A reliability coefficient of 0.78 was found.
Data analysis showed that there were no statistically significant differences in students’ scores on the pretest between the control group and either of the treatment groups. Moreover, there were no statistically significant differences between the control groups on the pretest scores. This suggests that all students in all three groups had similar levels of mathematical understanding and abilities at the beginning of this experiment.
Data analysis after the post-test revealed a statistically significant difference in scores between the control group and both treatment group A and treatment group B. This suggests that students who were in the classes where the diagnostic assessment strategy was implemented improved more than those who received regular instruction with regard to their mathematical abilities.
To further test for differences between the control group and the treatment groups on the specific eight dimensions within the DABMS test, means and standard deviations were calculated for the pre and post-tests (see
The main goal of this study was to investigate the effectiveness of implementing a diagnostic assessment strategy
Test Group | Pre-test | Post-test | Adjusted Means Post-test | ||||
---|---|---|---|---|---|---|---|
Mean | SD | Mean | SD | Mean | SD | N | |
Treatment A | 21.4286 | 2.59331 | 34.8571 | 2.38125 | 34.856a | 0.655 | 14 |
Treatment B | 21.5833 | 2.23437 | 35.5833 | 3.26018 | 35.578a | 0.708 | 12 |
Control | 21.2000 | 2.54109 | 25.1333 | 1.50555 | 25.139a | 0.633 | 15 |
Total | 21.3902 | 2.41742 | 31.5122 | 5.45033 | 31.858a | 0.384 | 41 |
Covariance sources | Square total | df | Mean square | F | P | sig |
---|---|---|---|---|---|---|
group | 960.570 | 2 | 480.285 | 79.979 | 0.000 | 0.812 |
pretest | 0.175 | 1 | 0.175 | 0.029 | 0.866 | 0.001 |
error | 222.190 | 37 | 6.005 | |||
total | 1188.244 | 40 |
Post-test | Group | N | Mean | SD | T value | df | sig |
---|---|---|---|---|---|---|---|
post. D1 | Treatment A | 14 | 6.0714 | 1.14114 | -0.621- | 24 | 0.541 |
Treatment B | 12 | 6.3333 | 0.98473 | ||||
post. D2 | Treatment A | 14 | 6.4286 | 0.85163 | -0.661- | 24 | 0.515 |
Treatment B | 12 | 6.6667 | 0.98473 | ||||
post. D3 | Treatment A | 14 | 6.4286 | 0.85163 | 1.135 | 24 | 0.268 |
Treatment B | 12 | 6.0833 | 0.66856 | ||||
post. D4 | Treatment A | 14 | 5.0000 | 0.67937 | 0.825 | 24 | 0.418 |
Treatment B | 12 | 4.7500 | 0.86603 | ||||
post. D5 | Treatment A | 14 | 4.0714 | 0.73005 | -1.877- | 24 | 0.073 |
Treatment B | 12 | 4.6667 | 0.88763 | ||||
post. D6 | Treatment A | 14 | 3.2143 | 0.57893 | -1.163- | 24 | 0.256 |
Treatment B | 12 | 3.5000 | 0.67420 | ||||
post. D7 | Treatment A | 14 | 2.9286 | 0.73005 | 0.665 | 24 | 0.512 |
Treatment B | 12 | 2.7500 | 0.62158 | ||||
post. D8 | Treatment A | 14 | 0.7143 | 0.72627 | -0.389- | 24 | 0.701 |
Treatment B | 12 | 0.8333 | 0.83485 | ||||
post. Total | Treatment A | 14 | 34.8571 | 2.38125 | -0.655- | 24 | 0.519 |
Treatment B | 12 | 35.5833 | 3.26018 |
of instruction in helping students with dyscalculia improve their mathematical abilities. Two treatment groups and one control group were randomly selected, and given instruction in mathematics for a period of two months.
The findings revealed that students who were in the treatment groups and received diagnostic assessment based instruction showed more improvement than students in the control group, which suggested that the diagnostic assessment strategy was effective in significantly improving dyscalculic students’ mathematical abilities.
Test Group | Pre-Test | Post-Test | Marginal Post-Test | |||||
---|---|---|---|---|---|---|---|---|
Dimension | Mean | SD | Mean | SD | Mean | SD | N | |
D1 | Treatment A | 5.2857 | 0.72627 | 6.0714 | 1.14114 | 6.066a | 0.285 | 14 |
Treatment B | 5.2500 | 0.96531 | 6.3333 | 0.98473 | 6.344a | 0.327 | 12 | |
Control | 5.2000 | 0.77460 | 5.6667 | 0.81650 | 5.664a | 0.279 | 15 | |
Total | 5.2439 | 0.79939 | 6.0000 | 1.00000 | 6.024a | 0.165 | 41 | |
D2 | Treatment A | 4.5000 | 0.75955 | 6.4286 | 0.85163 | 6.392a | 0.229 | 14 |
Treatment B | 4.1667 | 0.57735 | 6.6667 | 0.98473 | 6.724a | 0.263 | 12 | |
Control | 4.5333 | 0.74322 | 4.8667 | 0.74322 | 4.855a | 0.224 | 15 | |
Total | 4.4146 | 0.70624 | 5.9268 | 1.17026 | 5.990a | 0.133 | 41 | |
D3 | Treatment A | 4.2143 | 0.89258 | 6.4286 | 0.85163 | 6.452a | 0.205 | 14 |
Treatment B | 4.4167 | 0.66856 | 6.0833 | 0.66856 | 6.105a | 0.236 | 12 | |
Control | 4.2000 | 0.67612 | 4.6000 | 0.82808 | 4.560a | 0.201 | 15 | |
Total | 4.2683 | 0.74244 | 5.6585 | 1.13159 | 5.706a | 0.119 | 41 | |
D4 | Treatment A | 2.5714 | 1.01635 | 5.0000 | 0.67937 | 4.993a | 0.222 | 14 |
Treatment B | 2.9167 | 0.66856 | 4.7500 | 0.86603 | 4.798a | 0.255 | 12 | |
Control | 2.5333 | 1.06010 | 3.8000 | 0.94112 | 3.768a | 0.217 | 15 | |
Total | 2.6585 | 0.93834 | 4.4878 | 0.97780 | 4.520a | 0.129 | 41 | |
D5 | Treatment A | 2.7143 | 0.72627 | 4.0714 | 0.73005 | 4.095a | 0.166 | 14 |
Treatment B | 2.5833 | 1.16450 | 4.6667 | 0.88763 | 4.509a | 0.190 | 12 | |
Control | 2.7333 | 0.70373 | 2.6667 | 0.61721 | 2.770a | 0.162 | 15 | |
Total | 2.6829 | 0.84968 | 3.7317 | 1.11858 | 3.792a | 0.096 | 41 | |
D6 | Treatment A | 1.2143 | 0.80178 | 3.2143 | 0.57893 | 3.230a | 0.157 | 14 |
Treatment B | 1.3333 | 0.77850 | 3.5000 | 0.67420 | 3.454a | 0.180 | 12 | |
Control | 1.2000 | 0.77460 | 1.8000 | 0.41404 | 1.822a | 0.153 | 15 | |
Total | 1.2439 | 0.76748 | 2.7805 | 0.93574 | 2.835a | 0.091 | 41 | |
D7 | Treatment A | 0.5714 | 0.51355 | 2.9286 | 0.73005 | 2.927a | 0.196 | 14 |
Treatment B | 0.5833 | 0.51493 | 2.7500 | 0.62158 | 2.726a | 0.225 | 12 | |
Control | 0.4667 | 0.51640 | 1.2000 | 0.77460 | 1.220a | 0.191 | 15 | |
Total | 0.5366 | 0.50485 | 2.2439 | 1.06725 | 2.291a | 0.113 | 41 | |
D8 | Treatment A | 0.3571 | 0.49725 | 0.7143 | 0.72627 | 0.752a | 0.197 | 14 |
Treatment B | 0.3333 | 0.49237 | 0.8333 | 0.83485 | 0.792a | 0.226 | 12 | |
Control | 0.3333 | 0.48795 | 0.5333 | 0.51640 | 0.531a | 0.192 | 15 | |
Total | 0.3415 | 0.48009 | 0.6829 | 0.68699 | 0.692a | 0.114 | 41 |
This finding further supports the findings of previous studies (i.e. Fuchs et al., 2010; Kauffman, Handl, and Thony, 2003) that found that certain types of specialized instruction can improve the mathematical abilities and performance of Dyscalculic students
Source | Independent variables | df | F | P | Sig |
---|---|---|---|---|---|
Group Hoteling’s value = 8.196 Sig = 0.000 | post.D1 | 2 | 1.235 | 0.305 | 0.076 |
post.D2 | 2 | 17.548 | 0.000 | 0.539 | |
post.D3 | 2 | 24.403 | 0.000 | 0.619 | |
post.D4 | 2 | 8.867 | 0.001 | 0.372 | |
post.D5 | 2 | 27.404 | 0.000 | 0.646 | |
post.D6 | 2 | 29.993 | 0.000 | 0.667 | |
post.D7 | 2 | 22.707 | 0.000 | 0.602 | |
post.D8 | 2 | 0.478 | 0.625 | 0.031 |
The findings of this study suggest a need for further development and implementation of specific diagnostic assessment based programs in order to assist students with dyscalculia in becoming more able to overcome their mathematical difficulties, especially in early years.
Ahmad Rababah,Yazan Alghazo, (2016) Diagnostic Assessment and Mathematical Difficulties: An Experimental Study of Dyscalculia. Open Journal of Social Sciences,04,45-52. doi: 10.4236/jss.2016.46005