Scholarly Research Journal for Humanity Science & English Language, Online ISSN 2348-3083, SJ IMPACT FACTOR 2019: 6.251, www.srjis.com PEER REVIEWED & REFERRED JOURNAL, JUNE-JULY, 2020, VOL- 8/40
CONSTRUCTION AND STANDARDIZATION OF AN ACHIEVEMENT TEST IN MATHEMATICS Ranibala Chourasia1, Rupali Kanade2, Ph.D. & Dr. Kale Supriya 1
Asst. Professor, Department of Mathematics, Sinhgad college of science, Pune
2
Asst. Professor, Department of Mathematics, Sinhgad college of science, Pune Abstract
“Achievement test is a test designed to measure knowledge, understanding and skills in a specified subject or a group of subjects”. It is a test for evaluation of student performance after a period of instructions. A test is done after a period of instructions for evaluation purpose. The present study was conducted to construct and standardize an Achievement test in Mathematics for VIII grade students to measure their achievement. In the present study multiple choice questions (MCQ) type Mathematics Achievement test is constructing according to the blue print. The Construction of test items is an important phase in the development of a test as the reliability; validity of the test depends upon the test items. It is a pre-pilot study. The test consisted of 25 items covering all aspects of text -book of standard VIII prescribed by Maharashtra Board, after doing item analysis, 10 items were retained in the final draft of the test. Reliability was calculated by split half method of reliability and value of coefficient of correlation was found to be 0.99. Validity of the achievement test was established by content validity method. The purpose of an achievement test is to determine student’s knowledge in a particular subject area. It helps in evaluating the effectiveness of teaching instructions. It also provides the feedback to the students as well as to the teachers. The achievement test has the focus on the realization of objectives of teaching and learning. Among such steps, achievement test in Mathematics can help the students. Therefore, in this research paper an attempt has been made to construct and standardized an achievement test in Mathematics so that it will be helpful in improving problem solving skills of students. Keywords: achievement test, construction, standardization Scholarly Research Journal's is licensed Based on a work at www.srjis.com
Introduction Mathematics has played very important role in building up modern civilization by perfecting all sciences. “Mathematics is a science of all science and arts of all arts.”-- Kant Copyright © 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10227
(Pg. 10226-10237)
It is one of the basic subjects in curriculum at all levels, beginning from primary level to engineering, science, and commerce and computer science.The objective of teaching mathematics at primary level is to develop concept of different numbers and basic operations. The goal of education is to develop problem solving skills in mathematics. If students will not practice, they will not understand the concept and leave that concept or skills. So naturally their basic skills will not be perfect. Standardized testing has assumed a prominent role in recent efforts to improve the quality of education. Statement of the Problem: - “Construction and Standardization of an Achievement Test in Mathematics for Class VIII students. Objective of the Study:-Objectives of this research study were as follows: 1. To construct an achievement test in Mathematics to measure the performance level of each pupil on different areas of mathematics in the syllabus of standard VIII th.. 2. To standardize the constructed achievement test of Mathematics for the students completing VIIIth standard. 3.
Preparation of the test manual for the achievement test constructed and standardized in this study.
Method of Construction and Standardization of an achievement Test. This test was constructed on the basis of the objectives of teaching; knowledge, understanding and application and skills in Mathematics. Steps are as follows:1. Planning the test 2. Preparation of the test 3. Administration of the Test 4. Item analysis 5. Standardization of test:
a. Reliability
b. Validity
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10228
(Pg. 10226-10237)
Figure :Flow Chart of Plan & procedure followed in Standardisation of an Achievement Test Objectives of test Content of the Test Planning
Preparation of blue print Item writing
Preparation Checking by expert Item editing Steps of constructing an Achievement test
First try out Administration
Second try out Final try out Difficulty Value
Item Analysis
Discriminative Index Reliability
Standardization Validity
1. Planning of the test:Planning of a test is very important step in the construction of an achievement test. An achievement test needs very careful planning. For proper planning of the test, the investigator has to keep following aspects in mind such as: to whom, what, when and how to measure. It includes designing of the test and preparation of the blue print. Designing of the test includes important aspects such as objectives of the test, content of the test, nature of the test, scoring schemes, number of items, type of items, length of test, weightage to objectives, weightage to content, weightage to questions, allotment of time and marking scheme. Planning is not only an important but an essential aspect of test construction. A good test cannot be constructed by merely „throwing together‟ different types of questions framed on related units. Test in present study constructed in a systematic and organized way. Planning for item difficulty, directions to the examiner, arrangement for try-out, test reproduction, provision for expert review has done carefully in present study, Copyright © 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10229
(Pg. 10226-10237)
In construction of the achievement test of mathematics researcher has drawn the questions which tested the proficiency of the students with respect to different concepts included in the prescribed syllabus of 8th standard mathematics. These questions were based on the topics Number Systems, Algebra, Geometry, and mensuration & Statistical Data Analysis. These test items has drawn as per the instructional objectives knowledge, understanding, skills and application of the mathematical concepts present in these chapters. Test has only multiple type questions to avoid subjectivity in evaluation. The test item constructed according to the blue print 1.1 Objectives of the test Objectives in this achievement test were defined by Bloomâ€&#x;s Taxonomy as knowledge, understanding, application and skill, from all the units of Mathematics of VIIIth class prescribed by the Maharashtra Board of School Education. 1.2 Content of the test The achievement test covered the content from all the units of Mathematics textbook prescribed by the Maharashtra Board of School Education of standard VIII. 1.3 Preparation of blue print After designing, preparation of blueprint is the last stage of the planning of test. Here investigator keptdifferent types of question in blueprint and allots them marks depending on the time and according to difficulty level. The researcher prepared mind map of all questions in the form of a blueprint. Initially 40 Questions were prepared, but after the expert view and ambiguity in items, 25 questions were finalised for try outs. 2. Preparation of items:2.1 Writing the test items:-To serve the purpose of the test design each item or a question of the test was related to the curriculum. Researcher selected the questions based on a predetermined instructional objective on the specific content area. The language of the question was well within the comprehension of pupils. A question is the basic element in the test construction. Considering characteristics of good questions Validity, Reliability, Difficulty level, Discriminating power Practicability, researcher has selected each question of the test constructed and standardized in present study. 2.2 Checking by experts:- Researcher has written questions one by one as per blue print. List of 40 Questions were given to the expert teachers teaching to 8 th standard as per
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10230
(Pg. 10226-10237)
following table.
(K- Knowledge, U- Understanding, A- Application, S- Skills).As per
suggestions of the experts each test items modified and reconstructed. Sr.
Question
No.
This Question will test following K
1
1
2
2
U
A
S
Item selected
Suggestions for
/Reconstruct
Reconstruction
ed
2.3 Items editing:-The difficulty level is a very important characteristic of a question. Present arranged in ascending order of difficulty level. Easy questions have kept in preliminary part of the test so students will have confidence to solve further questions. Test has easy, average and difficult questions as per following table. Sr.
Difficulty level of
No
questions
1.
Easy questions
15
2.
Average questions
70
3.
Difficult question
15
Total
100
Percentage
3. Administration of the Test:3.1 First try out After finalizing the test items, were administered on 50 students for First try-out.
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10231
(Pg. 10226-10237)
First try out Analysis
Mean
Standard Error Median Mode Standard Deviation Sample Variance Kurtosis Skewness Range Minimu m Maximu m Sum Count
31.6000
Q. N o
No. of Stu. who given Corre ct ans.
No. of Stu. who given Wron g answe r
Total Mark s
Not attempt ed
Difficul ty Value
Discrimi nation Index
1.1183
1
38
10
76
2
0.76
-0.16
34.0000 38.0000
2 3
32 2
2 48
64 4
16 0
0.64 0.04
0.56 0
7.9076
4
19
31
38
0
0.38
0.28
62.5306
5
37
13
74
0
0.74
0.28
0.8522
6
33
17
66
0
0.66
0.44
-1.1949 32.0000
7 8
9 46
37 4
18 92
4 0
0.18 0.92
-0.04 0.16
D D
8.0000
9
50
0
100
0
1
0
D
40.0000
10
32
18
64
0
0.64
0.4
11
38
11
76
1
0.76
0.4
12 13 14
13 24 49
33 24 1
26 48 98
4 2 0
0.26 0.48 0.98
-0.36 0.08 0.04
15 16
37 44
9 6
74 88
4 0
0.74 0.88
0.36 0.24
17 18 19
18 39 11
27 7 37
36 78 22
5 4 2
0.36 0.78 0.22
-0.08 0.36 0.2
D
20 21 22
47 28 35
2 21 13
94 56 70
1 1 2
0.94 0.56 0.7
0.12 0.8 0.52
D
23 24
41 34
7 14
82 68
2 2
0.82 0.68
0.28 0.64
25
34
15
68
1
0.68
0.4
1580.00 00 50.0000
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Rema rk
D
D D
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10232
(Pg. 10226-10237)
Second try out Analysis: After First try-out, the test items were administered on the 68 students VIII class of Utkarsha School Pune. This attempt was made to check any point of difficulty as well as any language problem occurring in the construction of the test. All the students were given different answer sheet on which students mark their responses, after giving the required instructions about the test.. Out of 25 items 8 items were discarded. Therefore out of 25 items 8 items (Q. No.3, 7,8,9,13,14,17, 20) were removed from the draft. Thus, the second draft of the achievement test is consisting 17 items keeping in view the nature of content as well as difficulty level.
Questio n No.
No. of Stu. who given Correct answer
1
61
No. of Stu. who given wron g answ er 7
0.9625
2
19
28.0000
4
Mode Standard Deviation Sample Variance Kurtosis
36.0000
Total Marks
Not attemp ted
Diffic ulty Index
Discri minati on Index
122
0
0.9
0.206
47
38
2
0.28
0.32
16
50
32
2
0.24
0.056
5
30
37
60
1
0.44
0.47
7.9371
6
38
29
76
1
0.56
0.29
62.9982
10
47
18
94
3
0.69
0.08
-0.3101
11
30
34
60
4
0.44
0.412
Skewness
-0.2694
12
16
34
32
8
0.24
0.23
Range
38.0000
15
58
7
116
3
0.85
0.176
Minimum
8.0000
16
55
12
110
1
0.81
0.265
Maximum
46.0000 1926.000 0 68.0000
17
41
22
82
5
0.6
-0.029
D
18
46
18
92
4
0.68
0.118
D
21
21
43
42
4
0.31
0.441
22 23
31 51
31 13
62 102
6 4
0.46 0.75
0.676 0.441
24
38
24
76
6
0.56
0.471
25
35
28
70
5
0.51
0.5
28.3230
Mean Standard Error Median
Sum Count
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Remark
D
D
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10233
(Pg. 10226-10237)
3.3 Final try-out The test was administered to 118 students of VIII class who had completed the syllabus for final try-out. The answer sheets were collected from all the students. The answer sheets were scored with the help of scoring key which was already prepared by the investigator. Correct answer has been awarded two mark and incorrect has been awarded zero. Out of 17 items 4 items were discarded. Therefore out of 17 items 4 items (Q. No.4,10,17,18) were removed from the draft. Thus, the Final draft of the achievement test is consisting 13 items keeping in view the nature of content as well as difficulty level. Final try- out Analysis
Mean
Standard Error Median Mode Standard Deviation Sample Variance
No. of Stu. who given wrong answer
29.7118
Question No.
No. of Stu. who given Correct answer
0.74166
1
99
16
198
3
0.84
-0.05
31
2
51
50
102
17
0.43
0.661
36
5
67
50
134
1
0.57
0.559
8.05653
6
71
46
142
1
0.6
0.492
64.90772
11
68
45
136
5
0.58
0.61
12
29
77
58
12
0.25
-0.051
D
15
95
16
190
7
0.81
0.153
D
Total Not Difficulty Discrimination Marks attempted Index Index
Skewness
0.243726 -0.60893
Range
38
16
99
18
198
1
0.84
0.254
Minimum
8
21
49
64
98
5
0.42
0.695
Maximum Sum
46 3506
22 23
66 92
46 21
132 184
6 5
0.56 0.78
0.712 0.373
Count
118
24
72
39
144
7
0.61
0.678
Count
68.0000
25
69
44
138
5
0.58
0.593
22
31
31
62
6
0.46
0.676
23
51
13
102
4
0.75
0.441
24
38
24
76
6
0.56
0.471
25
35
28
70
5
0.51
0.5
Kurtosis
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Remark
D
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10234
(Pg. 10226-10237)
D=Discarded Out of 13 items3 items were discarded. Therefore out of 13 items 3 items (Q. No.1,12,15) were removed from the draft. Thus, the Final draft of the achievement test is consisting 10 items keeping in view the nature of content as well as difficulty level. 4. Item Analysis - Item analysis is the statistical treatment to each item to determine its difficulty level, and the power of discrimination. Researcher carried out this statistical analysis and arranged the questions as per the ascending order of its difficulty level. 4.1 Arranging answer sheet in descending order:-All the 118 answer sheets were arranged in descending order. 4.2 Difficulty Value The percentage of students correctly answering the item is called the item difficulty, and it is denoted as the P value. The range is from 0% to 100%, the higher the value, the easier the item. If P values above 0.90 then test items are very easy items and might be a concept not worth testing. P-values below 0.20 indicate that item is difficult and should be reviewed for possible confusing language or the contents needs re-instruction.The maximumdiscrimination between high and low achievers havingOptimum difficulty level is 0.50. Generally, items of moderate difficulty are to be preferred in test. Difficulty index = No. of correct response / Total no. of response * 100 4.3 Discrimination Index Discrimination index was calculated by the 27% rule. The group was divided into three parts. The best 27% is named as the upper group and the 27% from the worst end will be termed as the lower group. The remaining students were constituted the middle group. For item validity that is the discriminatory values of each item upper and lower group performance was considered. Discriminatory index was calculated using the following formula. D.I.=
U ď€l N /2
Where D.I. = Discriminatory Index U = the number of students in upper group who response correctly. L = the number of students in the lower group who response correctly. N = the total number of students. An item with the discrimination index equal to 0.18 was remained and below 0.18 was rejected. Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10235
(Pg. 10226-10237)
Ebel and Frisbie (1986) gave the following rule of thumb for determining the quality of the items, in terms of the discrimination index. Table
shows the values DI and their
corresponding interpretation. Range
Grade
Recommendations
> 0.39
Excellent
Preserve
0.30-0.39
Good
Possibilities for enhancement
0.20-0.29
Average
Need to verify/review
0.00-0.20
Poor
Reject or review in depth
< -0.01
Worst
Remove
5. Standardization of Achievement Test 25 items constituted in the final form of the Achievement test. Achievement test was standardized by experimental validation of the testwhich includedthe process of establishing reliability and validity. 5.1 Reliability of the test:. Reliability refers to degree of consistency of test scores obtained by same individual when re-examined with test on different sets of equivalent items or under other variable examining condition. There are different methods such as test-retest, split half, alternate form and parallel form etc.Reliability is very important aspect of any test and measuring instrument.It is a degree of consistency of test scores obtained by same individual when re-examined with test on different sets of equivalent items or under other variable examining condition. In the present research paper, the reliability of the test was measured by split half method. The reliability co-efficient of the present test was 0.99149.and spearman brown correlation is .995729.This shows that achievement test has high reliability. Correlation Spearman-Brown correction Cronbach's Alpha
Split half Method 0.991494901 0.995729 Reliability Statistics 0.74582
This result shows that the test is most reliable
5.2 Validity of the test: - Validity refers to the attainment of purpose for which the test is prepared. There are different methods of estimating validity such as face validity, content validity, construct validity, predictive validity and concurrent validity. The investigator opted Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10236
(Pg. 10226-10237)
for content validity. The content validity is concerned with the relevance of the contents of the items, individually and as a whole. Expert judgement was taken into consideration. To estimate content validity of an achievement test, test was given to Mathematics teacher and experts to compare test items with the content and objectives of content. The experts agreed with the investigator with the distribution of content and objective of the content as well as with the scoring procedure. In this way content validity of the achievement test was established. Conclusion:-This Pre-pilot study was carried out to construct and standardize a reliable and valid achievement test in Mathematics. The test was standardized on the sample of 118 students studying in Utkarsha School, Maharashtra school, Shankar- raochavhan more vidyalaya of Pune city. Theoretical and empirical literature related to the study was reviewed. The reliability of the test was determined through split half method of reliability which was 0.99 and content validity of the test was estimated. Hence, the constructed achievement test in Mathematics has a high reliability and validity. The test can be used by the teachers to assess studentâ€&#x;s achievement in Mathematics when they have covered the content areas of VIII class. References Bhagat, Pooja, Baliya JN. Construction and Validation of Achievement Test in Science.International Journal of Science and Research (IJSR).2016, 5(6). Ebel RL. Essentials of Educational Measurement (3rd Edition).Englewood Cliffs, NJ: Prentice Hall, 1979. Good CV. Dictionary of Education. New York: McGraw Hill Book Company Inc, 1959. Jayanthi J. Development and Validation of an Achievement Test in Mathematics. International Journal of Mathematics and Statistics Invention (IJMSI). 2014, 2(4). Kumar N. Construction and Standardization of an Achievement Test in English Grammar. International Journal of Current Research and Modern Education ((IJCRME)).2016, 1(2). Sharma HL, Poonam. Constructivist Approach for Teaching English: Making sense of Paradigm shift from the Traditional Approach. International Journal of Science and Research (IJSR). 2016; 5(10):788-792.
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language
Ranibala Chourasia , Dr. Rupali Kanade & Dr. Kale Supriya
10237
(Pg. 10226-10237)
Sharma HL, Devi Sharmila. Construction of an Achievement Test for the students of VIII class in the Subject of Mathematics International journal of scientific research (IJSR).2013, 2(7). Sharma HL, Rani, Kiran. Tracing the Conceptual Framework of Multimedia-based Instructional Package for Enhancing English Language Skills.International Journal of Science and Research (IJSR).2016, 5(2). Sharma HL, Sharma, Leena. Effect of Constructivist Approach on Academic Achievement of Seventh Grade Learner inMathematics.International Journal of Scientific Research (IJSR).2013, 2(10). Sharma, Manu, Gurmit S. Construction and Standardization of Achievement Test in Economics. International Journal of Science and Research (IJSR).2015; 4(12). Webster’s Dictionary of Education. Spring Field, Massachusetto: G and C Merriain Co. publishers, 1989
Copyright Š 2020, Scholarly Research Journal for Humanity Science & English Language