1) This is a comparison of the Fall 2007 MAT0024C Test
Group (Courses with Factoring Active Learning Notes) with the Fall 2007
MAT0024C Control Group (Courses without Factoring Active Learning Notes).
In this study, I compared two groups: the Fall 2007 MAT0024C
Test Group (Courses with Factoring Active Learning Notes) with the Fall 2007
MAT0024C Control Group (Courses without Factoring Active Learning Notes).
My goal was to compare courses all from the same semester that were taking the
same MAT0024C State Exam. There was a total of 403 students who took the
exam, of which 105 had the active learning notes for factoring, and 298 did
not.
A comparison of only the percent correct from the two groups
reveals the following:
Questions |
||||||
Q19 |
Q20 |
Q21 |
Q22 |
Q23 |
Q24 |
Q25 |
Percent correct |
||||||
Test Group Total Students = 105 |
||||||
85.71% |
94.29% |
89.52% |
73.33% |
78.10% |
84.76% |
72.38% |
Control Group Total Students = 298 |
||||||
83.22% |
95.97% |
89.93% |
75.84% |
76.85% |
82.21% |
76.85% |
All of the percents were near each other; however, the test
group was higher on 3 questions (19, 23, 24) while the control was higher on 4
questions (20, 21, 22, 25).
The proportion correct of the test group is equal to the
proportion correct of the control group.
The proportion correct of the test group is greater than the
proportion correct of the control group.
2 Prop z test to see if there is a statistical difference between test group and control group |
||||||
P-Value: The probability, computed assuming that Ho is true, that the observed outcome would take a value as extreme as or more extreme than that actually observed. |
||||||
90/105 versus 248/298 |
99/105 versus 286/298 |
94/105 versus 268/298 |
77/105 versus 226/298 |
82/105 versus 229/298 |
89/105 versus 248/298 |
76/105 versus 229/298 |
p = 0.275 |
p = 0.764 |
p = 0.547 |
p = 0.695 |
p = 0.397 |
p = 0.357 |
p = 0.820 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
An examination of the p values showed that there was no
statistical difference between the groups. This shows that implementing the
active learning for factoring did not increase the percent correct.
Conclusion: Fail
to reject. There is
no statistically significant evidence to reject.
We conclude the proportion correct of the test group is NOT greater than the
proportion correct of the control group.
Since the test group was not greater than the control group, I will examine if the test group is not equal to the control group.
The proportion correct of the test group is equal to the
proportion correct of the control group.
The proportion correct of the test group is not equal to the
proportion correct of the control group.
2 Prop z test to see if there is a statistical difference between test group and control group |
||||||
P-Value: The probability, computed assuming that Ho is true, that the observed outcome would take a value as extreme as or more extreme than that actually observed. |
||||||
90/105 versus 248/298 |
99/105 versus 286/298 |
94/105 versus 268/298 |
77/105 versus 226/298 |
82/105 versus 229/298 |
89/105 versus 248/298 |
76/105 versus 229/298 |
p = 0.550 |
p = 0.472 |
p = 0.905 |
p = 0.609 |
p = 0.793 |
p = 0.714 |
p = 0.359 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
An examination of the p values showed that there was no
statistical difference between the groups. This shows that implementing the
active learning for factoring did not increase or decrease the percent
correct.
Conclusion: Fail to reject. There is no statistically significant evidence to reject. We conclude the proportion correct of the test group is NOT equal to the proportion correct of the control group.
In conclusion, there is no statistically significant
evidence that the active learning notes increases or decreases the proportion
correct. Since there is no significant difference in the active learning notes
and a traditional textbook we can examine the costs of the resources. The price
of traditional textbook is around $150.00 where the active learning notes are
priced around $15 which is about 10% of the cost of a traditional textbook.
There were some lurking variables in this study. One
lurking variable was that some instructors and students who were not in the
test may have used the active learning notes because they were made available
over the internet. Another lurking variable was the experience of the
instructors and the skills of the instructors. To deal with the
experience of the instructors in the next study I compared the test instructors
to themselves the previous year.
\
COMPLETE DATA
All Fall 2007 MAT0024C State Exam Results Complete Data |
||||||
OVERALL RESULTS FOR ALL MAT0024C CLASSES FALL 2007 |
||||||
Overall |
Total Students = 403 |
|
|
|
|
|
Questions |
||||||
Q19 |
Q20 |
Q21 |
Q22 |
Q23 |
Q24 |
Q25 |
Number correct |
||||||
338 |
385 |
362 |
303 |
311 |
334 |
305 |
Percent correct |
||||||
83.87% |
95.53% |
89.83% |
75.19% |
77.17% |
82.88% |
75.68% |
|
|
|
|
|
|
|
RESULTS FOR TEST GROUP USING NOTES IN MAT0024C FALL 2007 |
||||||
Test Group |
Total Students = 105 |
|
|
|
|
|
Questions |
||||||
Q19 |
Q20 |
Q21 |
Q22 |
Q23 |
Q24 |
Q25 |
Number correct |
||||||
90 |
99 |
94 |
77 |
82 |
89 |
76 |
Percent correct |
||||||
85.71% |
94.29% |
89.52% |
73.33% |
78.10% |
84.76% |
72.38% |
|
|
|
|
|
|
|
RESULTS FOR CONTROL GROUP IN MAT0024C FALL 2007 |
||||||
Control Group |
Total Students = 298 |
|
|
|
|
|
Questions |
||||||
Q19 |
Q20 |
Q21 |
Q22 |
Q23 |
Q24 |
Q25 |
Number correct |
||||||
248 |
286 |
268 |
226 |
229 |
245 |
229 |
Percent correct |
||||||
83.22% |
95.97% |
89.93% |
75.84% |
76.85% |
82.21% |
76.85% |
|
|
|
|
|
|
|
2 Prop z test to see if there is a statistical difference between test group and control group
|
||||||
90/105 versus 248/298 |
99/105 versus 286/298 |
94/105 versus 268/298 |
77/105 versus 226/298 |
82/105 versus 229/298 |
89/105 versus 248/298 |
76/105 versus 229/298 |
p = 0.275 |
p = 0.764 |
p = 0.547 |
p = 0.695 |
p = 0.397 |
p = 0.357 |
p = 0.820 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.01 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.05 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
Not Significant at alpha 0.10 |
2 Prop z test to see if there is a statistical difference between test group and control group
|
||||||
P-Value: The probability, computed assuming that Ho is true, that the observed outcome would take a value as extreme as or more extreme than that actually observed. |
||||||
90/105 versus 248/298 |
99/105 versus 286/298 |
94/105 versus 268/298 |
77/105 versus 226/298 |
82/105 versus 229/298 |
89/105 versus 248/298 |
76/105 versus 229/298 |
p = 0.550 |
p = 0.472 |
p = 0.905 |
p = 0.609 |
p = 0.793 |
p = 0.714 |
p = 0.359 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |
Not Significant at alpha 0.01, 0.05, 0.10 |