20111016

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2011)

Starting fall semester 2008 and continuing through fall semester 2011, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 fall semester 2011 sections 70158, 70160
(N = 48)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      1 : *
2. Disagree               1 : *
3. Neutral               11 : ***********
4. Agree                 26 : **************************  [3.9 +/- 0.8]
5. Strongly agree         9 : *********
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      2 : **
2. Disagree               9 : *********
3. Neutral                8 : ********
4. Agree                 22 : **********************  [3.5 +/- 1.1]
5. Strongly agree         7 : *******

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      2 : **
2. Disagree               2 : **
3. Neutral               17 : *****************
4. Agree                 20 : ********************  [3.6 +/- 1.0]
5. Strongly agree         7 : *******

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      3 : ***
2. Disagree               5 : *****
3. Neutral                8 : ********
4. Agree                 23 : ***********************  [3.6 +/- 1.1]
5. Strongly agree         9 : *********

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral               19 : *******************
4. Agree                 20 : ********************  [3.8 +/- 0.7]
5. Strongly agree         9 : *********

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral                4 : ****
4. Agree                 20 : ********************
5. Strongly agree        23 : ***********************  [4.4 +/- 0.7]

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral                5 : *****
4. Agree                 24 : ************************  [4.2 +/- 0.7]
5. Strongly agree        18 : ******************

III.4 Using PCMC was difficult.    
1. Strongly disagree     20 : ********************
2. Disagree              21 : *********************  [1.8 +/- 3.0]
3. Neutral                5 : *****
4. Agree                  0 : 
5. Strongly agree         2 : **

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral               14 : **************
4. Agree                 19 : *******************  [3.7 +/- 1.0]
5. Strongly agree        10 : **********

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.
The following are all of the student responses to this question, verbatim and unedited.
"pcmc rocks!!!"

"it was very helpfull"

"I like that we are rewarded for being able to rule out an answer that is not correct. It reinforces test taking strategy that should be used in all multiple choice tests in any class."

"It's good."

"I think it's nice having PCMC. It helps with the proccess of elimination and it definitly is nice being able to get credit for picking out which answer is wrong on a test. I think that you should continue to use PCMC in the future."

"Keep PCMC"

"I really like using PCMC, it makes taking tests a little easier as well as making you feel less worried about whatever grade you get on the test."

"if you do a X and O on each probelm do you just get partial bacuse i market two or do you get full point if you mark both and they are both correct is it full creadit or partial because two are mark instead of just one beacuse i mark the incorrect and the correct on each probelm just in case ones is wrong then the other is ritghis that partial or full do you have to have both right to get full credit or just one answer to get full credit"

"I have never used PCMC before, and I would like to use it again. Thank you"

"II think PCMC gives the teacher a better undestanding of a students comprehension of the question."

"I Love PCMC!"

"You should put three right answers and one wrong that way, everyone has a 75% chance of getting the right answer!"

"I wish each question wasn't worth so many points (4 pts) especially when PCMC is worth .5 point."

"I think PCMC is good overall. It doesn't allow people to fluff off studying, however for those questions where a student is torn between two answers, it allows them to at least get some credit if they answer incorrectly. It also shows they at least have a rudamentry understanding of the concept."

"It was a nice way to get easy points and now that I think about it, it really did make me read the question answers more thoroughly."

"I think it does help a little with PCMC because even if the answer is wrong on a question, there is a possibility of obtaining some points for the problem given."

"Keep it going!"

"It was a nuetral expeiriance"

"it's a nice way to get points if i don't know the answer to a question."

"It's a Blessing"

"I like PCMC"

"I like the fact we can still get points for questions."

"I like the ability of getting partial points for questions."

"It like using a life line on who wants to be a millionaire...I love that show"

"I really enjoy the system"

"I think that this policy is one of the best I've ever heard of! It really gives us students a little extra push on being able to find the correct answer within some pretty hard material to learn. Thank you for allowing us the second chance!"

"Its th bees knees!!! Hey _____!"

"really like it!!"

"I usually look for obvious wrong answers, so this is great."

"PCMC!"

"I like it because it's almost like the 50/50 lifeline on Who Wants to Be a Millionaire. Sometimes when I find the one definite wrong answer, I look for more wrong answers if I'm not completely sure on a positive answer. Helps me narrow down choices."

"I like it. It's really helpful. Thanks."

"Just a quick reminder of its existence before each test would be helpful for us forgetful types."

"good stuff"


Previous posts:
at

No comments:

Post a Comment