Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2012)

Starting fall semester 2008 and continuing through spring semester 2012, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 spring semester 2012 sections 30674, 30676
(N = 46)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      0 : 
2. Disagree               2 : **
3. Neutral                9 : *********
4. Agree                 28 : ****************************  [3.9 +/- 0.7]
5. Strongly agree         7 : *******
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      0 : 
2. Disagree              10 : **********
3. Neutral               10 : **********
4. Agree                 22 : **********************  [3.4 +/- 0.9]
5. Strongly agree         4 : ****

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral               19 : *******************
4. Agree                 19 : *******************  [3.4 +/- 0.8]
5. Strongly agree         3 : ***

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      2 : **
2. Disagree               7 : *******
3. Neutral                5 : *****
4. Agree                 25 : *************************  [3.6 +/- 1.1]
5. Strongly agree         7 : *******

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               3 : ***
3. Neutral               13 : *************
4. Agree                 23 : ***********************  [3.7 +/- 0.8]
5. Strongly agree         6 : ******

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                7 : *******
4. Agree                 17 : *****************  [4.3 +/- 0.7]
5. Strongly agree        21 : *********************

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                7 : *******
4. Agree                 24 : ************************  [4.2 +/- 0.7]
5. Strongly agree        14 : **************

III.4 Using PCMC was difficult.    
1. Strongly disagree     16 : ****************
2. Disagree              20 : ********************  [2.0 +/- 2.5]
3. Neutral                5 : *****
4. Agree                  3 : ***
5. Strongly agree         1 : *

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      0 : 
2. Disagree               4 : ****
3. Neutral               12 : ************
4. Agree                 23 : ***********************  [3.7 +/- 0.8]
5. Strongly agree         6 : ******

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited. Some responses have been bolded for emphasis.

"PCMC helps me know where im at when knowing the material."

"I like it because I feel like I have two chances to get the question right."

"I enjoying using the PCMC and would strongly encourage you to continue to use it in the future...
PCMC is a great way to give partial credit, as well as narrow answers down to the correct one."

"I like being able to get partial credit even if my answer is wrong."

"Before using PCMC in this class i would initially look for the first correct answer i saw and then go over the rest of the incorrect answers ruling them out, using PCMC is very helpful for me on questions that i am unsure about cause identifying wrong answers is never a problem."

"i like it, please continue to use it"

"... I love the opportunity PCMC gives me and how it might give me some extra points but all in all the amount given is nothing that would really benefit the overall test. Plus with your tests already a lot of the multiplication problems have options that are all alike so it intimidates me to circle an answer and then go and cross out another since i feel all are correct."

"PCMC is a great way to encourage because if you know for a fact one is wrong then you know you can at least get some points!"

"I like having this because whne the questions area little difficult it does make you go through the possibiliites more thoroughly."

"I like PCMC :)"

"The PCMC really helps narrow down a correct answer if I'm having difficulty on a question."

"You should make the correct incorrect choice worth more than 0.5 points. Maybe one point?"

"no comments"

"I think it's a great idea. Usually when we are presented with multiple choice its all or nothing. This way at least gets you somewhat closer to the answer by eliminating a wrong choice, even if you don't quite know the correct choice"

"you're the man p-dog!"

"it works"

"I like it because I can fall back on them incase I am not quite sure of an answer, but I always end up finishing the quiz or test then going back and figuring our definite wrong ones."

"PCMC was great--even if I answered incorrectly, I still could receive credit on a question without taking a 0 outright. Keep it, P-Dog!"

"I find that PCMC really helps me in determining the answer to a question that I am unsure about."

"No comment"

"It takes a little bit of the stress off of a test."

"I feel PCMC is really valuable for other students more than it is for me. I am the type of person who really studies for tests and quizzes and I dot really want to use PCMC because I want to really earn my grade from putting in the effort and studying. I also, while in the moment of taking a quiz or exam forget that I can make an x mark next to a question I am not 100 percent sure about. I think PCMC will only come in handy for me in the explanation essay portion of the exam, just in case I can't explain something in as much detail as I want."

"I think PCMC is helpful because it's extremely difficult for me to get good grades on these tests. I feel like I study for such a long time, and the material is still eluding me. PCMC makes me a little more confident that I'll hopefully at least pass the class because of the partial credit I receive. (also, I think it might be good if the tests were longer and the questions were worth more points... like 20 questions worth 2 points each- that way, grades aren't devastated if you get a couple wrong!)"

"Do we have multiple choice on the midterm too and does it use PCMC. Or is the midterm only short answer"

"i really like it because all my life i was taught by teachers that if you dont know an answer, eliminate what you know is wrong first to narrow it down. Often i can do this but still struggle with the right answer. So its nice to get partial credit for the fact that i at least somewhat get it."

"i think it is a cool concept but i feel the partial credit that you give for a x-ed out answer doesn't make a very big difference with your score."

"PCMC is a grade helper, and I super appreciate that... especially when one question is worth 4 points."

"I enjoy pcmc to help eliminate wrong answers."

"i think it is smrt but it personaly makes me second guess myself"

"i think we should get even more points for crossing an answer out"

Previous posts:

• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2011)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2011)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2010)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2010)
Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2008)
• Education research: partial credit for multiple-choice questions (PCMC) bibliography

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2011)

Starting fall semester 2008 and continuing through fall semester 2011, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 fall semester 2011 sections 70158, 70160
(N = 48)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      1 : *
2. Disagree               1 : *
3. Neutral               11 : ***********
4. Agree                 26 : **************************  [3.9 +/- 0.8]
5. Strongly agree         9 : *********
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      2 : **
2. Disagree               9 : *********
3. Neutral                8 : ********
4. Agree                 22 : **********************  [3.5 +/- 1.1]
5. Strongly agree         7 : *******

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      2 : **
2. Disagree               2 : **
3. Neutral               17 : *****************
4. Agree                 20 : ********************  [3.6 +/- 1.0]
5. Strongly agree         7 : *******

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      3 : ***
2. Disagree               5 : *****
3. Neutral                8 : ********
4. Agree                 23 : ***********************  [3.6 +/- 1.1]
5. Strongly agree         9 : *********

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral               19 : *******************
4. Agree                 20 : ********************  [3.8 +/- 0.7]
5. Strongly agree         9 : *********

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral                4 : ****
4. Agree                 20 : ********************
5. Strongly agree        23 : ***********************  [4.4 +/- 0.7]

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral                5 : *****
4. Agree                 24 : ************************  [4.2 +/- 0.7]
5. Strongly agree        18 : ******************

III.4 Using PCMC was difficult.    
1. Strongly disagree     20 : ********************
2. Disagree              21 : *********************  [1.8 +/- 3.0]
3. Neutral                5 : *****
4. Agree                  0 : 
5. Strongly agree         2 : **

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral               14 : **************
4. Agree                 19 : *******************  [3.7 +/- 1.0]
5. Strongly agree        10 : **********

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited.

"pcmc rocks!!!"

"it was very helpfull"

"I like that we are rewarded for being able to rule out an answer that is not correct. It reinforces test taking strategy that should be used in all multiple choice tests in any class."

"It's good."

"I think it's nice having PCMC. It helps with the proccess of elimination and it definitly is nice being able to get credit for picking out which answer is wrong on a test. I think that you should continue to use PCMC in the future."

"Keep PCMC"

"I really like using PCMC, it makes taking tests a little easier as well as making you feel less worried about whatever grade you get on the test."

"if you do a X and O on each probelm do you just get partial bacuse i market two or do you get full point if you mark both and they are both correct is it full creadit or partial because two are mark instead of just one beacuse i mark the incorrect and the correct on each probelm just in case ones is wrong then the other is ritghis that partial or full do you have to have both right to get full credit or just one answer to get full credit"

"I have never used PCMC before, and I would like to use it again. Thank you"

"II think PCMC gives the teacher a better undestanding of a students comprehension of the question."

"I Love PCMC!"

"You should put three right answers and one wrong that way, everyone has a 75% chance of getting the right answer!"

"I wish each question wasn't worth so many points (4 pts) especially when PCMC is worth .5 point."

"I think PCMC is good overall. It doesn't allow people to fluff off studying, however for those questions where a student is torn between two answers, it allows them to at least get some credit if they answer incorrectly. It also shows they at least have a rudamentry understanding of the concept."

"It was a nice way to get easy points and now that I think about it, it really did make me read the question answers more thoroughly."

"I think it does help a little with PCMC because even if the answer is wrong on a question, there is a possibility of obtaining some points for the problem given."

"Keep it going!"

"It was a nuetral expeiriance"

"it's a nice way to get points if i don't know the answer to a question."

"It's a Blessing"

"I like PCMC"

"I like the fact we can still get points for questions."

"I like the ability of getting partial points for questions."

"It like using a life line on who wants to be a millionaire...I love that show"

"I really enjoy the system"

"I think that this policy is one of the best I've ever heard of! It really gives us students a little extra push on being able to find the correct answer within some pretty hard material to learn. Thank you for allowing us the second chance!"

"Its th bees knees!!! Hey _____!"

"really like it!!"

"I usually look for obvious wrong answers, so this is great."

"PCMC!"

"I like it because it's almost like the 50/50 lifeline on Who Wants to Be a Millionaire. Sometimes when I find the one definite wrong answer, I look for more wrong answers if I'm not completely sure on a positive answer. Helps me narrow down choices."

"I like it. It's really helpful. Thanks."

"Just a quick reminder of its existence before each test would be helpful for us forgetful types."

"good stuff"

Previous posts:

• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2011)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2010)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2010)
Education research: partial credit for multiple-choice questions (PCMC) student attitudes (fall semester 2008)
• Education research: partial credit for multiple-choice questions (PCMC) bibliography

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Spring semester 2011)

Starting Fall semester 2008 and continuing through Spring semester 2011, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Spring Semester 2011 sections 30674, 30676
(N = 45)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      0 : 
2. Disagree               2 : **
3. Neutral                6 : ******
4. Agree                 29 : *****************************  [4.2 +/- 0.8]
5. Strongly agree        20 : ********************
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      4 : ****
2. Disagree               6 : ******
3. Neutral               14 : **************
4. Agree                 21 : *********************  [3.5 +/- 1.1]
5. Strongly agree        11 : ***********

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral               11 : ***********
4. Agree                 24 : ************************  [3.9 +/- 1.0]
5. Strongly agree        16 : ****************

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      1 : *
2. Disagree               9 : *********
3. Neutral                9 : *********
4. Agree                 17 : *****************
5. Strongly agree        20 : ********************  [3.8 +/- 1.1]

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      1 : *
2. Disagree               2 : **
3. Neutral               10 : **********
4. Agree                 23 : ***********************  [4.1 +/- 0.9]
5. Strongly agree        20 : ********************

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                5 : *****
4. Agree                 17 : *****************
5. Strongly agree        34 : **********************************  [4.5 +/- 0.7]

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral                7 : *******
4. Agree                 22 : **********************
5. Strongly agree        27 : ***************************  [4.3 +/- 0.8]

III.4 Using PCMC was difficult.    
1. Strongly disagree     22 : **********************  [2.0 +/- 3.0]
2. Disagree              19 : *******************
3. Neutral               10 : **********
4. Agree                  4 : ****
5. Strongly agree         1 : *

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      2 : **
2. Disagree               7 : *******
3. Neutral               20 : ********************
4. Agree                 22 : **********************  [3.4 +/- 1.0]
5. Strongly agree         5 : *****

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited.

"I liked PCMC because it allows you to get points back. It helps your grade if you need it. =)"

"i like it except for when i go to look at my score i have a hard time understanding it ."

"I think that the PCMC is really great and think it is very effective in the class on tests and quizzes. The PCMC makes me more confident that I will not fail and at least get some points when I am going between two answers. I normally have really bad test anxiety and PCMC has really helped me not freak out as much as I normally would. I really like the use of PCMC in this class and really wish that more teachers would use this method."

":)"

"i was lost but being in a group with people that know it and got it helps"

"good"

"I think it is very helpful. I also think that it is great to have an extra opportunity to receive points when it could be just written off as wrong."

"Its useful but is doing things partially and getting partial credit really good if the student as clearly demonstrated they do not know the material? I suppose though that even those student will not be helped much by PCMC. I do believe it is excellent for those who can recall some details about the materials which does in fact demonstrate that they have learned some of the material, which i think should be rewarded with some credit, especially if some of the concepts are difficult to grasp."

":)"

"I like it."

"I really appreciate the opportunity to use the PCMC method on our tests. It encourages me to think about the question on a different level and provides me with the confidence to know that even if i didnt get an answer correct, I know my thought process will be recognized and appreciated."

"I think it is a great fall back for a student struggling with the test."

":)"

"I love that we can get partial credit for indentifying wrong answers, it makes me feel a little bit better if I didn't know the correct answer in the first place."

"It helps because I'm doing so poorly"

"I love it."

"it's good :)"

"It gives you hope on a question that you really have no idea how to answer."

"PCMC WOO!"

"I really like PCMC as a system for getting some partial credit on quizzes and tests. It makes it less stressful because even if I don't have certainty about my answer, I can be certain about at least one wrong answer."

"I think that instead of .5 points it should be anywhere between 1-1.5 points because if there is a 4 choice question, eliminating one question removes 25% of the choices so we should get at least 25% of the points because we knew what answer was wrong out of the 4 showing that we know what's going on.Kinda."

"It definitely helps :)"

"If we don't 'x' out an answer we know is wrong, will we not get as much credit?"

"I often confuse myself trying to figure out which wrong answer I should choose."

"It's a good method"

"i like the PCMC"

"I like it. Its just awesome"

"I feel like sometimes if i 'x' out a wrong answer then the question becomes incorrect and i am only graded solely on the partial credit wrong answer i 'x'ed out."

"I think PCMC is a great idea- however, I think it would help to have more review. I know time is a constraint, but it's hard to have a quiz or test almost every week and not go over "problem spots" or maybe have just 10 minutes the class after the quiz/test to go over common wrong answers. Even though it's nice to get some points made up with the PCMC, I think it would be better yet to know more of the correct answers. I say keep the PCMC and maybe add a 10 minute quiz or test review, or have a question on our Online Reading Assignments that allows us to ask for a review of certain topics."

"PCMC is a good help to figuring out the right answer easily"

"Gives a different perspective on the test. anybody would like to have that possibility to get a little credit when not being 100% that the selected answer was best while especially while mind dueling between two"

"I love it :)"

"I think it is really helpful. It helps you to narrow down your choices and get some extra points at the same time! I just wish they were worth a little more. Maybe a full point? .5 out of 4 isn't a whole lot, but every bit helps!"

"I think it's rad."

"Great tool. Helps you cancel out the wrong answer ."

"I like PCMC because sometimes you are torn between two answers... so if you cross off the ones you know are definitely incorrect, you already have a better score than if you took a chance and had to guess."

"Golden"

"helps"

"I think that this method is very effective for nervous multiple-choice test takers! I am definitely a fan."

"I really love all the oppurtunities we get in order to get more points inside class... PCMC really confuses me. Can you explain it more in detail?"

"PCMC has me going into stressfully test situations with more optimism and relaxation which leads to better scores"

":P"

"I think that there should be partial credit for x-ing out any of the incorrect answers not just the most incorrect because then I worry about that as well as circling the right answer. Then partial credit would be more effective and give students a few extra points if they are struggling with a few questions"

"LOVE PCMC!!!!!!!!!!!!!!!!"

"I like the PCMC because I don't feel doomed by an incorrect answer. My grade benefits as I am often able to use the knowledge I have obtained to eliminate an answer I know is wrong."

Previous posts:

• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2010)
• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Spring semester 2010)
Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2008)
• Education research: partial credit for multiple-choice questions (PCMC) bibliography

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2010)

Starting Fall semester 2008 and continuing through Fall semester 2010, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Fall Semester 2010 sections 70158, 70160
(N = 45)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral               11 : ***********
4. Agree                 24 : ************************  [4.0 +/- 0.7]
5. Strongly agree        10 : **********
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      2 : **
2. Disagree              14 : **************
3. Neutral               10 : **********  [3.1 +/- 1.1]
4. Agree                 15 : ***************
5. Strongly agree         4 : ****

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral               13 : *************
4. Agree                 24 : ************************  [3.8 +/- 0.7]
5. Strongly agree         7 : *******

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      1 : *
2. Disagree               6 : ******
3. Neutral               10 : **********
4. Agree                 21 : *********************  [3.6 +/- 1.0]
5. Strongly agree         7 : *******

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral               17 : *****************
4. Agree                 21 : *********************  [3.7 +/- 0.7]
5. Strongly agree         6 : ******

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                1 : *
4. Agree                 27 : ***************************  [4.4 +/- 0.5]
5. Strongly agree        17 : *****************

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                4 : ****
4. Agree                 32 : ********************************  [4.1 +/- 0.5]
5. Strongly agree         9 : *********

III.4 Using PCMC was difficult.    
1. Strongly disagree     19 : *******************  [1.7 +/- 2.8]
2. Disagree              22 : **********************
3. Neutral                3 : ***
4. Agree                  1 : *
5. Strongly agree         0 : 

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      1 : *
2. Disagree               5 : *****
3. Neutral               17 : *****************
4. Agree                 17 : *****************  [3.4 +/- 0.9]
5. Strongly agree         5 : *****

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited.

"I think it's a nice way to get at least some credit, even if you don't know the answer for sure."

"I don't think using PCMC necessarily helped me answer any questions better or improved my test taking skills, but it is really nice to get that partial credit which I think is the most positive outcome of using it. Its really hard sometimes on the quizzes because each question is worth so many points so if you get even one wrong, it drops your grade a lot. So having the option and opportunity for extra points helps a lot."

"It can cause confusion."

"I like the idea of still being able to get some credit for knowing which answers aren't correct, even if you might not get the right answer."

"I like knowing that even if I answer a question wrong I have a chance of recieving credit for the amount of inforation that I 'do' know."

"I think it is useful because even if you don't get the answer right you can cross out one's you know that are wrong."

"I think it is helpful to look out for wrong answers which can move you towards the right answer if you are unsure of the right answer."

"I think PCMC is a very fair way of grading tests. You are a least rewarded for identifying the wrong answer"

"none"

"I like it....a lot."

"like it :)"

"Great Job P-DAWGGGG!!!!!"

"I think its nice because its makes you feel better. 0 points for a question just sucks!"

"PCMC makes you feel more confident after taking a test knowing you get at least some credit for knowing a wrong answer"

"What made you choose PCMC?"

"Its a good way to receive partial credit even if you dont know the correct answer"

"I like this idea, it reinforces the fact that even though you do not know the correct answer, you still have an idea about what it could (or could not) be."

"I think it is a good idea because even if a student gets the wrong answer they can prove that know a little about subject by crossing out an answer they know is FOR SURE not correct (and the fact that partial credit is offered proves that underneath all that thuggish roughness P-dawg has a kind heart)"

"It helps, but it makes you think a little harder than you would normally."

"I like the PCMC because it helps acknowledge that i do know enough about the question to eliminate answers that are wrong and i can get a little credit for that."

"I just had trouble with figuring out how it works in the beginning--that we have to pick the correct answer AND cross out one incorrect answer---I thought at first that if you dont know the answer, you can cross out the one that is definitely incorrect..."

"Even though credit is minimal for PCMC it's still satisfying to earn that extra half point! haha"

"I really liked PCMC. They really help."

"I love PCMC!!"

"Good system, adds a little bit of wiggle-room and forgiveness on tests and quizes."

"i love it"

"I appreciate the partial credit for multiple choice because it helps improve my grade on quizzes/exams."

"From my experience with PCMC, it works fine because its partial credit that you can earn even if you get a question wrong. "

"With that you have a better chance of earning partial credit along with the points for the correct answer if one answers the correct answer"

"PCMC is good for partial credit on multiple choice questions, but it hasn't really helped me answer questions any easier. Usually its really easy to eliminate one choice anyway."

"Receiving partial credit for eliminating an obviously wrong answer is a great idea, and should be implemented more often. It's almost a form of reverse learning, in which we can identify what is at least closer to correct when throwing out one answer, and I like that. PCMC gives a student the opportunity to reinforce their own mental process of elimination, and answer things more confidently."

"in the beginning it sometimes throws you off."

"its a really good idea i wish more classes used this"

"i think the PCMC almost makes the tests too easy, because even when i get an answer wrong i get points which allows me to get a much higher grade than i normally would have."

"It's a nice safety net of sorts if you miss something while studying for a test/quiz"

"It's a great way for students to learn better by identifying and using process of elimination to get closer to the answers."

"I like having the opportunity to be able to get partial credit for a wrong answer."

"I think we should get at least a full point for pcmc instead of only half a point."

Previous posts:

• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Spring semester 2010)
Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2008)
• Education research: partial credit for multiple-choice questions (PCMC) bibliography

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Spring semester 2010)

Starting Fall semester 2008 and continuing through Spring semester 2010, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Spring Semester 2010 sections 30674, 30676
(N = 76)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral               12 : ************
4. Agree                 35 : ***********************************  [4.0 +/- 0.9]
5. Strongly agree        23 : ***********************
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      2 : **
2. Disagree              20 : ********************
3. Neutral               20 : ********************  [3.3 +/- 1.1]
4. Agree                 20 : ********************
5. Strongly agree        14 : ********

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      1 : *
2. Disagree               6 : ******
3. Neutral               17 : *****************
4. Agree                 36 : ************************************  [3.8 +/- 1.9]
5. Strongly agree        14 : **************

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      3 : ***
2. Disagree              12 : ************
3. Neutral                8 : ********
4. Agree                 36 : ************************************  [3.7 +/- 1.1]
5. Strongly agree        17 : *****************

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               6 : ******
3. Neutral               23 : ***********************
4. Agree                 34 : **********************************  [3.7 +/- 0.8]
5. Strongly agree        11 : ***********

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      1 : *
2. Disagree               1 : *
3. Neutral                4 : ****
4. Agree                 35 : ***********************************  [4.3 +/- 0.8]
5. Strongly agree        35 : ***********************************

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               1 : *
3. Neutral               11 : ***********
4. Agree                 40 : ****************************************  [4.1 +/- 0.7]
5. Strongly agree        24 : ************************

III.4 Using PCMC was difficult.    
1. Strongly disagree     38 : *************************************  [1.6 +/- 4.4]
2. Disagree              30 : ******************************
3. Neutral                4 : ****
4. Agree                  2 : **
5. Strongly agree         0 : 

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      4 : ****
2. Disagree               7 : *******
3. Neutral               18 : ******************
4. Agree                 36 : ************************************  [3.5 +/- 1.1]
5. Strongly agree        10 : **********

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited.

"I LIke it Becouse it gives u a better chance to get the correct answer becouse eliminate a couple of the wrong answers."

"The main reason that it is helpful to me is because the reward of partial credit forces me to slow down and work on eliminating before looking for the right answer. Having this incentive I believe actually increases the number of correct answers because of the incentive for students to reason through all of the answers."

"it works. do what you do good sir"

"It's a good method of testing that urges students to read and understand by process of elimination the content of a question by proof."

"Stops you from just circle the first answer u see. i would say it is a good thing"

"PCMC helps me get affitional points inour test."

"The only thing that I dont like about partial credit multiple choice is that we are only allowed to cross out one answer. I usually mark off all of the choices I know are wrong, so it's a little harder to just mark off one."

"PMCS rocks!"

"im just still not use to putting an X yet.."

"having PCMC makes it a lot easier for me to be ready to take the tests"

"At first it was a little hard to understand exactly how to use PCMC, I wasn't sure if I had to have a correct answer circled or not to get the PC, which hurt my grade a bit, but I quickly figured it out and benefitted from it. I think it can only boost one's grade if they understand how to use it."

"I think its great becasue even if you dont know the correct answer to thegiven question, at least you can earn some credit by no which answer is not correct. :)"

"Half credit on missed questions is better than nothing."

"I love the PCMC option, it's very helpful."

"I like being able to get partial credit
I think the use of PCMC is a good tool for eliminating an incorrect answer, which can give you a small amount of points for at least identifying one that was wrong."

"I believe that PCMC is a good way to buffer your grade if you get the initial question wrong. Usually I can figure out which answer is the definite wrong one. Good job PDogg"

"I really like the use of PCMC."

"its a good system in identifying the correct answer by removing the wrong one"

"It helped me feel like I had a greater understanding of the subject when I could identify a wrong answer even when I didn't know the correct one for sure."

"i think that we should be able to iliminate all the wrong choices we know for sure and get extra partial credit instead of just one"

"This is the first time I have seen an instructor use the PCMC system. I like it. You have the opportunity to get partial credit rathor than getting no credit at all. You have more hope when taking a test. Please keep this system going."

"I think that is helps to actually be able to mark off answers that you know are incorrect and in turn be able to get partial credit for it which is great!"

"i enjoy it. its enjoyable"

"I am glad that even if we don't know the right answer we may know the wrong one and get points on that alone."

"Great idea!"

"I like it, it makes you really read over the question and narrow down choices."

"That was legit"

"PCMC's great"

"I thought it was a good way to get some points."

"I like the practice, even if I didn't receive partial credit I like the physical act of crossing out the wrong answer. I think it is a good confidence booster."

"Gives you points for knowing what is wrong and not just for what is right
In multiple choice tests identifying incorrect answers is a standard tactic to maximizing test results, especially if you don't know your stuff. I've been using this tactic for over 45 years. It works! Adding a half point for selecting a wrong answer is not a big deal for me. But it might encourge some to use this tactic more often."

"Good way to get points"

"Sometimes i think i cross out a wrong answer and it's the right answer which sucks"

"This is the first time I have seen partial credit multiple choice, and I am 100% in favor of it. It helps me identify correct answers more efficiently and get better grades on the tests. :D"

"I like being able to get credit for knowing what the wrong answers are on it seems fair. I would suggest you keep using the PCMC in the future."

"I think it a much more efficient way of testing because it makes taking tests not as stressful because it is always possible to still earn some points."

"I think it's a smart idea and I've never seen it before. I would definitely recommend it for other teachers and future classes. I like it because sometimes you may not know what the right answer is but you know what it isn't."

"I think PCMC is a very useful, keep using it. It can't hurt us in, so i like it"

"Its legit :)"

"I like this because sometimes you know that certain answers are not correct but you might not be positive about what one is correct. This way, you can still get a little bit of credit for knowing a little opposed to not getting any credit. I like the PCMC method a lot and strongly suggest keeping it."

"SHIBBY!!!"

"It helps a lot. Like it. Its sweet. Its fun. I love PCMC."

"I like it a lot but sometimes it makes me nervous because essentially it is two chances to be right, but it is also two spots where I can make the wrong choice (making me feel twice as wrong )"

"This is really helpful for concepts that I don't fully understand
Loves it."

"its a good system and i believe that more teachers should follow this practice"

"I like it but at the same time it is hard because i get confused on which isnt the correct answer and spend more time on that than the right answer."

"I love it"

"I like it because if I feel unsure about an answer, at least I feel that I have bettered my chances by eliminating an answer for each problem, and at least can fall back on the fact that at least I will get partial credit. It does make me read questions more thoroughly and take my time."

"love it!"

"Really like it overall, but feel like more questions would be better and less points for each question."

"It makes me feel much more confident about my test scores. Its a brilliant Idea!"

"Having PCMC in class allowed me to be more relaxed too when taking a quiz or exam, mostly because I had the comfort of knowing that even if I answered a question incorrectly, I could still get partial credit for crossing out the wrong answer."

"PCMC is probably a good thing for people that aren't the great test takers, those who second and triple guess themselves. Generally, I look at all or most of the answers anyway; or I use elimination to select an answer."

"i like"

"i think they are great"

"I think it's a great incentive to eliminate answers."

"i think its good because it shows you that even if we dont know the correct answer, we at least are not completely stupid and we at least know what its not"

"It really helps to narrow down your choices and makes it much more clear and understandable."

"It helped me a lot when it came to answers i didint know"

"I think that PCMC is great it shows how much people have learned, it tests them so that if they were only partly listening they would get credit"

Previous posts:

• Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2008)
• Education research: partial credit for multiple-choice questions (PCMC) bibliography

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2008)

During Fall semester 2008, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the seventh week of instruction (after taking three 10-question quizzes), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.

Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Fall Semester 2008 sections 70158, 70160
(N = 40)

I. In order to receive credit for completing this survey, 
   first enter your first and last name below:
   ____


II. Recall that for this semester there is PCMC = "partial 
    credit for multiple choice," where you can get partial 
    credit even after circling a wrong answer, if you have 
    also eliminated an incorrect answer by marking it with 
    an "x."      
      Answer the following statements which may or may not 
    describe your beliefs about PCMC in this class.      
      Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree      1 : *
2. Disagree               1 : *
3. Neutral                3 : ***
4. Agree                 19 : *******************  [4.2 +/- 0.9]
5. Strongly agree        16 : ****************
     
II.2 ...I spend more time taking a test. 
1. Strongly disagree      1 : *
2. Disagree               4 : ****
3. Neutral                9 : *********
4. Agree                 16 : ****************  [3.7 +/- 1.0]
5. Strongly agree         9 : *********

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree      2 : **
2. Disagree               5 : *****
3. Neutral                9 : *********
4. Agree                 19 : *******************  [3.5 +/- 1.0]
5. Strongly agree         5 : *****

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree      2 : **
2. Disagree               7 : *******
3. Neutral                6 : ******
4. Agree                  11 : ***********  [3.7 +/- 1.3]
5. Strongly agree        14 : **************

III. Answer the following statements which may or may not describe 
     your beliefs about PCMC in this class.  

III.1 PCMC helped me answer test questions better.
1. Strongly disagree      0 : 
2. Disagree               3 : ***
3. Neutral               10 : **********
4. Agree                 17 : *****************  [3.9 +/- 0.9]
5. Strongly agree        10 : **********

III.2 I would recommend using PCMC in future semesters of this class.   
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                0 : 
4. Agree                 22: **********************  [4.5 +/- 0.5]
5. Strongly agree        18 : ******************

III.3 Having PCMC a positive experience.
1. Strongly disagree      0 : 
2. Disagree               0 : 
3. Neutral                1 : *
4. Agree                 29 : *****************************  [4.2 +/- 0.5]
5. Strongly agree        10 : **********

III.4 Using PCMC was difficult.    
1. Strongly disagree     22 : **********************
2. Disagree              15 : ***************  [1.5 +/- 3.5]
3. Neutral                3 : ***
4. Agree                  0 : 
5. Strongly agree         0 : 

III.5 I would identify incorrect choices even without PCMC.  
1. Strongly disagree      0 : 
2. Disagree               5 : *****
3. Neutral               14 : **************
4. Agree                 16 : ****************  [3.5 +/- 0.9]
5. Strongly agree         5 : *****

IV. (Optional.)  Please type in any comments you may have regarding 
    the use of PCMC in this class.

The following are all of the student responses to this question, verbatim and unedited.

"P-Pre-ordained C-Cows M-Maul C-Children Mwaaahahaaahaa"

"I think it makes you read the questions more carefully so you can make sure that if you don't know the answer you can at least get some credit for knowing what's NOT the answer, which I think somewhat reinforces knowledge."

"I try my hardest in this class adn I still suck!....Ah"

"I think that using PCMC is another way we can earn points on out tests. Knowing the wrong answer is like know what the right answer is. I believe it is helpful and that every class should use this system."

"In my opinion, PCMC is a really great idea. I don't know how anyone could not like the ability to receive extra credit. It doesn't change the way I read or answer questions on a quiz, but I do appreciate the partial credit if I'm not sure on a question. Every point counts on these killer Astronomy quizzes, right? :)"

"As far as the top questions I'm not sure I understood the exact meaning, I wasn't trying to contradict myself if i inadvertently did..."
It helps out.

"I like using PCMC because if I get a question wrong on the test but I "X" out the wrong answer, I still get partial creadit and it still gives me a chance to do well on the test even if i don't answer correctly."

"Partial credit for multiple choice is a great way to get points even if you miss the question. Sometimes i know wrong answers but i can not make up my mind on the correct answer. In this case PCMC is a great way to reward students for at least being able to identify wrong answers."

"At least you get credit if get the wrong answer and some credit is better than none"

"I dig it."

"My tactic is to find the right answer first, when I achieve this, I cross out the one I know is incorrect. Other times, if I am unsure with a correct answer, the thought of PCMC gives me a glimpse of hope. Otherwise, PCMC is not a system I employ to answer a question correctly, but it does make me consider each answer, and this perhaps leads to better scores in the end."

"I feel like I am always sure which answer could be incorrect on quiz's and i use PCMC everytime whether i am sure on a question or not. I don't always feel like my points get counted for crossing out an answer. I think it really would be helpful to use PCMC if their were good results for it. It shows we know the answer, but the question was confusing."

"I think it is beneficial overall. I have never crossed another instructor who has done it, so I hope you inspire others. The only complaint would be it seems it would be harder to grade with precision."

"PCMC is helpful because it directs my thoughts to eliminate the incorrect answers and that helps with choosing the correct one."

"I like PCMC, because sometimes I am not sure about the answers, but I know some answers are not correct. Because of PCMC, I still have chances to get points. This is a good system."

"I don't know a lot about astronomy, so the partial credit really helps"

Education research: partial credit for multiple-choice questions (PCMC) bibliography

Fall semester 2008 has partial credit for multiple-choice questions (PCMC) being piloted for Astronomy 210 (introductory one-semester astronomy) at Cuesta College (San Luis Obispo, CA). The intent is to get students to spend more time critically selecting their answers, especially with regards to eliminating incorrect answers. Observations of students in previous semesters is that students spend approximately one minute per question before turning in their completed quizzes, which could be considered much too little time, given that there are two minutes per question allotted.

Quizzes have 10 multiple-choice questions, each with four (A)-(D) choices.

Sample quiz questions from Fall semester 2008:
http://tinyurl.com/3tbhnz

From the course policy:

"Partial credit (0.5 points) will be given for an incorrectly circled answer to a multiple-choice question if a single "x" is also made on one incorrect response to that question. No other circumstance other than that previously described will result in partial credit."

A briefer statement on the quiz itself:

"Closed book, closed notes. Clearly circle ("O") the one choice that you think is most definitely correct. Cross out ("×") only one choice that you think is definitely incorrect."

A correct circled answer is 4.0 points, and 0.5 points is awarded for a successfully identified incorrect answer only if the circled answer is incorrect. Thus the partial-credit option is 1/8th of the full-credit possible.

Brief bibliography, with abstracts/excerpts:

"Humanizing the multiple-choice test with partial credit"
Barry M. Cherkas, Joseph Roitberg, International Journal of Mathematical Education in Science and Technology, Volume 24, Issue 6 November 1993, pages 799-812.

"We describe an innovative method for machine-grading precalculus students: the partial-credit, multiple-choice test (PCMCT). Our scheme is to assign partial credit to any wrong multiple-choice answer for which we can ascribe partially correct reasoning. This permits us to accumulate additional information about the extent of a student's incomplete understanding. We add the assigned partial credit to arrive at our final measure of a student's total knowledge—the student's grade. In comparison with the standard multiple-choice test (MCT), the PCMCT judiciously avoids the necessity to scale scores—an educationally unsound but common practice with MCTs. In addition, the PCMCT turns out to be better at distinguishing uneducated guessing than the MCT. We conducted student surveys in our pre-calculus classes and found that most students believed the PCMCT is a more accurate measure of their knowledge than the MCT. We also uncovered the remarkable result that most students are less math-anxious when taking the PCMCT than when taking either the MCT or a standard essay test."

"Comparative Review: Partial-Credit Scoring Methods for Multiple-Choice Tests"
Robert B. Frary, Applied Measurement in Education, Volume 2, Issue 1 January 1989, pages 79-96.

"This review covers multiple-choice response and scoring methods that attempt to capture information about an examinee's degree or level of knowledge with respect to each item and use this information to produce a total test score. The period covered is mainly from the early 1970s onward; earlier reviews are summarized. It is concluded that there is little to be gained from the complex responding and scoring schemes that have been investigated. Although some of them have confirmed potential to increase internal-consistency reliability, this outcome is often obtained only at the expense of validity. Also, the extra responding time required by some methods would permit lengthening a conventional multiple-choice test sufficiently to obtain the same reliability improvement. Partial-credit response and scoring methods that continue to be used will probably earn this status due to secondary characteristics such as providing feedback to enhance learning."

"A Multiple Choice Test that Rewards Partial Knowledge"
M. Bush, Journal of Further and Higher Education, Volume 25, Number 2, 1 June 2001, pp. 157-163(7).

"A new multiple choice test format is presented that allows examinees to select more than one answer to a question if they are uncertain of the correct one. Negative marking is used to penalise incorrect selections. The aim is to explicitly reward examinees who possess partial knowledge as compared with those who are simply guessing. The result is a test method that forces examinees to think more carefully about their answers, and that yields results of a higher resolution than standard multiple choice tests. After describing the new format, the paper presents and critiques several existing methods which have the same or similar aims. The paper ends with a discussion of the feedback and experience gained to date in using the new format."

"A singular choice for multiple choice"
Gudmund S. Frandsen, Michael I. Schwartzbach, ACM SIGCSE Bulletin Volume 38, Issue 4 (December 2006), p. 34-38.

"How should multiple choice tests be scored and graded, in particular when students are allowed to check several boxes to convey partial knowledge? Many strategies may seem reasonable, but we demonstrate that five self-evident axioms are sufficient to determine completely the correct strategy. We also discuss how to measure robustness of the obtained grades. Our results have practical advantages and also suggest criteria for designing multiple choice questions."