20110227

Education research: preliminary feedback on flashcards and online reading assignments (Cuesta College, Astronomy 210, Spring Semester 2011)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or asking (anonymous) questions or making (anonymous) comments.

Through the fifth week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards and online reading assignments in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II, III, and V were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Spring Semester 2011 sections 30674, 30676
(N = 56)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture/slideshow presentations by instructor.
1. Strongly disagree 1 : *
2. Disagree 7 : *******
3. Neutral 5 : *****
4. Agree 20 : ********************
5. Strongly agree 23 : *********************** [4.0 +/- 1.1]

II.2 Working in groups on in-class activities.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 12 : ************
4. Agree 26 : ************************** [3.9 +/- 1.0]
5. Strongly agree 14 : **************

II.3 Using flashcards to participate in class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 9 : *********
4. Agree 28 : **************************** [4.1 +/- 0.8]
5. Strongly agree 17 : *****************

II.4 Reading the textbook.
1. Strongly disagree 2 : **
2. Disagree 5 : *****
3. Neutral 22 : ********************** [3.5 +/- 1.1]
4. Agree 14 : **************
5. Strongly agree 12 : ************

II.5 Interacting with other students during class.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 8 : ********
4. Agree 32 : ******************************** [3.9 +/- 0.9]
5. Strongly agree 12 : ************

II.6 Interacting with other students outside of class.
1. Strongly disagree 7 : *******
2. Disagree 9 : *********
3. Neutral 30 : ****************************** [2.8 +/- 1.3]
4. Agree 7 : *******
5. Strongly agree 3 : ***

II.7 Online reading assignments.
1. Strongly disagree 1 : *
2. Disagree 10 : **********
3. Neutral 19 : ******************* [3.4 +/- 1.0]
4. Agree 18 : ******************
5. Strongly agree 8 : ********

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 17 : *****************
4. Agree 24 : ************************ [3.8 +/- 0.8]
5. Strongly agree 12 : ************

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 6 : ******
3. Neutral 14 : **************
4. Agree 26 : ************************** [3.7 +/- 0.9]
5. Strongly agree 10 : **********

III.3 I would recommend using flashcards in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 11 : ***********
4. Agree 28 : **************************** [3.9 +/- 0.8]
5. Strongly agree 14 : **************

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 17 : *****************
2. Disagree 29 : ***************************** [1.9 +/- 2.3]
3. Neutral 8 : ********
4. Agree 1 : *
5. Strongly agree 0 :

III.5 Flashcards were a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 15 : ***************
4. Agree 26 : ************************** [3.9 +/- 0.8]
5. Strongly agree 14 : **************

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 14 : **************
2. Disagree 25 : ************************* [2.2 +/- 2.0]
3. Neutral 11 : ***********
4. Agree 6 : ******
5. Strongly agree 0 :

III.7 Too many flashcard questions were asked.
1. Strongly disagree 9 : *********
2. Disagree 25 : ************************* [2.3 +/- 1.4]
3. Neutral 17 : *****************
4. Agree 4 : ****
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 19 : *******************
2. Disagree 23 : *********************** [2.0 +/- 2.6]
3. Neutral 11 : ***********
4. Agree 3 : ***
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"I think the flash card were helpful to some degree but i understood it more when the question was gone over step by step to understand the question."

"I dont like having to explain my answer outloud, even if I have the right answer, so I always answer that I dont know. Maybe you should ask for volunteers to see who wants to explain their answer?"

"I like how the flashcards make us realize if we actually know the correct answer or not on our own. If we are called on, we better know why we were correct. That was helpful."

"I really love how you make the flashcards different colors, it adds excitement :)"

"It's nice because some of the questions that appear on the quizzes but it would help if we went over them as a class and not just picking on one person and moving on so quickly."

"I really like using flashcards. They make me apply what we just learned in the lecture."

"I really like the concept of using flashcars. It makes answering questions comfortable and productive."

"pleasant :)"

"No other comments. Explaining the flashcard questions for longer would be nice."

"Explaining which answer is correct and why more would help a lot."

"I like them."

"None"

"The way some questions are worded brings confusion."

"They are great! As long as you ask somebody why they picked an answer, please keep the 'I'm lost, and don't know how to answer this.' Also they are much cheaper to produce and procure than electronic 'clickers.'"

"No comments."

"keep using the flashcards they really help"

"They are good, we just need to get the correct answers after so that we can write them down to study for the quizes."

"I like the process. useful learning technique"

"Trying to get a feel for the class..i dig it."

"Flash cards are legit"

"They make you think about what you just learned. I think it helps."

"they make it entertaining"

"I like them"

"Help us and you known if it is really making sense. A lot of teachers just say the info and if we dunno it we just dunno and have to go and ask .. You find out right away if its not making any sense."

"The flashcards are fine, but I need a few more examples done in class in which we are walked though the question step by step. Typically, he gives us one example and then we are just on our own. I need more examples please..... Also, when we are doing flashcards, we never know what the REAL correct answer is. He will call on a student to explain their answer, but he never says, 'YES the correct answer is C,' or 'does that make sense, B everyone??'. I feel like I am so frustrated during flashcard questions and I am always the one person yelling out... 'wait, what is the real answer??' Honestly, I could do without the flashcard questions.... I'd prefer him walking us step by step through it more."

"I don't like folding papers."

"if this is in reference to the a b c d e f g h papers we flip to answer questions i think they are one of the best approaches to lecture I've ever been a part of in school. It works reat to see how well you remembered something and i think it gives the professor a very good idea of how efficient his lecture was."

"I really enjoy the flashcards. They are very helpful. However ,I wish we had more time and went into depth when we achieve the answer. Sometimes, Im not to sure of how we got the answer."

"They are beneficial but not knowing the correct answers makes them a semi-painful experience"

"Flashcards arent as useful or fun as the clickers are. Its really nice having all of that feedback on the screen as to what % of the class answered for each different option."

"I think you should include an option on the flashcard choices that states 'I think I know the answer but I don't want to explain it in front of the class' Many times that seems to be my answer and I hate having to chose 'I'm lost and don't know how to answer this question'"

"Good tool to use to review the material."

"I like them. Super helpful."


V. Answer the following statements which may or may not describe 
your beliefs about the use of the online reading assignments in this class.

V.1 I like working on the online reading assignments.
1. Strongly disagree 0 :
2. Disagree 4 : *******
3. Neutral 28 : ******************
4. Agree 20 : *************************** [3.4 +/- 0.7]
5. Strongly agree 4 : **********

V.2 Online reading assignments helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 5 : **************
3. Neutral 24 : *****************
4. Agree 21 : ********************** [3.4 +/- 0.8]
5. Strongly agree 5 : *******

V.3 I would recommend using online reading assignments in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 3 : ****
3. Neutral 14 : ************
4. Agree 32 : ********************************** [3.8 +/- 0.7]
5. Strongly agree 7 : ***********

V.4 I will avoid other classes using online reading assignments in future semesters.
1. Strongly disagree 9 : *********************
2. Disagree 34 : ***************************** [2.1 +/- 1.4]
3. Neutral 10 : **********
4. Agree 3 : **
5. Strongly agree 0 :

V.5 Online reading assignments were a positive experience.
1. Strongly disagree 0 :
2. Disagree 4 : *
3. Neutral 17 : *************
4. Agree 30 : *************************************** [3.6 +/- 0.7]
5. Strongly agree 5 : *********

V.6 Too much time outside of class was spent working on online reading assignments.
1. Strongly disagree 17 : ******************
2. Disagree 24 : ************************************ [2.0 +/- 2.4]
3. Neutral 12 : ******
4. Agree 3 : *
5. Strongly agree 0 :

V.7 Too many online reading assignment questions were asked.
1. Strongly disagree 10 : *******************
2. Disagree 32 : ********************************** [2.1 +/- 1.5]
3. Neutral 11 : *******
4. Agree 3 : **
5. Strongly agree 0 :

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 15 : *************************** [2.1 +/- 2.1]
2. Disagree 25 : **********************
3. Neutral 11 : **********
4. Agree 5 : ***
5. Strongly agree 0 :

VI. (Optional.) Please type in any comments you may have regarding
the online reading assignments in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"----"

"I like the fact that all of the homework so far is online, that is really nice! And I really like that you just have to submit it and then not have to fill anything out and hand it in!
I like em."

"They're very simple and are right out of the lectures and book"

"the online reading assignments weren't that bad to do and they do help. its also nice to have those random questions like the miso soup one."

"i just find it very hard to find the answers in the text."

"I like the online reading assignments. I like that they are credit/no credit because they are not as much pressure which allows you to answer honestly and not worry about getting marked down for getting a question wrong."

"Sometimes the reading assignments are extremely simple, and other times the assignments are more difficult."

"I like and find them helpful!"

"Online reading assignments are helpful, and I feel that they are easy points to receive."

"I don't like reading ha ha."

"None"

"Again the way some questions are worded brings confusion."

"I answered 'disagree' instead of 'strongly disagree' on the second question- 'I will avoid other classed using online reading assignments in future semesters' only because not all other teachers will give credit just for picking answers, even if they are wrong."

"No comments."

"i still have no leads on that lost book of mine"

"I feel like you need to give us more information to write down in your lectures rather than having just pictures and demonstrations, although those are great too"

"I like the way you segment the class and break up lectures. Makes learning the information more interesting and fun."

"Since I only have class once a week the reading assignments help keep things fresh in my mind.
not bad"

"It helps get points:)"

"It helps you see what's going to be talked about prior to the class and makes you read what's going to be going on."

"i dont read nearly as mch as i should but if i did, i see how the online assignments are beneficial"

"The online reading assignments are alright. I would honestly prefer to fill out a worksheet or packet for class as homework, but that's just my opinion. The website is really annoying to use because you have to push "ignore warning" every single time you press a button or are advancing to a new page. The website was really hard to understand at first too.... but I guess I have the hang of it now."

"They were not too bad."

"The way our homework is set up is really nice because it makes it simple. Being that most of us are on a pc most of the time anyway, online homework assignments seem like the most logical choice."

"I really like the online assignments. They are relaxed and we get points for completion!"

"They give us a taste of information to come which makes it seem familiar when taught in class"

"I like the online reading assignments because it helps with a preview of the lectures, guarantees you read the book and also gives you easy points while you learn."

"Neutral on them. Im glad they arent graded based on the right answer"

"I like the idea of being able to ask a question at the end; however the better questions that relate to the subject at hand don't ever seem to get an answer. Everyone just giggles at the drunk person who wrote they had too much tequila, seems like a waste of time."

"I answer them without reading the material. Free points."

No comments: