20100616

Education research: post-instruction feedback on flashcards and online reading assignments (Cuesta College, Astronomy 210, Spring Semester 2010)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or asking (anonymous) questions or making (anonymous) comments.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards and online reading assignments in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II, III, and V were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Spring Semester 2010 sections 30674, 30676
(N = 93)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 5 : *****
3. Neutral 16 : ****************
4. Agree 47 : *********************************************** [4.0 +/- 0.8]
5. Strongly agree 24 : ************************

II.2 Working in groups on in-class activities.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 6 : ******
4. Agree 52 : **************************************************** [4.2 +/- 0.7]
5. Strongly agree 31 : *******************************

II.3 Using flashcards to participate in class.
1. Strongly disagree 1 : *
2. Disagree 6 : ******
3. Neutral 10 : **********
4. Agree 43 : ******************************************* [4.1 +/- 0.9]
5. Strongly agree 33 : *********************************

II.4 Reading the textbook.
1. Strongly disagree 10 : **********
2. Disagree 9 : *********
3. Neutral 27 : ***************************
4. Agree 32 : ******************************** [3.4 +/- 1.5]
5. Strongly agree 15 : ***************

II.5 Demonstrations/videos in class.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 12 : ************
4. Agree 47 : *********************************************** [4.2 +/- 0.8]
5. Strongly agree 32 : ********************************

II.6 Interacting with other students during class.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 13 : *************
4. Agree 46 : ********************************************** [4.1 +/- 0.8]
5. Strongly agree 30 : ******************************

II.7 Interacting with other students outside of class.
1. Strongly disagree 5 : *****
2. Disagree 19 : *******************
3. Neutral 37 : ************************************* [3.1 +/- 1.1]
4. Agree 21 : *********************
5. Strongly agree 10 : **********

II.8 Online reading assignments.
1. Strongly disagree 3 :
2. Disagree 6 : ******
3. Neutral 29 : *****************************
4. Agree 34 : ********************************** [3.7 +/- 1.0]
5. Strongly agree 20 : ********************

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 6 : ******
3. Neutral 13 : *************
4. Agree 49 : ************************************************* [4.0 +/- 0.8]
5. Strongly agree 25 : *************************

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 5 : *****
3. Neutral 14 : **************
4. Agree 51 : *************************************************** [3.9 +/- 0.8]
5. Strongly agree 22 : **********************

III.3 I would recommend using flashcards in future semesters of this class.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 10 : **********
4. Agree 48 : ************************************************ [4.2 +/- 0.7]
5. Strongly agree 34 : **********************************

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 37 : *************************************
2. Disagree 46 : ********************************************** [1.7 +/- 3.9]
3. Neutral 7 : *******
4. Agree 3 :
5. Strongly agree 0 :

III.5 Flashcards were a positive experience.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 10 : **********
4. Agree 54 : ****************************************************** [4.1 +/- 0.7]
5. Strongly agree 25 : *************************

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 25 : *************************
2. Disagree 42 : ****************************************** [2.1 +/- 2.7]
3. Neutral 19 : *******************
4. Agree 6 : ******
5. Strongly agree 1 : *

III.7 Too many flashcard questions were asked.
1. Strongly disagree 21 : *********************
2. Disagree 52 : **************************************************** [2.1 +/- 1.3]
3. Neutral 13 : *************
4. Agree 7 : *******
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 37 : *************************************
2. Disagree 39 : *************************************** [1.8 +/- 3.9]
3. Neutral 10 : **********
4. Agree 6 : ******
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"it was good to use to see if you understood the concepts that were just learned in class"

"they helped"

"=D"

"Great Idea, forces participation"

"I think that using flash cards was good when we understood the lecture."

"i liked getting to use them because you or a fellow student would explain the subject if i didnt understand it."

"I have no comments, everything in astronomy class was great!"

"Flashcard questions really helped in understanding the material."

"i liked them"

"I don't think the 'i'm lost and dont know how to answer this' should be an option because I think it gives some students a chance to slack off and not think in class."

"i think that the flashcard questions really helped with understanding the material"

"I liked the flashcards for the most part- they were occasionally intimidating if I felt someone was starting at my answer, though"

"Sometimes it was awkward to show my flashcard when I didn't know an answer. I could tell that other students were looking at my answer. But I was happy when I had kind students sitting next to me that explained the correct answer."

"Flashcards work, keep them."

"flashcards are a great way to understand hard concepts but sometimes, the answer needs to be explained a little better before continuing with the lecture"

"Flashcard questions where fun and easy.... if you knew the answer. Alot of times though I would put down G or F so I wouldn't have to give an explanation since you only choose to the correst answers. I suggest next semester, instead of just picking the people with the correct cards ask people there opinion in why they choose what they choose. That way you have an idea if people are on the right track or not."

"Flashcards are great because they show if you understood that day's lecture or not."

"none"

"Keep using the flashcards"

"I like when you explain the answers as opposed to other people in the class."

"Nah."

"i like them. it makes me learn the material. cause if you pick me to tell the class what my answer is and why, i can maybe help someone else who doesnt get it!"

"They're easy to remember for quizzes and tests"

"i had never used them in any other class."

"Flashcards."

"Please keep using the flashcard system. It helps tremendously."

"I really thought that getting to hear another's students explanation was very helpful in understanding some answers or concepts."

"flashcards helped me better understand matierial in depth"

"to much time explaining, just answer with brief explanation"

"just make sure the answer is clear at the end of the question. sometimes you would just say what most people were saying instead of explaining the correct answer and why that answer was correct."

"Very helpful made you not feel so alone"

"The flashcard methods used really helped me understand the concepts in the class."

"The flashcard system was awesome!"

"they helped me understand subjects more clearly which led to greater test and quiz scores."

"i dont like having to explain to the whole class why i chose my answer so i tend to put 'e' if i think im going to have to explain in front of everyone, even if i know im correct. Otherwise i think they are very helpful"

"Sa great idea. Hope they weren't too expensive to make using so much ink!"

"Flashcard questions were awesome because if you didn't know the answer you could just say that, and then learn from other people's answers and the explanation/discussion after. Writing down the flashcard questions really helped me with quizzes and tests."

"I always felt stupid because I wasn't sure of my answer."

"Having to 'Explain your answer to someone near you' seems to be a waste of time that could be spent getting the correct answer explained by the instructor, and then another flash card question could be asked to reinforce what was just explained or address a new topic."

"The flashcards were so gangster they helped me a grip. Thanks for that"

"They're okay."

"I liked the flashcard questions because they were always on the tests/quizzes."

"Please further explain why the answer is right."

"Good stuff."

"I believe the flash card method is a really great way to develop a stable understanding of the material in class. If one is able to discuss and describe a concept to someone else it really does help. Listening to other students views on the material is very helpful too because it gives a person more ways to look at a concept."

"Not a big fan."

"like em!"

"I felt dumb often, unsure of my answer. but it was nice to know in the end what the right answer is."

"Keep using them."

"Like I've said before, flashcards are a wonderful source of learning from not only you but the students around us. Good learning experience option :]"

"Flashcards are a good experience but they may have been used too often."

"i like the colors"

"I like flashcards"

"They were helpful but I don't like saying 'I don't know'"

"final answers were vague at times, or neighbors explaining their answers confused me. a definitive answer at the end of each question would be best"

"I liked flashcards. Would definitely recommend them to other classes."

"there a great learning tool. if any thing i learned from them. they are a great way to make sure i am learning the material."

"they helped at times"

"the flashcards really helped"

"great job with flashcards"

"They broke up the lectures into absorbable chunks. I liked."

"Keep using them, because they work."

"You should keep using flashcards in class. Whenever I was confused about something we were learning in class, the flashcard questions would clarify it for me."

"It's a really helpful tool to use, and I think it would only benefit future Astronomy classes to come."

"Liked them"

"Give out candy"

"flashcards are cool"

"i liked the flashcard questions"

"i like them p-dawg"

"flashcards were pretty cool and a good way to converse with classmates to get the correct answer"

"i believed they were a great aspect to the class. it made me learn faster."

"they work good"

"some of the flashcard questions were a little confusing"

"They helped a great deal in learning the materials because it made you think."

"loved the use of flashcards I think they helped a lot... although most of the time I knew the answer but for the few I didn't know it helped a lot!!!"


V. Answer the following statements which may or may not describe 
your beliefs about the use of the online reading assignments in this class.

V.1 I like working on the online reading assignments.
1. Strongly disagree 1 : *
2. Disagree 8 : ********
3. Neutral 28 : ****************************
4. Agree 40 : **************************************** [3.7 +/- 0.9]
5. Strongly agree 15 : ***************

V.2 Online reading assignments helped me understand lectures better.
1. Strongly disagree 2 : **
2. Disagree 10 : **********
3. Neutral 37 : ************************************* [3.4 +/- 0.9]
4. Agree 34 : **********************************
5. Strongly agree 10 : **********

V.3 I would recommend using online reading assignments in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 19 : *******************
4. Agree 46 : ********************************************** [4.0 +/- 0.8]
5. Strongly agree 25 : *************************

V.4 I will avoid other classes using online reading assignments in future semesters.
1. Strongly disagree 31 : *******************************
2. Disagree 46 : ********************************************** [1.9 +/- 3.3]
3. Neutral 11 : ***********
4. Agree 4 : ****
5. Strongly agree 0 :

V.5 Online reading assignments were a positive experience.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 22 : **********************
4. Agree 45 : ********************************************* [3.9 +/- 0.8]
5. Strongly agree 23 : ***********************

V.6 Too much time outside of class was spent working on online reading assignments.
1. Strongly disagree 36 : ************************************
2. Disagree 40 : **************************************** [1.8 +/- 3.8]
3. Neutral 14 : **************
4. Agree 3 : ***
5. Strongly agree 0 :

V.7 Too many online reading assignment questions were asked.
1. Strongly disagree 29 : *****************************
2. Disagree 48 : ******************************************* [1.9 +/- 3.0]
3. Neutral 14 : **************
4. Agree 2 : **
5. Strongly agree 0 :

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 33 : *********************************
2. Disagree 40 : **************************************** [1.9 +/- 3.5]
3. Neutral 15 : ***************
4. Agree 5 : *****
5. Strongly agree 0 :

VI. (Optional.) Please type in any comments you may have regarding
the online reading assignments in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"the online reading assigments really didnt matter to me they werent hard"

"they too helped"

"The on-line format is easy to follow and allows for personal research of topics which can help to retain the information learned."

"=("

"Great way to see where the class is, I would recommend it to all teachers!"

"I think the readig assigments where great if you did not know a question you could look it up in your book."

"it was a good way for me to be prepared for the lectures the following class"

"Your class was not only very helpful, but fun as well!"

"keep them going"

"i liked the online reading assignments. knowing that it can only help my understanding and grade"

"Online reading assignments were easy points..."

"I like the online reading assignment. I especially like how we get credit even if we don't get the right answer =)"

"The little work required to do these were well worth the extra points."

"They were fun and easy but i dont think i got much education benefit out of them. except when you reffered back to them in lecture."

"reading assignments where a great way to get points!!!Only negative part was doing it. Sometimes I would literally forget to work on them. I know it's not you to blame, we do have five days to get on and spend ten min filling it out, but i did lose a few points becuase of that. So a suggestion for next semester... "

"Write in a calander when to get on and get into the habit of working on it every week."

"I think the questions should be all related to the following class' lecture; but, they're still awsome."

"none"

"Keep doing these as well"

"i think they were beneficial to my grade, and a good way of obtaining easy points."

"Nah"

"i like the fact that we can make a comment or ask a question at the end. also, its funny how we can answer a question and have the answer be wrong, but still get all the points. that is interesting. but thank you for that"

"They helped a little."

"they're good points"

"They were good. Made it so lectures would ring a bell from ORA"

"The online reading assignments were helpful in getting me ready for class. Keep using them."

"I liked that it didn't matter if you got the right or wrong answers and still received points for making the effort to complete the assignment."

"online reading assignments are crucial to success"

"like the extra points"

"they were a good way to get points for the class."

"I like the reading assignments because it helps build up points"

"I never could remember to do them in the beginning!"

"It was hard to remember to do the online reading assignments!"

"I really like the online reading assignments, they are a good preview of what will be happening next class"

"Theyre a banginnn way to get points. and they only take 2 min. super dope"

"Online reading assignments were great because they gave you a lot of points and were easy to do. It helps you to prepare for the lecture also."

"I thought they were a good source for a preview of what was coming up in the next class."

"Words"

"P dizzle these reading assignments straight were hood."

"it would be nice to be able to do the assignment the day of the class"

"The reading assignments implanted thoughts in my head that I would find the answers to during the lectures. They were very beneficial to me."

"I liked that they were easy points, I just didn't get a lot out of them."

"Way better then pen and paper homework! And easy points!"

"Hard to remember to do the before the deadline."

"The online reading assignments were great. There was not a lot of work, but it was very beneficial because they reflected exactly what was brought up at the next lecture. This is the only class that I did not feel overwhelmed by homework. Although, many of the concepts were overwhelming and there was a lot of material that was covered."

"I thought they helped."

"like em!"

"I liked them!"

"None."

"I think not many people put too much effort into them so the statistics didn't turn out very well, but otherwise they were helpful."

"The online reading assignemnts were a positive experience"

"I like that they were a chance to receive extra points."

"theyre funny stuff"

"They were a nice review and helped give some extra points"

"I wish they were always open right after class (doing it on the break this time) because I always try Then And Then forget"

"online reading assignments were awesome, they help you earn points as well as offer review or hints at what is to come in the class"

"I don't think too many people put too much effort into them so answers were always skewed for class results, but they started conversations and points of learning. Overall they were useful and helpful."

"there were helpful in the points and they got me thinking about the next week concepts"

"just have to remember to do them"

"keep doing them"

"i love it"

"They definitely didn't hurt anybody, but a lot of times I didn't put my full effort into it because of either time constraints on my part or because I was too lazy to get the book and look up the answer. Good preview of what was coming in the next lecture though."

"The only thing I would change about online reading assignments is having each question graded for correctness and not just completeness. It's not fair for students who actually try and study the material to get the same grade as the slackers who log on 5 minutes before it's due and put random answers in, just to get it done. Other than that though, the online reading assignments were helpful, and I recommend using them in future classes."

"Liked them"

"Keep it real!"

"online reading assignments are the besttt"

"they were nice"

"they were chill"

"none. the class went smooth and you told us exactly what you expected out of us. thank you"

"they are good way to boost up your point value if you're falling behind in class"

"They gave a little preview of what we were about to talk about, but I dont think it was as good as flash cards."

"my problem was accessing them or even remembering to do them I found myself multiple times forgetting till the last minute. Thanks for allowing us to do make up ones though it really helped!"


Previous post:

No comments: