20120305

Education research: preliminary feedback on flashcards and online reading assignments (Cuesta College, Astronomy 210, spring semester 2012)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-pair-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or ask (anonymous) questions or make (anonymous) comments to be shared by the instructor in the following class.

Through the fifth week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards and online reading assignments in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II, III, and V were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 spring semester 2012 sections 30674, 30676
(N = 57)

I. In order to receive credit for completing this survey,
enter your last name, then first name for credit.
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture/slideshow presentations by instructor.
1. Not at all 2 : **
2. Just a little 3 : ***
3. Somewhat 16 : ****************
4. A lot 22 : ********************** [3.7 +/- 1.0]
5. A great deal 13 : *************

II.2 Working in groups on in-class activities.
1. Not at all 1 : *
2. Just a little 3 : ***
3. Somewhat 8 : ********
4. A lot 23 : *********************** [4.1 +/- 0.9]
5. A great deal 22 : **********************

II.3 Using flashcards to participate in class.
1. Not at all 0 :
2. Just a little 3 : ***
3. Somewhat 10 : **********
4. A lot 28 : **************************** [4.0 +/- 0.8]
5. A great deal 16 : ****************

II.4 Reading the textbook.
1. Not at all 2 : **
2. Just a little 15 : ***************
3. Somewhat 27 : *************************** [2.9 +/- 0.9]
4. A lot 11 : ***********
5. A great deal 2 : **

II.5 Interacting with other students during class.
1. Not at all 0 :
2. Just a little 2 : **
3. Somewhat 13 : *************
4. A lot 26 : ************************** [4.0 +/- 0.8]
5. A great deal 16 : ****************

II.6 Interacting with other students outside of class.
1. Not at all 17 : *****************
2. Just a little 14 : **************
3. Somewhat 16 : **************** [2.4 +/- 2.5]
4. A lot 8 : ********
5. A great deal 2 : **

II.7 Online reading assignments.
1. Not at all 2 : **
2. Just a little 12 : ************
3. Somewhat 28 : **************************** [3.1 +/- 0.9]
4. A lot 11 : ***********
5. A great deal 4 : ****

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 10 : **********
4. Agree 32 : ******************************** [3.9 +/- 0.8]
5. Strongly agree 13 : *************

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 2 : **
3. Neutral 7 : *******
4. Agree 37 : ************************************* [3.9 +/- 0.8]
5. Strongly agree 10 : **********

III.3 I would recommend using flashcards in future semesters of this class.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 6 : ******
4. Agree 26 : ************************** [4.1 +/- 0.9]
5. Strongly agree 22 : **********************

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 17 : *****************
2. Disagree 35 : *********************************** [1.9 +/- 2.3]
3. Neutral 4 : ****
4. Agree 1 : *
5. Strongly agree 1 : *

III.5 Flashcards were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 37 : ******************************** [4.0 +/- 0.8]
5. Strongly agree 12 : ************

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 8 : ********
2. Disagree 38 : ************************************** [2.1 +/- 1.3]
3. Neutral 7 : *******
4. Agree 3 : ***
5. Strongly agree 1 : *

III.7 Too many flashcard questions were asked.
1. Strongly disagree 12 : ************
2. Disagree 36 : ************************************ [2.0 +/- 1.7]
3. Neutral 7 : *******
4. Agree 2 : **
5. Strongly agree 1 : *

III.8 Using flashcards was difficult.
1. Strongly disagree 21 : *********************
2. Disagree 21 : ********************* [2.0 +/- 2.8]
3. Neutral 13 : *************
4. Agree 2 : **
5. Strongly agree 1 : *

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Astronomy 210.
The following are all of the student responses to this question, verbatim and edited [as noted] for clarity. Some responses have been bolded for emphasis.
"I enjoy using them."

"I think the flash cards work great to help everyone think for themselves first and then, i wrong, gain understanding."

"I like being able to talk to my neighbor to see why they think their answer is correct.

"i think they help a bit"

"If there are multiple options in the question that have different answers, then please go over the other options so that we can understand the difference the word makes to the answer..."

"Nice way to keep students awake in class. First time i've ever had a teacher use flash cards and it's a good idea!"

"I really like the fact you use flashcards rather than requiring the clickers in the bookstore."

"No problems using flashcards"

"Some questions are hard to understand."

"I think the flashcards are good. They test my knowledge throughout the course and its good that we interact with each other and teach each other the answers."

"Flashcards are used frequently, but only a couple questions are asked at a time."

"im gravy"

"I really like using flashcards in class, it helps me to further understand when we talk our answers over with other students."

"I like it when you have to debate with your group which flashcard answer is correct"

"i wish i had a way of going back and looking at the questions and answers after we have talked them out in class. once we go over it in class it doesnt stick in my brain. i try to write which question it is and why the answer is what it is but then i just fall behind on listening. having a class only once a week, i need to be able to look over exactly what ive learned because i cant remember"

"Give people like 5 seconds to pick an answer, give people like 20 seconds to talk if the answers were not right. i like the flashcards but the pace of the questions seems a lot like 6th grade."

"They help me realize that I don't know things I assume I know in lecture. Makes me feel stupid a lot but helps my grade so I don't complain."

"I like using the flash cards a lot. It gives us a chance to try and answer a question then clear up problems or difficulties we have. Its also very considerate seeings how the clickers cost money and are easy to forget and the batteries can run out. I HATE CLICKERS!!"

"flashin peoples pretty sick.."

"maybe [don't] ask us to hold the flash cards so close to our faces, even though it does hide the answer from the other classmate. I don't know how often my classmate wash their hands. I have gotten two colds this semester... just saying."

"flashcards are a smart way to keep the class engaged without buying special clickers"

"flashcards can let you know my input even if i am shy about answering questions in front of the class."

"This class is my first experience with flash cards. It took some getting used to, but I definitely like it. It makes for a nice change from the typical lecture class where you get talked at for hours with no interaction."

"I like that we use them!"

"While I think flashcards are a good tool, I think they are best utilized for memorization rather than actually LEARNING material. I believe there are better methods that can be used in-class to teach rather than flashcards. However, I can kind of understand why you use the flashcards with a larger than normal class."

"where duh purp?"

"i like that you give the option of 'E' [Unsure/guessing/lost/help!] so we dont have to make like eggs and scramble to come up with something to say"

"I think rather than calling on the right answer every time, it might be embarrassing (oh well), but call on some people occasionally with the wrong answer and ask why the got that answer"

"I find that flash cards clear up confused ideas that I might have."


V. Answer the following statements which may or may not describe 
your beliefs about the use of the online reading assignments in this class.

V.1 I like working on the online reading assignments.
1. Strongly disagree 1 : *
2. Disagree 9 : *********
3. Neutral 24 : ************************ [3.2 +/- 0.8]
4. Agree 21 : *********************
5. Strongly agree 2 : **

V.2 Online reading assignments helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 9 : *********
3. Neutral 19 : *******************
4. Agree 28 : **************************** [3.3 +/- 0.8]
5. Strongly agree 1 : *

V.3 I would recommend using online reading assignments in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 19 : *******************
4. Agree 32 : ******************************** [3.7 +/- 0.7]
5. Strongly agree 5 : *****

V.4 I will avoid other classes using online reading assignments in future semesters.
1. Strongly disagree 7 : *******
2. Disagree 35 : *********************************** [2.2 +/- 1.0]
3. Neutral 16 : ****************
4. Agree 0 :
5. Strongly agree 0 :

V.5 Online reading assignments were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 21 : *********************
4. Agree 31 : ******************************* [3.5 +/- 0.7]
5. Strongly agree 2 : **

V.6 Too much time outside of class was spent working on online reading assignments.
1. Strongly disagree 6 : ******
2. Disagree 39 : *************************************** [2.1 +/- 0.9]
3. Neutral 12 : ************
4. Agree 1 : *
5. Strongly agree 0 :

V.7 Too many online reading assignment questions were asked.
1. Strongly disagree 9 : *********
2. Disagree 36 : ************************************ [2.1 +/- 1.3]
3. Neutral 10 : **********
4. Agree 3 : ***
5. Strongly agree 0 :

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 8 : ********
2. Disagree 28 : **************************** [2.3 +/- 1.3]
3. Neutral 17 : *****************
4. Agree 4 : ****
5. Strongly agree 0 :

VI. (Optional.) Please type in any comments you may have regarding
the online reading assignments in Astronomy 210.
The following are all of the student responses to this question, verbatim and edited [as noted] for clarity. Some responses have been bolded for emphasis.
"NA"

"The only problem I have had with the reading assignments is confusion on when they are open and how to find which one we currently have to complete on the calendar."

"They aren't too bad so far, however i get that they connect with the reading but we never go over most of the stuff you ask from the assignment."

"Hard to unerstand what the answers were exactly felt as if they were to vague"

"Good balance of short answer Q's and multiple choice."

"They're very helpful."

"Thanks for taking the time to post the stuff online."

"I'm still not too sure about the reading assignments. Are we suppose to gather the information from online sources or are the answers suppose to be found in the chapters of our book."

"Keep at it P-dog!"

"I would recommend Dr. Len continue the use of online reading assignments in the future."

"sweet extra cred!!"

"It was annoying having the assignment due at midnight the night before. I would much rather have the assignment be due maybe an hour before the class. I would put more effort into the assignment and it would be more likely for me to remember the assignment before it was due."

"I'm not sure how much the online reading assignments are helping with my studies. I forget what my answers were whenever we review them in class and sometimes they are not relevant to what we were learning that week."

"The online reading assignments makes that class seem so much more organized instead of having to write down the homework and turn it in"

"i dont have much to say about online reading assignments. they are easy points and give me a heads up about what we will learn in class. but i would like to suggest more in depth powerpoints. they go really fast and dont have anything specific for me to write down and look over later to study...i learn best from seeing and writing. and i feel like i have zero notes for this class. just a bunch of scribbling i try to get done before you move onto the next topic. i need some more notes please!"

"I have missed almost every reading assignment. Its like I am an idiot. I like to compartmentalize my classes and stay organized, my ASTR class is at night on Wednesdays and Wednesday mornings are when I would naturally do my homework for that night... That is not working so well for me as I continue to get a closed message. This makes me feel stupid for not remembering every time to do it the night before the night of my class."

"They are very simple and I like how they are graded for completion."

"idk they are kinda hard to answer because the book words their sentences ridiculous and i like how you word things. when you say it, it makes more sense sometimes. hmm i guess you should probably just write a book for ur class cus that shit don't make no sense."

"maybe make the online reading assignments with ques to where in the textbook the information was coming from."

"online reading assignments are almost as cool as p-dog...."

"The technology (surveymonkey) worked really well. I like the way the reading assignments work, and they do help me to understand the material better by focusing my attention. However, I find that they are somewhat lacking in scope (i.e., perhaps 3-4 questions actually geared toward the reading)... but I understand that as a professor, you have to balance getting people to read while not making it so cumbersome that people just ignore the assignment. PS-Thank you for prompt responses, posting of grades, and general attention to detail. It seems as if you put a lot of work into each class, both before, during, and after, and it shows."

"I like that there aren't too many questions and some questions are fun, like the miso soup one. I wish you addressed all the questions we ask at the end though, I want to know the answer to my questions but you only select a few to go over."

"I think the online questions could be used better. I don't understand why there aren't study quizzes online that let us know our score. It seems like a hassle and time sink to do all the flashcard questions, email them to you, then wait for a response about how we did."

"[enter funny comment here]"

"its cool that its graded on compleation, and that they give a little heads up for the upcoming week."

No comments: