20090926

Education research: preliminary feedback on flashcards and online reading assignments (Cuesta College, Astronomy 210, Fall Semester 2009)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or asking (anonymous) questions or making (anonymous) comments.

Through the fifth week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards and online reading assignments in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Fall Semester 2009 sections 70158, 70160
(N = 59)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 1 : *
2. Disagree 6 : ******
3. Neutral 11 : ***********
4. Agree 29 : ***************************** [3.9 +/- 0.9]
5. Strongly agree 12 :************

II.2 Working in groups on in-class activities.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 10 : **********
4. Agree 25 : ************************* [4.1 +/- 0.9]
5. Strongly agree 22 : **********************

II.3 Using flashcards to participate in class.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 7 : *******
4. Agree 31 : ******************************* [4.0 +/- 0.9]
5. Strongly agree 16 : ****************

II.4 Reading the textbook.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 14 : **************
4. Agree 33 : ********************************* [3.7 +/- 0.8]
5. Strongly agree 6 : ******

II.5 Demonstrations/videos in class.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 7 : *******
4. Agree 24 : ************************ [4.1 +/- 1.0]
5. Strongly agree 23 : ***********************

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 7 : *******
4. Agree 30 : ****************************** [4.1 +/- 0.8]
5. Strongly agree 19 : *******************

II.7 Interacting with other students outside of class.
1. Strongly disagree 4 : ****
2. Disagree 11 : ***********
3. Neutral 23 : *********************** [3.1 +/- 1.1]
4. Agree 19 : *******************
5. Strongly agree 2 : **

II.8 Online reading assignments.
1. Strongly disagree 2 : **
2. Disagree 11 : ***********
3. Neutral 21 : ********************* [3.3 +/- 1.0]
4. Agree 20 : ********************
5. Strongly agree 5 : *****

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 : 0
2. Disagree 3 : ***
3. Neutral 17 : *****************
4. Agree 27 : *************************** [3.8 +/- 0.8]
5. Strongly agree 12 : ************

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 8 : ********
3. Neutral 11 : ***********
4. Agree 28 : **************************** [3.7 +/- 0.9]
5. Strongly agree 12 : ************

III.3 I would recommend using flashcards in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 13 : *************
4. Agree 24 : ************************ [3.9 +/- 0.9]
5. Strongly agree 18 : ******************

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 20 : ********************
2. Disagree 27 : *************************** [1.9 +/- 2.7]
3. Neutral 9 : *********
4. Agree 2 :
5. Strongly agree 1 :

III.5 Flashcards were a positive experience.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 9 : *********
4. Agree 34 : ********************************** [4.0 +/- 0.8]
5. Strongly agree 13 : *************

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 11 : ***********
2. Disagree 32 : ******************************** [2.2 +/- 1.6]
3. Neutral 10 : **********
4. Agree 6 : ******
5. Strongly agree 0 :

III.7 Too many flashcard questions were asked.
1. Strongly disagree 13 : *************
2. Disagree 30 : ****************************** [2.1 +/- 1.8]
3. Neutral 11 : ***********
4. Agree 5 : *****
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 27 : *************************** [1.8 +/- 3.5]
2. Disagree 21 : *********************
3. Neutral 9 : *********
4. Agree 2 : **
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"Its something different because I have never done that in any of my college courses, but its cool because changes like that could be good and useful! I really don't mind them at all, its actually kind of fun to see what people answers are and why!"

"have they every proved to be effective?"

"Flashcards are a great way to get students to feel confident about their understanding of concepts. Also, when a student is wrong or thought they knew a concept and they didn't, they can converse with the people around them to come up with the right answer."

"You never fully explain the answer, therfore I'm always a little lost and confused and so are the people next to me."

"i feel nothing gets explained well enough and then we jump to flashcards and the majority of the class is confused and nothing sinks in."

"Its a good way to review a little bit every day on the material"

"They help!"

"Good Idea, keeps class on their toes."

"I think the use of flashcards is a good thing. We are able to see how well we know the material and hopefully learn it if we don't. The one think I don't like is when we get the question wrong the 2nd time and the answer isn't given. It only happened a few times so its not that big of a deal."

"you don't always give the right answer, so sometimes i get confused on what the answer really is and if i got it or not."

"The flash cards really helped because if the instructor was not satisfied with the amount of correct answers he would make us discuss and explain to each other why we thought the answer we chose was the right one to another person. By doing this we start a small debate group until we come up with a conclusion."

"There is often no way to tell what is right before we hold up the cards"

"they are very helpful when explained."

"I like the use of flashcards because you can see where you are compared to everyone else in the class and any misunderstandings on the questions are cleared up when using them."

"i really enjoy using flashcards in class. it gives me an oppertunity to know what is on the test, know what to study, and helps me better understand the material we have gone over in a new way so that i am fully confident that i know the material."

"They are alright I think that sometimes the professor should help us answer them when we are lost not just rely on other class mates."

"Its a unique idea that i've never experianced before, thank you so much for introducing it to me."

"Talking about our flashcard answers with other students is helpful."

"Flashcards has helped because after you can discuss with others the right answer"

"Flashcards are a good way to give the instructor feedback as well as a way to discuss with fellow students."

"Flashcards rock"

"I like the flashcard questions, but sometimes I feel like I still don't know the answer after the question has been finished. It would help me if the instructor would spend a minute or two discussing what the correct answer is and why, instead of relying on peer education. More often than not, the people around me either don't know the answer or don't care about the activity and so my learning opportunity is decreased."

"This is a cool learning style in the class"

"When a lot of the class aren't agreeing with each-other then i think you should explain it better until we all get it, or when most of us have the answer still explain why that is the answer.
"hella like them"

"I would like to see flashcard adventures. Take a story and have the classes answers progress that story. (I am stranded in the desert with nothing but my starwheel. I need to get to shelter that I know is supposed to be east. What constellation should I go towards if it is 1 am when I start my perilous trek?) That kind of thing. Put some spice into it!"

"I feel that flashcards help the students understand the concepts."

"Flashcards help in class because if a person doesn't know what the answer is they can at least try to get it and when they get the answer correct or not the correct answer will always be provided by the P-dog"

"Flashcards are awesome. They really helped me understand what was going on."

"they really help prep for quizzes"

"I like them. Thought I think deeper explanations of the questions would be good after the class has answered it"

"I think that when no one knows the answer more help should be given then it currently is."

"they are fun"

"Flashcards are alright, they are a little pointless if you have no idea going into answering the question. But they are kind of fun. I've heard of an electrical flashcard system/quiz system that works pretty well."


V. Answer the following statements which may or may not describe 
your beliefs about the use of the online reading assignments in this class.

V.1 I like working on the online reading assignments.
1. Strongly disagree 0 :
2. Disagree 9 : *********
3. Neutral 15 : ***************
4. Agree 24 : ************************ [3.6 +/- 0.9]
5. Strongly agree 10 : **********

V.2 Online reading assignments helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 13 : *************
3. Neutral 14 : **************
4. Agree 24 : ************************ [3.4 +/- 1.0]
5. Strongly agree 7 : *******

V.3 I would recommend using online reading assignments in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 8 : ********
3. Neutral 14 : **************
4. Agree 26 : ************************** [3.7 +/- 0.9]
5. Strongly agree 11 : ***********

V.4 I will avoid other classes using online reading assignments in future semesters.
1. Strongly disagree 15 : ***************
2. Disagree 33 : ********************************* [2.0 +/- 2.1]
3. Neutral 8 : ********
4. Agree 2 : **
5. Strongly agree 1 : *

V.5 Online reading assignments were a positive experience.
1. Strongly disagree 0 :
2. Disagree 6 : ******
3. Neutral 20 : ********************
4. Agree 24 : ************************ [3.6 +/- 0.9]
5. Strongly agree 9 : *********

V.6 Too much time outside of class was spent working on online reading assignments.
1. Strongly disagree 13 : *************
2. Disagree 34 : ********************************** [2.1 +/- 1.8]
3. Neutral 8 : ********
4. Agree 4 : ****
5. Strongly agree 0 :

V.7 Too many online reading assignment questions were asked.
1. Strongly disagree 13 : *************
2. Disagree 36 : ************************** [2.0 +/- 1.8]
3. Neutral 7 : *******
4. Agree 3 : ***
5. Strongly agree 0 :

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 19 : *******************
2. Disagree 29 : ***************************** [2.0 +/- 2.6]
3. Neutral 4 : ****
4. Agree 7 : *******
5. Strongly agree 0 :

VI. (Optional.) Please type in any comments you may have regarding
the online reading assignments in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"I really enjoy doing them and the surveys too they're easy points. You cant go wrong with taking a few mins to do them and earning the points for it wether your right or wrong ! They do help understand the material better and it motives you to read on it if you're not sure of a question! =)"

"do the assignments prove to be helpful?"

"I just think that more time should be spent going over the actual book itself in class."

"they dont really help me"

"Helpful with regards to tracking how the student feels as the semester progresses."

"I actually enjoy them!"

"The online reading assignments were very helpful because they help understand the reading you do."

"Online reading assignments rarely help me out with the course material."

"theyare helpful and stmuloate ones brain in preparation for future lectures."

"I like the online reading assignments because they're easy :D"

"the online reading assignments are short and very helpful in preparing me what to expcept for our next class."

"I think that the online reading assignment should close before next class not midnight the night before because class is at 11 so students should be able to access it till that point."

"It helps direct me on what i should be getting out of the reading."

"I learn better by reading books and using paper...not the computer."

"The online reading assignments are kinda rough"

"Good length of reading for online assignments"

"Online reading assignments are chilllin"

"The only thing I dislike about the online reading assignments is that they are not discussed much in class. Since students are basically guessing at the answers, they do not get the full benefit of the activity. I think it would be better to assign the questions after the lecture, instead of before, as a review activity. It doesn't make sense to me to have homework on a subject before the subject is covered in lecture."

"good"

"I forgot we had online obligations at the start, so forgot to do the online assignments, which sucked to then lose points for it, but having us do more assignments than is needed will hopefully make up for it in the end."

"i enjoy them."

"they are ok"

"Nothing I can think of."

"They are fine and not a hassle to do"

"The online reading assignments were ok. I like them because it is different than the normal homework. Its good to spice things up."

"sometimes getting the online reading assignments done in time was a difficult thing... especially when my internet likes to go crazy on me!!!!"

"they're legit. kinda silly. easy points so i'm happy"

"I like online activities."

"YAY ASTRONOMY"

"They are okay, again, it helps reading the book before doing them. It's almost to easy to sign in and answer a bunch real quick without much thought.... But this is also nice at the same time..."

No comments: