20120621

Education research: post-instruct. feedback on flashcards, reading assignments, homework reports (Cuesta College, Physics 205B, spring semester 2012)

Students taking Physics 205B (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or asking (anonymous) questions or making (anonymous) comments.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards, online reading assignments, and online homework reports (Matthew L. Trawick, The Physics Teacher, vol. 48, no. 2, p. 118) in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II, III and V were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Physics 205B spring semester 2012 section 30882
(N = 27)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture/slideshow presentations by instructor.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 3 : ***
4. Agree 11 : ***********
5. Strongly agree 12 : ************ [4.2 +/- 0.8]

II.2 Doing unassigned flashcard questions.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 7 : *******
4. Agree 8 : ********
5. Strongly agree 11 : *********** [4.0 +/- 1.0]

II.3 Using flashcards to participate in class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 3 : ***
4. Agree 7 : *******
5. Strongly agree 17 : ***************** [4.5 +/- 0.7]

II.4 Reading the textbook.
1. Strongly disagree 2 : **
2. Disagree 9 : *********
3. Neutral 10 : ********** [2.9 +/- 1.1]
4. Agree 3 : ***
5. Strongly agree 3 : ***

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 8 : ********
4. Agree 13 : ************* [3.9 +/- 0.7]
5. Strongly agree 5 : *****

II.6 Interacting with other students during class.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 5 : *****
4. Agree 7 : *******
5. Strongly agree 14 : ************** [4.2 +/- 1.0]

II.7 Instructor follow-up on difficult online homework report problems.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 6 : ******
4. Agree 6 : ******
5. Strongly agree 14 : ************** [4.2 +/- 0.9]

II.8 Online reading assignments.
1. Strongly disagree 3 : ***
2. Disagree 5 : *****
3. Neutral 10 : ********** [3.0 +/- 1.2]
4. Agree 6 : ******
5. Strongly agree 3 : ***

II.9 Online homework reports.
1. Strongly disagree 2 : **
2. Disagree 8 : ********
3. Neutral 8 : ******** [3.0 +/- 1.2]
4. Agree 6 : ******
5. Strongly agree 3 : ***

II.10 Interacting with other students outside of class.
1. Strongly disagree 3 : ***
2. Disagree 4 : ****
3. Neutral 6 : ******
4. Agree 4 : ****
5. Strongly agree 10 : ********** [3.5 +/- 1.5]

II.11 Group problem solving sessions (on whiteboards).
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 6 : ******
4. Agree 7 : *******
5. Strongly agree 14 : ************** [4.3 +/- 0.8]

II.12 Laboratory.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 10 : ********** [3.3 +/- 1.2]
4. Agree 6 : ******
5. Strongly agree 5 : *****

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 2 :
4. Agree 10 : **********
5. Strongly agree 15 : *************** [4.5 +/- 0.7]

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 9 : *********
5. Strongly agree 17 : ***************** [4.6 +/- 0.6]

III.3 I would recommend using flashcards in future semesters of Physics 205B.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 8 : ********
5. Strongly agree 18 : ****************** [4.6 +/- 0.6]

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 15 : *************** [1.6 +/- 2.9]
2. Disagree 9 : *********
3. Neutral 3 : ***
4. Agree 0 :
5. Strongly agree 0 :

III.5 Flashcards were a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 3 : ***
4. Agree 11 : ***********
5. Strongly agree 13 : ************* [4.4 +/- 0.7]

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 10 : **********
2. Disagree 13 : ************* [1.9 +/- 2.0]
3. Neutral 2 : **
4. Agree 2 :
5. Strongly agree 0 :

III.7 Too many flashcard questions were asked.
1. Strongly disagree 10 : **********
2. Disagree 13 : ************* [1.8 +/- 2.0]
3. Neutral 3 : ***
4. Agree 1 : *
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 12 : ************ [1.7 +/- 2.3]
2. Disagree 10 : **********
3. Neutral 5 : *****
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Physics 205B.
"Thank you for leaving an 'I honestly have no clue' on the flashcards, sometimes that was nice."

"Great learning tool! Wish more classes utilized them."

"I really enjoyed using the flashcards in class, especially since the were directly reflective of the material covered on exams."

"They were a great learning experience, highly recommended."

"flashcards helped a lot to find out which questions we needed extra help on."

"Flashcards were a productive, effective way for the entire class to participate in problem solving exercises."

"set up was a bit confusing when trying to email answers. but it wasnt to bad."

"n/a"

"I think they're an efficient and effective way of teaching how to utilize the material, although a few more worked out, on board, examples would be good too, just so I'd have some written out problems in my notes for reference while working on homework."

"I like how we dont have to buy anything to participate and how it is anonymous for everyone. The only thing i dont like sometimes is that while im reading the question and understanding it, the flashcards are asked to be put up and i have to rush it and guess or say unsure. i like having the unsure option though it is really nice and helps."

"I think they are an effective and easy tool for learning and I wish my other classes utilized them."
V. Answer the following statements which may or may not describe 
your beliefs about working on the online reading assignments
in this class.

V.1 Online reading assignments were a positive experience.
1. Strongly disagree 3 : ***
2. Disagree 5 : *****
3. Neutral 8 : ********
4. Agree 9 : ********* [3.1 +/- 1.2]
5. Strongly agree 2 : **

V.2 I like working on the online reading assignments.
1. Strongly disagree 4 : ****
2. Disagree 7 : *******
3. Neutral 10 : ********** [2.8 +/- 1.3]
4. Agree 3 : ***
5. Strongly agree 2 : **

V.3 Too much time outside of class was spent working on online reading
assignments.
1. Strongly disagree 4 : ****
2. Disagree 10 : **********
3. Neutral 9 : ********* [2.5 +/- 1.2]
4. Agree 3 : ***
5. Strongly agree 1 : *

V.4 I will avoid other classes using online reading assignments in future
semesters.
1. Strongly disagree 5 : *****
2. Disagree 10 : ********** [2.5 +/- 1.4]
3. Neutral 8 : ********
4. Agree 2 : **
5. Strongly agree 2 : **

V.5 Online reading assignments helped me understand lectures better.
1. Strongly disagree 3 : ***
2. Disagree 6 : ******
3. Neutral 5 : *****
4. Agree 10 : ********** [3.1 +/- 1.3]
5. Strongly agree 3 : ***

V.6 Too many online reading assignment questions were asked.
1. Strongly disagree 4 : ****
2. Disagree 9 : *********
3. Neutral 12 : ************ [2.4 +/- 1.1]
4. Agree 2 : **
5. Strongly agree 0 :

V.7 I would recommend using online reading assignments in future semesters of
this class.
1. Strongly disagree 3 : ***
2. Disagree 5 : *****
3. Neutral 4 : ****
4. Agree 11 : *********** [3.3 +/- 1.3]
5. Strongly agree 4 : ****

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 5 : *****
2. Disagree 11 : ***********
3. Neutral 5 : ***** [2.4 +/- 1.4]
4. Agree 4 : ****
5. Strongly agree 2 : **

VI. (Optional.) Please type in any comments you may have regarding
the use of online reading assignments in Physics 205B.
The following are all of the student responses to this question, verbatim and unedited.
"Really didnt work well for me at all."

"Online reading assignments are just easy points, but I don't feel like I learn much from them, especially when it is possible to just copy and paste the answer from a google search result, and they don't really get me to open the book."

"The reading assignments online were a great way to prepare for lecture and go in with more background information on the upcoming material."

"Choice of questions are essential, thank you P-Dogg!"

"i found the online reading assignments difficult for the most part. i didn't rely on them to help myself learn the material."

"Online reading assignments forced me to make sure I was familiar with the material before going into the lecture about it, which helped me maximize the effectiveness of the lecture."

"i hardly ever did them, and if i did i would google :("

"n/a"

"I think they're a great way to ensure the proper material was read, and understood, although it'd be cool if they were multiple choice, and would tell us which ones we got wrong and we could go back later and try until we got them right, or something convoluted like that, it'd be a good way to review for tests and the final too."

"i like going over them in class to compare results with the class. it would be nice if there was a chapter and section associated with each question to help me refer to the book while working on them."

"I could never remember to do them!"

"you should make the homework modeled off of mastering chemistry hw. talk to dr. baxley."

"they confused me until i came to lecture"
VII. Answer the following statements which may or may not describe 
your beliefs about working on the online homework reports
in this class.

VII.1 Online homework reports were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 6 : ******
4. Agree 11 : *********** [3.7 +/- 1.1]
5. Strongly agree 6 : *

VII.2 Instructor follow-up on difficult online homework report questions was
valuable.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 3 : ***
4. Agree 6 : ******
5. Strongly agree 18 : ****************** [4.6 +/- 0.7]

VII.3 Online homework reports motivated me to complete (or try to complete)
problems on my own before coming to class.
1. Strongly disagree 3 : ***
2. Disagree 4 : ****
3. Neutral 9 : ********* [3.1 +/- 1.2]
4. Agree 8 : ********
5. Strongly agree 3 : ***

VII.4 Too many online homework report questions were asked.
1. Strongly disagree 2 : ***
2. Disagree 11 : *********** [2.6 +/- 1.0]
3. Neutral 11 : ***********
4. Agree 0 :
5. Strongly agree 2 : **

VII.5 I would recommend using online homework reports in future semesters of
this class.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 5 : *****
4. Agree 7 : *******
5. Strongly agree 10 : ********** [3.7 +/- 1.3]

VIII. (Optional.) Please type in any comments you may have regarding
the use of online homework reports in Physics 205B.
The following are all of the student responses to this question, verbatim and unedited.
"I didnt feel too motivated to the hw"

"didnt like the online homework reports...if it werent for you going over the problems, I would have been just absolutely been lost"

"I wish other classmates were honest in their survey results. I don't know more than a small handful of students that actually do the homework until they study for the midterms. Tangible, collected homework would benefit my learning and help keep me motivated to open the book and do the problems. It would also help me not forget to get the easy points of doing the survey. However, the easy points reward students for getting away with not doing the assignments."

"The homework reports were useful for reviewing tough problems in class and preparing for exams. I wouldn't change a thing Dr. Len! I love how your class is laid out... very organized and no confusion about expectations."

"Choice of questions are essential, thank you P-Dogg!"

"the online homework reports very helpful to learn the material. i used them to study for quizzes and the midterms."

"As somebody who usually becomes bored with homework and reaches the level of 'I get it' way before the assignment is actually over, I really appreciated the homework report format. It allowed me to read over homework problems to see if I understood them, and take what I needed from homework rather than waste 3 hours on something I understand."

"<3"

"n/a"

"The homework reports are perfect, I just wished I'd quit forgetting to do them."

"What does Pdawg do over the summer?"

"should be a graded system on line, not earn 4 points by filling things out. i would have a much greater incentive to finish the homework on time and fully complete homework."

"Survey was very useful and convenient. But, maybe there should be daily reminders; a lot of people forget to do the reading and hwk"

"it wasnt quite motivating enough should of collected some homework, especially circuit analysis!!! :)."
Previous posts:

No comments: