20101224

Education research: post-instruction feedback on flashcards, reading assignments, homework reports (Cuesta College, Physics 205B, fall semester 2010)

Cuesta College students taking Physics 205B (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA use flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture, and complete weekly online reading assignments (hosted by SurveyMonkey.com), where they answer questions based on reading their textbook, material covered in previous lectures, opinion questions, and/or asking (anonymous) questions or making (anonymous) comments.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards, online reading assignments, and online homework reports (Matthew L. Trawick, The Physics Teacher, vol. 48, no. 2, p. 118) in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II, III and V were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Physics 205B fall semester 2010 section 70856
(N = 11)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 4 : ****
5. Strongly agree 6 : ****** [4.5 +/- 0.7]

II.2 Doing unassigned flashcard questions.
1. Strongly disagree 2 : **
2. Disagree 0 :
3. Neutral 0 :
4. Agree 6 : ****** [3.7 +/- 1.4]
5. Strongly agree 3 : ***

II.3 Using flashcards to participate in class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 0 :
4. Agree 5 : *****
5. Strongly agree 6 : ****** [4.5 +/- 0.5]

II.4 Reading the textbook.
1. Strongly disagree 2 : **
2. Disagree 1 : *
3. Neutral 4 : **** [2.9 +/- 1.2]
4. Agree 4 : ****
5. Strongly agree 0 :

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 1 : *
4. Agree 3 : ***
5. Strongly agree 4 : **** [3.7 +/- 1.2]

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 1 : *
4. Agree 6 : ****** [4.0 +/- 0.9]
5. Strongly agree 3 : ***

II.7 Instructor follow-up on difficult online homework report problems.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 2 : **
5. Strongly agree 8 : ******** [4.6 +/- 0.6]

II.8 Online reading assignments.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 1 : *
4. Agree 6 : ****** [3.5 +/- 1.0]
5. Strongly agree 1 : *

II.9 Online homework reports.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 2 : **
4. Agree 4 : **** [4.0 +/- 1.0]
5. Strongly agree 4 : ****

II.10 Interacting with other students outside of class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 4 : **** [3.5 +/- 1.0]
4. Agree 3 : ***
5. Strongly agree 2 : **

II.11 Group problem solving sessions (on whiteboards).
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 2 : **
4. Agree 4 : **** [3.9 +/- 1.2]
5. Strongly agree 4 : ****

II.12 Group concept mapping (on whiteboards).
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 4 : **** [2.8 +/- 1.2]
4. Agree 0 :
5. Strongly agree 2 : **

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 6 : ****** [4.3 +/- 0.6]
5. Strongly agree 4 : ****

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 0 :
4. Agree 6 : ****** [4.5 +/- 0.5]
5. Strongly agree 5 : *****

III.3 I would recommend using flashcards in future semesters of Physics 205B.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 0 :
4. Agree 6 : ****** [4.5 +/- 0.5]
5. Strongly agree 5 : *****

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 5 : *****
2. Disagree 5 : ***** [1.6 +/- 1.5]
3. Neutral 1 : *
4. Agree 0 :
5. Strongly agree 0 :

III.5 Flashcards were a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 6 : ****** [4.3 +/- 0.6]
5. Strongly agree 4 : ****

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 3 : ***
2. Disagree 5 : ***** [2.0 +/- 1.0]
3. Neutral 3 : ***
4. Agree 0 :
5. Strongly agree 0 :

III.7 Too many flashcard questions were asked.
1. Strongly disagree 4 : ****
2. Disagree 5 : ***** [1.8 +/- 1.3]
3. Neutral 2 : **
4. Agree 0 :
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 7 : ******* [1.5 +/- 2.1]
2. Disagree 3 : ***
3. Neutral 1 : *
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Physics 205B.
"one answer could be, 'I would know the answer, and know how to do it, but I ran out of time.'"

"It helped us apply something that we had just learned instead of having to gruel over it later for homework."

"I think I little bit too much time is given to come up with answers but flashcard questions are helpfull to formulate questions to ask in class. Otherwise I had a hard time remembering what i was confused about on the homework."

"Flash cards helped me study the most for quizzes and tests."

"When doing flashcard questions which have multiple scenarios given by which one you circle, I would have liked to go through all scenarios for each problem that we did. I felt that when we did the questions in class, we would do the easiest scanarios and skip the harder ones."

"I believe there should be more questions in each sections. they were the most helpful thing during this class."

"An answer key to the flashcard questions would be helpful for the quizzes"
V. Answer the following statements which may or may not describe 
your beliefs about working on the online reading assignments
in this class.

V.1 Online reading assignments were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 5 : ***** [3.3 +/- 0.9]
4. Agree 5 : *****
5. Strongly agree 0 :

V.2 I like working on the online reading assignments.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 5 : ***** [2.6 +/- 1.0]
4. Agree 0 :
5. Strongly agree 1 : *

V.3 Too much time outside of class was spent working on online reading assignments.
1. Strongly disagree 1 : *
2. Disagree 5 : ***** [2.5 +/- 0.8]
3. Neutral 4 : ****
4. Agree 1 : *
5. Strongly agree 0 :

V.4 I will avoid other classes using online reading assignments in future semesters.
1. Strongly disagree 2 : **
2. Disagree 6 : ****** [2.2 +/- 0.9]
3. Neutral 2 : **
4. Agree 1 : *
5. Strongly agree 0 :

V.5 Online reading assignments helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 2 : **
4. Agree 5 : ***** [3.6 +/- 1.0]
5. Strongly agree 2 : **

V.6 Too many online reading assignment questions were asked.
1. Strongly disagree 1 : *
2. Disagree 5 : ***** [2.6 +/- 1.0]
3. Neutral 2 : **
4. Agree 3 : ***
5. Strongly agree 0 :

V.7 I would recommend using online reading assignments in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 3 : ***
4. Agree 5 : ***** [3.6 +/- 0.9]
5. Strongly agree 1 : *

V.8 Completing the online reading assignments was difficult.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 6 : ****** [2.6 +/- 0.8]
4. Agree 1 : *
5. Strongly agree 0 :

VI. (Optional.) Please type in any comments you may have regarding
the use of online home assignments in Physics 205B.
The following are all of the student responses to this question, verbatim and unedited.
"a list of what to skip and what to read in a chapter"

"The actually reading assignments themselves were very easy. The hard part was remembering to do them."

"They weren't too hard, but also not that helpfull."

"A lot of the time the reading was too confusing without having lecture first."

"I found that online reading assignments were not very helpful. We would go over things in the reading assignments that werent even covered in lecture. I felt it easier to not read the book and just go off the information taught during class. Also online reading assignments were always different in regards to whether they were on the material we aready covered or what came next so I never knew what to read before doing the assigments. Also I think if you are to continue to do the reading assignments, if it looks as though the class was confused on a specific question, go over that answer right away instead of saying 'we will get to that in lecture' because I could never tell if the question was answered in lecture or not or if you continue to talk about the answers in lecture make sure to address that that was the answer to this specific reading question."

"Being ahead of the class is always helpful."
VII. Answer the following statements which may or may not describe 
your beliefs about working on the online homework reports
in this class.

VII.1 Online homework reports were a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 2 : **
4. Agree 5 : ***** [3.9 +/- 0.9]
5. Strongly agree 3 : ***

VII.2 Instructor follow-up on difficult online homework report questions was valuable.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 0 :
4. Agree 3 : ***
5. Strongly agree 8 : ******** [4.7 +/- 0.4]

VII.3 Online homework reports motivated me to complete (or try to complete) problems on my own before coming to class.
1. Strongly disagree 1 : *
2. Disagree 3 : *** [3.4 +/- 1.4]
3. Neutral 1 : *
4. Agree 3 : ***
5. Strongly agree 3 : ***

VII.4 Too many online homework report questions were asked.
1. Strongly disagree 1 : *
2. Disagree 6 : ****** [2.5 +/- 0.9]
3. Neutral 2 : **
4. Agree 2 : **
5. Strongly agree 0 :

VII.5 I would recommend using online homework reports in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 1 : *
4. Agree 2 : **
5. Strongly agree 6 : ****** [4.1 +/- 1.2]

VIII. (Optional.) Please type in any comments you may have regarding
the use of online home assignments in Physics 205B.
The following are all of the student responses to this question, verbatim and unedited.
"better thank clickers?"

"Its easy to forget to do your homework when the means to do it is on the computer ."

"The idea is a good one, but there is no accountability if you don't do the assignment."

"Sometimes the homework problems were helpful but we didn't really have enough class time to go over the problems. Maybe try making time for an example before the homework so that there are less questions after the online assignment???"

"hw is good practice"

"Some questions I had difficulties on were often not on the homework report. it would be helpful to ask if there were any problems not on the report that we may have needed help on."

"I liked the whole method of the class, and how the instructor kept track of every student's steps."

"Solving difficult problems and flash card questions was the best."

"It was harder to motivate myself rather than if we had to turn the homework in but it was nice..."

"I liked it overall"


Previous post:

No comments: