Showing posts with label clickers. Show all posts
Showing posts with label clickers. Show all posts

20091018

Education research: preliminary feedback on clickers (Chemistry 210FL, Cuesta College, Fall Semester 2009)

Cuesta College students taking Chemistry 210FL (introductory chemistry) at Cuesta College, San Luis Obispo, CA use clickers (Classroom Performance System, einstruction.com) during lecture.

Through the fifth and sixth weeks of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Chemistry 210FL Fall Semester 2009 sections 72122, 72234, 70302, 70306, 71813, 72093
(N = 32)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 3 : ***
4. Agree 8 : ********
5. Strongly agree 20 : ******************** [4.5 +/- 0.8]

II.2 Working in groups on FAL (Facilitated Assisted Learning) activities.
1. Strongly disagree 1 : *
2. Disagree 6 : ******
3. Neutral 3 : ***
4. Agree 8 : ********
5. Strongly agree 14 : ******************* [3.9 +/- 1.2]

II.3 Using clickers to participate in class.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 11 : *********** [3.7 +/- 1.0]
4. Agree 9 : *********
5. Strongly agree 8 : ********

II.4 Reading the textbook.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 5 : *****
4. Agree 13 : ************* [4.2 +/- 0.8]
5. Strongly agree 13 : *************

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 10 : ********** [3.9 +/- 0.9]
4. Agree 10 : **********
5. Strongly agree 10 : **********

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 4 : ****
4. Agree 15 : *************** [4.2 +/- 0.8]
5. Strongly agree 12 : ************

II.7 Interacting with other students outside of class.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 9 : *********
4. Agree 10 : ********** [3.7 +/- 1.1]
5. Strongly agree 9 : *********

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 15 : *************** [3.5 +/- 0.8]
4. Agree 11 : ***********
5. Strongly agree 4 : ****

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 1 : *
2. Disagree 9 : *********
3. Neutral 9 : *********
4. Agree 11 : *********** [3.1 +/- 1.0]
5. Strongly agree 2 : **

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 14 : ************** [3.5 +/- 0.7]
4. Agree 13 : *************
5. Strongly agree 3 : ***

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 7 : ************
2. Disagree 13 : ****************** [2.2 +/- 1.5]
3. Neutral 11 : ***********
4. Agree 0 :
5. Strongly agree 1 : *

III.5 Clickers were a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 13 : *************
4. Agree 15 : *************** [3.6 +/- 0.7]
5. Strongly agree 3 : ***

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 5 : *****
2. Disagree 15 : *************** [2.4 +/- 1.1]
3. Neutral 8 : ********
4. Agree 3 : ***
5. Strongly agree 1 : *

III.7 Too many clicker questions were asked.
1. Strongly disagree 5 : *****
2. Disagree 17 : ************ [2.3 +/- 1.2]
3. Neutral 7 : *******
4. Agree 2 : **
5. Strongly agree 1 : *

III.8 Using clickers was difficult.
1. Strongly disagree 13 : *************
2. Disagree 15 : *************** [1.8 +/- 2.4]
3. Neutral 2 : **
4. Agree 0 :
5. Strongly agree 2 : **

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Chemistry 210FL.
The following are all of the student responses to this question, verbatim and unedited.
"The clickers were quite nice once they were working. I wish there wer a little bit more clicker questions on lecture examples."

"They are easy to use."

"I think that the clickers are a great idea and can be useful in class discussions. Although in the way that we are using them, simply to turn in answers without understanding the results or review the questions, they are not as beneficial as they could be."

"If we used the clickers as a statistical viewpoint only and spent more time reviewing the questions that were asked of us, then the clickers would become more helpful in an education way, opposed to the point/credit purpose they serve now."

"I believe that clickers are just another way to get money out of us. They can be useful, but you must buy the clicker and register it. It is too much money. We could have different kinds of quizzes and other kinds of participation in class."

"I could take them or leave them."

"I think having jump start questions were a good idea, since it made you read the next chapter and I also felt that it helped during lecture to have a 'heads up' on what we were going to cover next."

"I think now that we seem to have the clickers all working, that the program is very useful and is a creative way of learning."

"I think FALs should be an optional study groups. It is bad enough that we don't get the complete credit time for time spent in class(s). But on top of it, an extra hour is required to force us to work together. The idea of an FAL is great. but it would be much better to have Chemlab like Mathlab, leave it optional. People will work together anyway with friends they make in class during clicker quiz's or in lab. Demo videos are cool but with a lab they are not really needed. its cooler to see it for real in a lab then to see it in a video. I see a lot of interest is directed in the use of clickers. Clickers are fine. The way in which you chose to use them is good and time effective, you don't over use them. and the amount of class time consumed is about 10 minutes per week. so 7% of the in class lecture time is used to help you determine what is least understood. granted people will work together to get answers so the 100% correct may not mean 100% understood. but a low % would grantee confusion. I know there is debate over the effectiveness of clickers. I support them, they are not expensive and they help the teacher keep in touch with their classes progress between tests. 'Clickers helped me understand lectures better.' I agree with this because it adds to exposure and interactivity in the subject. I is like when your having a hour long conversation with someone and after while you kinda zone out. ahuh ahuh ahuh, you know. so this makes you think and apply what your doing. it breaks up the lecture a bit and makes the class more interesting. That said. I believe reading the textbook, being lectured and asking questions is adequate to learn the subject. Your a great teacher, and [the lab instructor] is a great lab instructor. both of you add alot of color and enjoyment to the subject. I feel fortunate to have a positive first exposure to learning the subject. I read a book in the past called Feynman's Rainbow. It was a terrible book by a terrible failed chemist, failed physicist and it turned me off to chemistry. But it turns out that chemistry is no so bad after all."

"I do like the option of working with other students for clicker quizes in clas"

"I have no questions, currently."

"This class is well balanced in time spent on lecture, demonstrations, using the clicker, and answering questions from students. I had a previous class that used the clicker and I felt that it hindered my ability. However, [the instructor] does an excellent job using the clickers in constructive ways that help the students and also allow her know if the students are understanding the concepts. The clickers are definitely an asset to this class."

"I am often at a neutral position with clickers because you can just as easily quiz students without them. This change in form would help the students with money because of the cost of not only the clicker but to sign up in the class as well. However it is much easier to link the clickers rather than print out 40 copies of a test, that is why I find myself at a neutral position."

"I find the clicker to be a nice tool and great time saver for instructors when grading and record student data, but it's just another material cost to have to afford when I am seem to be struggling already to pay for the textbook, FAL packet as well as chemistry lab booklet."

"I think the clicker quizzes are fun and challenging way to get the students to pre-read the course material."

"I do not mind the clickers what so ever, my only thing is i found it very expensive. This is the only class i have ever taken that has required the clicker an it was i thought i process. Buying it was thirty dollars, then another fifteen to register the thing. I find using the small ten point scantrons is easier. I can understand that the clicker is faster an better for the instructor, but also expensive for the students."

"The only comment I have is that the clickers would be more desirable if they were in the classroom ready to check out each time we use them. Carrying them around and buying them is the only inconvenience. Otherwise I like using them."

20090912

Education research: preliminary feedback on flashcards (Cuesta College, Physics 205A, Fall Semester 2009)

Cuesta College students taking Physics 205A (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA use numerical keypad clickers (Classroom Performance System, einstruction.com) to enter homework and to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

However, during the first two to three weeks of instruction, students are first coached through the "think-(pair)-share" process using flashcards instead of clickers. At the end of the third week of the semester, students were given the opportunity to evaluate the instructional components of the course, and the use of flashcards in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Physics 205A Fall Semester 2009 sections 70854, 70855, 72177
(N = 30)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 12 : ************ [3.7 +/- 1.1]
5. Strongly agree 7 : *******

II.2 Doing unassigned textbook problems/clicker questions/practice quizzes.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 6 : ******
4. Agree 14 : ************** [4.1 +/- 0.7]
5. Strongly agree 9 : *********

II.3 Using flashcards to participate in class.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 4 : ****
4. Agree 16 : **************** [3.7 +/- 1.1]
5. Strongly agree 6 : ******

II.4 Reading the textbook.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 10 : **********
4. Agree 13 : ************* [3.8 +/- 0.8]
5. Strongly agree 5 : *****

II.5 Demonstrations/videos in class.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 10 : **********
4. Agree 13 : ************* [3.6 +/- 0.9]
5. Strongly agree 4 : ****

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 2 : **
4. Agree 15 : *************** [4.2 +/- 0.8]
5. Strongly agree 11 : ***********

II.7 Interacting with other students outside of class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 16 : **************** [3.5 +/- 0.7]
4. Agree 9 : *********
5. Strongly agree 3 : ***

III. Answer the following statements which may or may not describe
your beliefs about the use of flashcards in this class.

III.1 I like using flashcards.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 17 : ***************** [3.8 +/- 0.8]
5. Strongly agree 5 : *****

III.2 Flashcards helped me understand lectures better.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 16 : **************** [3.6 +/- 1.1]
5. Strongly agree 4 : ****

III.3 I would recommend using flashcards in future semesters of Physics 205A.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 5 : *****
4. Agree 17 : ***************** [3.9 +/- 0.9]
5. Strongly agree 6 : *******

III.4 I will avoid other classes using flashcards in future semesters.
1. Strongly disagree 11 : ***********
2. Disagree 12 : ************ [1.9 +/- 2.1]
3. Neutral 6 : ******
4. Agree 0 :
5. Strongly agree 1 : *

III.5 Flashcards were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 3 : ***
4. Agree 20 : ******************** [3.9 +/- 0.8]
5. Strongly agree 5 :*****

III.6 Too much time in class was spent using flashcards.
1. Strongly disagree 2 : **
2. Disagree 14 : ************** [2.7 +/- 1.2]
3. Neutral 8 : ********
4. Agree 2 : **
5. Strongly agree 4 : ****

III.7 Too many flashcard questions were asked.
1. Strongly disagree 4 : ****
2. Disagree 17 : ***************** [2.3 +/- 1.0]
3. Neutral 6 : ******
4. Agree 3 : ***
5. Strongly agree 0 :

III.8 Using flashcards was difficult.
1. Strongly disagree 16 : **************** [1.5 +/- 2.9]
2. Disagree 14 : **************
3. Neutral 0 :
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of flashcards in Physics 205A.
The following are all of the student responses to this question, verbatim and unedited.
"I Think The Flashcard System Is A Perfect Way To Get Introduced To And Move On To The Clickers."

"I liked the use of flash cards, besause they gave the instructor a good idea of where the class stood in understanding the material. as far the cards helping me understand the material that we were covering in class, well the flash cards weren't bad, but i would have liked the instructor to do more examples and demonstrations, not to mention explanations on the board."

"I thought using flash cards was very helpful. I think I need to spend more time doing the book problems and getting the anwsers to the clicker questions. Now I know what to look for through the class link."

"The flashcards are a great idea for interactive learning, however they did not influence the amount of content learned."

"The use of flashcards is helpful and good to use as a reenforcement of the lecture. However i think i personally need more lecture and explanations and problems thoroughly worked out and less flashcards rather than the majority of class being flashcards."

"Flashcards make me feel smart because i usually get the answers right. So, it makes class more rewarding for me"

"I've never had a class where the teacher lectured with clicker questions and flashcards. Maybe it will take me awhile to get used to it. I do feel as though I learn the most when I am doing the clicker questions and studying the textbook. I learn more when I study alone. I apologize for being harsh."

"Overall I understand why a teacher would use flashcards/clickers. It encourages students to listen, stay awake, talk to other students, ask questions from other students, etc., which is all positive. I personally can only learn when I see the problem completely worked out and would love to see more problems worked out on the board step by step. Even showing basic steps... This is how I process the best, but overall I enjoy the flashcards/clickers."

"flashcards and discussion with students is helpful, yet difficult for the shy"

"I think using flashcards is a great idea because it helps you to see if the class really understands a concept."

"I think that they are a great way to get everyone involved in the lecture"

"The flashcards seem to be the focus of this class, I was hoping for more lecture and explanation of the material we should be learning, during class time. A vast majority of my learning so far has been from reading the text. This is just a very different style of learning and teaching and I am going to do my best to adjust. I realize that most of the students seem to be more advanced in their math and this is where I need to freshen up."

"Overall I really like concept of flashcards and clickers to allow the teacher to get a general idea that the class is following the lecture and understands the material. However, I dislike using them so frequently, and would appreciate more actual lecture; you have to reach all types of learners."

"The flashcard use in this class, I believe, is very good. It kicks participation up 100%. In a standard lecture, maybe a few people are called on, but using flashcards gets everyone involved."

"The use of flashcards were fine so long as they don't distract from the overall lesson of the class session."

20090710

Education research: post- feedback on think-(pair)-share attitudes (Astronomy 210, Cuesta College, Spring Semester 2009)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA used flashcards to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last month of instruction, after taking their second and last midterm, students were given the opportunity to evaluate the use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question.

Cuesta College
Astronomy 210 Spring Semester 2009 sections 30674, 30676
(N = 46)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that clickers are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not describe
your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 5 : *****
4. Agree 18 : ****************** [4.2 +/- 0.9]
5. Strongly agree 18 : ******************

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 12 : ************
3. Neutral 16 : **************** [3.2 +/- 0.9]
4. Agree 11 : ***********
5. Strongly agree 4 : ****

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 15 : ***************
3. Neutral 17 : ***************** [3.0 +/- 0.9]
4. Agree 7 : *******
5. Strongly agree 4 : ****

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share clicker use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"I think this is a great learning tool. If I explain my answer and help another student understand why, it deepens my own understanding of the concept. Sometimes I have the answer wrong, and appreciate it when another student can explain why their answer is correct. It also encourages us to be prepared for the class."

"I would feel better if and when the class does poorly on a clicker question that the instructor explain it instead of other students. When other students tend to explain their answer they are convincing others, most of the time, of the wrong answer."

"I think it is a good concept, but in many cases the information has not been fully comprehended by the students, hence if the material isn't understood by the majority of the class, a lot of wrong answers are reciprocating around."

"I like the use of clickers but I think after we think and share with each other that it should still be reexplained if we have not answered it correctly at that time. I also think that we should not do clicker questions until we learn the material otherwise we are just getting and wasting time."

"i think it would actually be helpful to have more clicker questions. i generally tend to remember those answers much better for tests and quizzes."

"For me, think-pair-share only confuses me. If i am uncertain of an answer, id rather have the teacher explain then someone who kinda understands. Usually this only makes me more confused. Most of the time i feel like myself and other students pick an answer just to pick it, not because we understand it. I would rather have the teacher explain confusing answers than my classmates."

"Redoin the clicker questions when the majority of the class is wrong doesn't allow me to understand the material. It shows that the class doesn't understand the material but doesn't clarify why the don't understand it."

"I'm alright with it."

"I really like think-pair-share because sometimes an explanation comes better from another student rather than the book, or some other scientific source."

"I like this class"

"This is the first course I have taken that uses the clickers and I must say that I really enjoy them. It helps me stay on task and remain engaged in the lecture. I also like that I get credit for it, easy points are always a good thing. :)"

"I thought midterm two was easier to comprehend than midterm one."

"I strongly believe that grouping people together by force in a class is extremely unfair. I go to school for myself, I pay for it myself, and I learn for myself. Therefore my grade should be reflected by my individual effort and not by an assigned group. Clickers are fine but being forced to work with others is not OK."

"Love the clickers but would rather get instruction from the instructor rather than ask an equally clueless classmate."

"I love think-pair-share! Forces me to actually consider the question instead of dozing off into space."

"I think it would be nicer if we had more clicker questions and more time to review the answers for a better understanding of the topic."

"the clicker questions make the class more interesting and for a 2.5-3 hour long class it makes a difference. As for the mid-term I was NOT prepared for the multiple choice questions which is my fault, but I feel that my short answer questions where solid and well answered. my favorite question was the one asking to explain how viewing the stars is like looking into the past."

"Think-pair-share clicker use is very beneficial to my greater understanding of the topics in class. I wish all my classes could incorporate clickers. Thank you Dr. Len for choosing to use the think-pair-share clickers."

"Additional help is definitely helpful because I struggle with the material. It's hard because we go relatively fast, & I'm still struggling to make the inferences necessary to do well in the class. The only thing keeping me afloat is your blog...not because they tell me the answer (don't get me wrong-it helps) but because there's a plain explanation for the answer that helps me tremendously."

"I feel that it would be more helpful if P-dog explained the material, rather than leaving us to figure it out. Frequently, most people don't understand the material, and spend the time given to make un-educated guesses..."

Previous posts:
Education research: pre- and post- feedback on think-(pair)-share attitudes (Physics 205A, Cuesta College, Fall Semester 2008)

Education research: post- feedback on think-(pair)-share attitudes (Astronomy 210, Cuesta College, Fall Semester 2008)

Education research: post- feedback on think-(pair)-share attitudes (Physics 205A, Cuesta College, Spring Semester 2009)

20090709

Education research: post- feedback on think-pair-share attitudes (Physics 205A, Cuesta College, Spring Semester 2009)

Cuesta College students taking Physics 205A (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last month of instruction, after taking their second and last midterm, students were given the opportunity to evaluate the use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question.

Cuesta College
Physics 205A Spring Semester 2009 sections 30880, 30881
(N = 34)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that clickers are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not describe
your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 3 : ***
4. Agree 14 : ************** [4.3 +/- 0.8]
5. Strongly agree 15 : ***************

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 15 : *************** [3.4 +/- 0.9]
4. Agree 9 : **********
5. Strongly agree 4 : ****

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 11 : ***********
3. Neutral 14 : ************** [2.7 +/- 0.6]
4. Agree 3 : ***
5. Strongly agree 0 :

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share clicker use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"i love useing the clickers in class. i like trying to defend my answer when we talk with other class mates."

"I think that the Think-Pair-Share system works great because you get to answer the questions during class to the best of your knowledge and then get to see if you are correct. The answers are most of the time explained so it is not just for fun, you actually learn from not only the instructor but your peers as well. This is the first time I have used it and I think it works well."

"I think this is a great way for the students to interact during class. It also helps students sort through problems that their having trouble with."

"I think that the clickers are a great way to participate in class and good tool for talking out concepts with other students."

"Clicker did not help me learn much. I wish you lectured more than you asked clicker questions. Mr. Len, this class has been hard for me because, I needed more explanations in class. Because I didn't understand the material in class, I felt like I been teaching Physics to myself. I also felt like the clicker questions were reaching out only for those who have Physics background but, not for those who are taking it for the first time. This been the hardest semester for me. For the future I recommend that you lecture more (do more example problems) and ask less clicker questions. People who are taking Physics for the first time are feeling lost because, they (I) feel like they (I) have to see problems worked out on the board instead of guessing for the right answer. With respect,
__________"

"i think thats a really good idea"

"I think that the think-pair-share clicker use is very helpful in this class."

"The material can be very difficult so its nice to receive easy participation points while thinking through problems without feeling like if you don't get them right you will lose points."

"I like using the clickers in class. Hardest thing for me is to get these concepts right away. Being my first Physics course it usually takes me reading through the material a few times to really understand the concepts so I feel sometimes I do not get a lot out of the clicker questions until someone explains things to me (and sometimes even then I don't get it). Overall I like using the clickers, it ensures that you listen and focus in class and keeps us involved so we don't get bored."

"Good Stuff"

"Since I am a returning student after 5 years out of school, I have an interesting perspective. I never experienced this type of learning the first time I was here at Cuesta. I feel the clickers and the think-pair-share concept are exceptional learning 'tools' and give them both two thumbs up!!!"

"The Mid term was not that bad, the last question was hard. but you warned us. All in all totally fair."

Previous posts:
Education research: pre- and post- feedback on think-(pair)-share attitudes (Physics 205A, Cuesta College, Fall Semester 2008)

Education research: post- feedback on think-(pair)-share attitudes (Astronomy 210, Cuesta College, Fall Semester 2008)

20090708

Education research: post- feedback on think-(pair)-share attitudes (Astronomy 210, Cuesta College, Fall Semester 2008)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last month of instruction, after taking their second and last midterm, students were given the opportunity to evaluate the use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question.

Cuesta College
Astronomy 210 Fall Semester 2008 sections 70158, 70160
(N = 41)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that clickers are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not
describe your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 9 : *********
4. Agree 18 : ****************** [4.1 +/- 0.7]
5. Strongly agree 13 : *************

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 13 : *************
3. Neutral 20 : ******************** [2.9 +/- 0.8]
4. Agree 7 : *******
5. Strongly agree 1 : *

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 11 : ***********
3. Neutral 16 : **************** [3.1 +/- 0.9]
4. Agree 7 : *******
5. Strongly agree 3 : ***

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share clicker use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"It's frustrating to have to sit and 'discuss' in think-pair-share when everyone around you has no idea what the answer is. If it is obvious that a class is confused by a wide range of answers on a question, then I think it goes without saying we have no idea what the answer is and we're guessing. I definitly felt that on this midterm I did fairly well on the multiple choice questions, but when it came to the last two essay questions I was completly lost. I have only missed one class this entire semester, I do the reading, I study for the tests and the quizzes I honestly feel that some things are not covered well in class to a point where I can fully comprehend the concepts. The clicker questions help a lot, in fact if we didn't do a clicker question about a subject I probably know less about that subject than if we had done one. This tool should be used for everything that is placed on tests, but I do not like having to 'discuss' with my peers. Discussing with classmates is a great idea, if you have students who actually understand the question and have a solid reason for their answer and are willing to explain it to other students. But if everybody has different answers or it seems like many people are guessing dicussion becomes a waste of time in class, that is when the teacher needs to step-it-up, explain the concept again, maybe from a different angle, then do another clicker question to see if there is any improvement."

"Monster energy drinks highly contribute to my efficiency in class."

"Probably one of the best methods of learning I've encountered."

"I find that the people I ask say they guessed the answer or they have no idea, so a lot of the time I feel like I'm not learning anything."

"it is a good way to test the students to see how they are doing."

"teacher should explain answers better."

"I think it is helpfull, however I think the majoraty of the class usually guesses the "correct" answer so when we think-pair-share, nobody really knows what to say-- except for a select few. Everyone agrees to disagree sort of speak."

"I think it would be better if you would explain the answer to us when all of the answers are different"

"Its a good way to become involved rather than just taking notes the whole time."

"I like the concept of think-pair-share, i just wish that sometimes we could go over the answers in more detail, so we could comprehend and grasp. When we do do that i feel like it sticks more, which obviously becomes beneficial for us. Other than that, it's all good."

"Using the clickers is Quack-tastic!!!!"

"it is a-maz-za-zing"

"Think-pair-share is nice, because it encourages students to think to choose an answer. Because of think-pair-share, I can understand more about the subject usually, not just know or remember the answer. Overalll, Think-pair-share is a great system."

"I can appreciate the think-pair-share system of learning, but after the 2nd discussion I would suggest an explanation from the teacher to help those who don't fully comprehend."

"I like it, but most people don't get out of their seats. You should make everyone get up and move not be ok with them sitting their."

"the last two questions [on Midterm 2] were tough. not ridiculous, but just tough."

"I like think, pair, and share because it gives us (as a class) the opportunity to "think out loud", and to teach our thoughts to one another."

"I think its a great system and it can help a lot to talk to a peer as opposed to listening to the same person talk for 3 hours. It's a nice change."

"I like having the clicker questions but sometimes I feel that we are focused on just choosing the right answer rather than thoroughly understanding the concepts."

"Think-pair share clicker use in this class is very effective. Usually my class mates are able to inform me of a different way to look at the question. Most of the time i change my answer after the think-pair share time."

"I think it's interesting to hear why other people put a different answer than I did. It has given me a lot of help when I was confused. In general, it's cool to talk about the questions with other people around me, but not so cool when they are just as confused as I am!"

"I think the think pair share clickers are a very creative way for students to get involved and have fun in their class, while learning as well."

"One of me answers [on Midterm 2] with teh stars are switched ....ah"

Previous post:
Education research: pre- and post- feedback on think-(pair)-share attitudes (Physics 205A, Cuesta College, Fall Semester 2008)

20090707

Education research: pre- and post- feedback on think-(pair)-share attitudes (Physics 205A, Cuesta College, Fall Semester 2008)

Cuesta College students taking Physics 205A (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the second month of instruction, after taking their first (of two) midterms, students were given the opportunity to evaluate the preliminary use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question.

Cuesta College
Physics 205A Fall Semester 2008 sections 70854, 70855
(N = 23)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that clickers are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not describe
your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 5 : *****
4. Agree 6 : ****** [3.7 +/- 1.1]
5. Strongly agree 6 : ******

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 7 : ******* [3.3 +/- 1.1]
3. Neutral 6 : ******
4. Agree 5 : *****
5. Strongly agree 4 : ****

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 9 : ********* [2.9 +/- 0.8]
3. Neutral 7 : *******
4. Agree 6 : ******
5. Strongly agree 0 :

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share clicker use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"I think that it is a good method however I feel that key concepts are not always explained fully due to some of my classmates not understanding the material, myself included. This makes class time sometimes feel pointless and confusing."

"I dont like think-pair-share that much"

"fun"

"It can be helpful, but it takes up class time that may be better used going over more sample problems. Other student's explanations will oftentimes not be as helpful or correct as the teacher's."

"I think that sometimes we just end up spreading wrong ideas amongst ourselves when what we really need is a stronger lecture component so we have something more solid to base our responses on rather than pretty much a couple people who actually know what they are talking about try and convince the rest of the class which is usually lost anyways."

"Sometimes Think-pair-share questions are too hard where such a small percentage of the class knows that it is pointless to ask someone around you bc chances are they didnt know. I like clicker questions but sometimes they just need to be explained to the class esp. on difficult questions."

"I was a skeptic but don't find it as bothersome as I thought. My only concern is that we sometimes waste valuable lecture time having two or three confused people trying to convince the others.... There is no equal distribution of "smart" people within the seating arrangement...therefore there is no guarantee of the effeectiveness of share and pair and I suspect the satisfaction with this teaching method varies widely for this reason."

"I still don't feel I get much out of this method, it'd be one thing to discuss this with the instructor but discussing with other students is flawed because another student could be completely wrong in their reasoning and cause more confusion than create clarity. As far as the test goes I didn't feel like I had enough time to even think about the problems on it much less complete them."

"I like the use of the clicker, but I am not very much for the pair and share part. But that is because I like to do things on my own."

"At first I was more opposed to the clickers, but now I feel that they aren't so bad. It took some getting used to, but it makes the lectures more interactive."



During the last month of instruction, after taking their second and last midterm, students were given the opportunity to evaluate the use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

Note that the attitudes towards think-pair-share for questions II.1 and II.2 improved over the course of this semester. (In subsequent semesters during the 2008-2009 academic year, this assessment was only asked after the second and last midterm, so this is the only set of pre- and post-test results for think-pair-share attitudes.)

Cuesta College
Physics 205A Fall Semester 2008 sections 70854, 70855
(N = 25)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that clickers are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not describe
your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 1 : *
4. Agree 9 : *********
5. Strongly agree 10 : ********** [4.1 +/- 1.0]

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 7 : *******
3. Neutral 9 : ********* [3.0 +/- 0.9]
4. Agree 6 : ******
5. Strongly agree 1 : *

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 14 : ************** [2.5 +/- 0.8]
3. Neutral 4 : ****
4. Agree 4 : ****
5. Strongly agree 0 :

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share clicker use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"I believe some of the questions on the midterm where a little bit obscure and came out of the dark which surprised a lot of students. Several of the short answer question where not like we had practiced or gone over in class."

"I do not think that the think-pair-share method helps at all. When the students don't understand the first time asked, then the professor should explain the topic better so everyone does understand. Most everyone just looks at which answer was most popular and chooses that one, then the professor likes the results and movees on oblivious that nobody learned a single thing.

"We haven't really been using think pair share that much recently. I like it better when p-dog just teaches us the material rather than us trying to teach each other."

"I really enjoy using the clickers. The fact that you are answering anonymously prevents people from being singled out if they have the wrong answer. Being able to discuss answers with other students if it is not clear has been very helpful."

"I think it is a great tool. One of the best ways to learn is teach and discuss it with other students, so this helps a lot. Could be done a little more often though. One downside might be that some students might not use this time to their advantage, and not pay attention, and just go with the answer with the most votes, but that's their fault."

"they are good"

"I enjoy being able to use clickers to get credit for attendence and HW. But pairing and sharing with my neighbor is seldom helpful. More often than not we are both uncertain about the answer and neigher one of us is able to strongly convince or influence the other. Time spent in lecture is more valuable. Just my opinion."

"I now remember my reasoning on the blood pressure question, but a lot of good that does me now. Your midterms are very fair, and well put together, with all the information you want to cover. Thanks."

20090531

Education research: SATA results (Cuesta College, Spring Semester 2009)

Student attitudes were assessed using the Survey of Attitudes Towards Astronomy (SATA), a 34-question, five-point Likert scale questionnaire that measures four attitude subscales (Zeilik & Morris, 2003):
  • Affect (positive student attitudes towards astronomy and science);
  • Cognitive competence (students' self-assessment of their astronomy/science knowledge and skills);
  • Difficulty (reverse-coded such that high-difficulty corresponds to a rating of 1, low-difficulty assessment of astronomy/science corresponds to a rating of 5);
  • Value (students' assessment of the usefulness, relevance, and worth of astronomy/science in personal and professional life).
The SATA was administered as a pre-test on the first day of class, and as a post-test on the last day of class.
Cuesta College
Astronomy 210 Spring Semester 2009 section 30676
(San Luis Obispo Campus)
(N = 50, matched pairs only)
Affect Cogn. Comp. Difficulty Value
Initial 3.6 +/- 0.6 3.6 +/- 0.5 3.7 +/- 0.5 2.6 +/- 0.5
Final 3.7 +/- 0.7 3.6 +/- 0.7 3.7 +/- 0.5 2.9 +/- 0.6

Cuesta College
Astronomy 210 Spring Semester 2009 section 30674
(North County Campus)
(N = 30, matched pairs only)
Affect Cogn. Comp. Difficulty Value
Initial 3.8 +/- 0.5 3.8 +/- 0.4 3.8 +/- 0.5 2.8 +/- 0.5
Final 3.7 +/- 0.7 3.6 +/- 0.6 3.6 +/- 0.5 2.8 +/- 0.6

Cuesta College
Astronomy 210 Spring Semester 2009 section 30677
(San Luis Obispo Campus, 9-week accelerated section)
(N = 18, matched pairs only)
Affect Cogn. Comp. Difficulty Value
Initial 3.4 +/- 0.7 3.5 +/- 0.6 3.8 +/- 0.5 2.5 +/- 0.4
Final 3.9 +/- 0.5 3.7 +/- 0.6 3.8 +/- 0.6 3.1 +/- 0.6
Apparently no or small (statistically significant?) differences between the pre-test and post-test results for each section.

References, and more detailed discussion on previous semesters' results:
Education research: SATA results (Cuesta College, Fall Semester 2007).

Education research: SATA results (Cuesta College, Spring Semester 2008).

Education research: SATA results (Cuesta College, Fall Semester 2008).

20090530

Education research: SATA results (Cuesta College, Fall Semester 2008)

Student attitudes were assessed using the Survey of Attitudes Towards Astronomy (SATA), a 34-question, five-point Likert scale questionnaire that measures four attitude subscales (Zeilik & Morris, 2003):
  • Affect (positive student attitudes towards astronomy and science);
  • Cognitive competence (students' self-assessment of their astronomy/science knowledge and skills);
  • Difficulty (reverse-coded such that high-difficulty corresponds to a rating of 1, low-difficulty assessment of astronomy/science corresponds to a rating of 5);
  • Value (students' assessment of the usefulness, relevance, and worth of astronomy/science in personal and professional life).
The SATA was administered as a pre-test on the first day of class, and as a post-test on the last day of class.
Cuesta College
Astronomy 210 Fall Semester 2008 section 70158
(San Luis Obispo Campus)
(N = 61, matched pairs only)
Affect Cogn. Comp. Difficulty Value
Initial 3.7 +/- 0.6 3.6 +/- 0.6 3.8 +/- 0.5 2.6 +/- 0.4
Final 3.7 +/- 0.7 3.5 +/- 0.8 3.7 +/- 0.6 2.7 +/- 0.6

Cuesta College
Astronomy 210 Fall Semester 2008 section 70160
(North County Campus)
(N = 26, matched pairs only)
Affect Cogn. Comp. Difficulty Value
Initial 3.8 +/- 0.7 3.7 +/- 0.5 3.8 +/- 0.6 2.6 +/- 0.6
Final 3.9 +/- 0.7 3.7 +/- 0.7 3.7 +/- 0.5 2.8 +/- 0.6
Apparently no or small (statistically significant?) differences between the pre-test and post-test results for each section.

References, and more detailed discussion on previous semesters' results:
Education research: SATA results (Cuesta College, Fall Semester 2007).

Education research: SATA results (Cuesta College, Spring Semester 2008).

20090529

Education research: SPCI gains (Cuesta College, Spring Semester 2009)

The Star Properties Concept Inventory (SPCI, developed by Janelle Bailey, University of Nevada-Las Vegas) was administered to Astronomy 210 (one-semester introductory astronomy) students at Cuesta College, San Luis Obispo, CA during the last week of instruction, at both the main San Luis Obispo campus and the North County campus at Paso Robles.
     Cuesta College    Cuesta College
Astronomy 210 Astronomy 210
SLO campus NC campus
Spring Semester Spring Semester
2009 2009
N 56 students* 29 students*
low 5 7
mean 11.0 +/- 3.1 11.7 +/- 2.9
high 18 16
*Excludes students with negative informed consent forms (*.pdf), the use of which is discussed in a previous post.

A "Student" t-test of the null hypothesis results in p = 0.33, thus there is no significant difference between post-test scores at these two Cuesta College campuses. Similarly, the t-test of pre-test scores from both campuses was p = 0.28, which was not significant.

The averages for each section of the initial and final SPCI scores (given as percentages, with standard deviations), as well as the Hake normalized gain <g> are given below:
Astronomy 210 Spring Semester 2009 section 30676 (SLO campus)
<initial%> = 30% +/- 14% (N = 64)
<final%> = 48% +/- 13% (N = 56)
<g> = 0.24 +/- 0.18 (51 matched-pairs); 0.25 (class-wise)

Astronomy 210 Spring Semester 2009 section 30674 (NC campus)
<initial%> = 28% +/- 13% (N = 41)
<final%> = 51% +/- 13% (N = 29)
<g> = 0.34 +/- 0.19 (28 matched-pairs); 0.32 (class-wise)
For the NC campus, this Hake gain is greater than previous gains for introductory astronomy classes, as discussed in previous posts on this blog. However, the "Student" t-test of the null hypothesis results in p = 0.41, thus there is no significant difference between matched-pair gains at these two Cuesta College campuses.

Notable about Astronomy 210 classes at Cuesta College from Fall 2008 semester onwards is not just the mere implementation of electronic response system "clickers" (Classroom Performance System, einstruction.com), but the use of known best practices of using clickers (i.e., "think-(pair)-share"), from current education research. More analysis on the impact of using clickers on this introductory astronomy class will be forthcoming on this blog.

For earlier results at Cuesta College and further discussion of the SPCI, see previous posts:
Education research: SPCI gains (Cuesta College, Spring Semester 2006-Spring Semester 2007).
Education research: SPCI gains (Cuesta College, Summer Session 2007).
Education research: SPCI gains (Cuesta College, Fall Semester 2007).
Education research: SPCI gains (Cuesta College, Spring Semester 2008).
Education research: SPCI gains (Cuesta College, Fall Semester 2008).

20090528

Education research: end-of-semester feedback on clickers (Astronomy 210, Cuesta College, Spring Semester 2009)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Spring Semester 2009 sections 30674, 30676
(N = 50)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 7 : *******
4. Agree 24 : ************************ [3.9 +/- 1.0]
5. Strongly agree 14 : **************

II.2 Working in groups on in-class activities.
1. Strongly disagree 3 : ***
2. Disagree 3 : ***
3. Neutral 7 : *******
4. Agree 18 : ******************
5. Strongly agree 19 : ******************* [3.9 +/- 1.2]

II.3 Using clickers to participate in class.
1. Strongly disagree 2 : **
2. Disagree 1 : *
3. Neutral 4 : ****
4. Agree 20 : ********************
5. Strongly agree 23 : *********************** [4.2 +/- 1.0]

II.4 Reading the textbook.
1. Strongly disagree 4 : ****
2. Disagree 9 : *********
3. Neutral 15 : *************** [3.3 +/- 1.3]
4. Agree 14 : **************
5. Strongly agree 8 : ********

II.5 Demonstrations/videos in class.
1. Strongly disagree 2 : *
2. Disagree 4 : ****
3. Neutral 9 : *********
4. Agree 17 : *****************
5. Strongly agree 18 : ****************** [3.9 +/- 1.1]

II.6 Interacting with other students during class.
1. Strongly disagree 2 : **
2. Disagree 1 : *
3. Neutral 7 : *******
4. Agree 22 : ********************** [4.1 +/- 1.0]
5. Strongly agree 18 : ******************

II.7 Interacting with other students outside of class.
1. Strongly disagree 3 : ***
2. Disagree 9 : *********
3. Neutral 21 : ********************* [3.1 +/- 1.0]
4. Agree 14 : *******************
5. Strongly agree 3 : ***

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 5 : *****
4. Agree 22 : ********************** [4.3 +/- 0.8]
5. Strongly agree 22 : **********************

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 5 : *****
3. Neutral 6 : ******
4. Agree 23 : *********************** [4.0 +/- 0.9]
5. Strongly agree 16 : ****************

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 3 : ***
4. Agree 26 : ************************** [4.2 +/- 0.8]
5. Strongly agree 19 : *******************

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 23 : ***********************
2. Disagree 25 : ************************* [1.6 +/- 3.2]
3. Neutral 2 : **
4. Agree 0 :
5. Strongly agree 0 :

III.5 Clickers were a positive experience.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 5 : *****
4. Agree 20 : ********************
5. Strongly agree 23 : *********************** [4.3 +/- 0.8]

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 14 : **************
2. Disagree 28 : **************************** [2.0 +/- 2.1]
3. Neutral 5 : *****
4. Agree 2 : **
5. Strongly agree 1 : *

III.7 Too many clicker questions were asked.
1. Strongly disagree 18 : ******************
2. Disagree 23 : *********************** [1.9 +/- 2.6]
3. Neutral 7 : *******
4. Agree 2 : **
5. Strongly agree 0 :

III.8 Using clickers was difficult.
1. Strongly disagree 35 : *********************************** [1.3 +/- 4.9
2. Disagree 13 : *************
3. Neutral 2 : **
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"I left my car clicker in my car and it got all friggin melted. Clickers should be made out of some type of super strong metal that doesn't melt. It still works it just looks all dumb.
It pretty much helped me understand better n study for quizes"

"I think clickers help students pay attention to the lectures, knowing they will have to respond to questions. I print out the clicker questions prior to the lecture and consult them while I read the text. I try to answer as many as I can before the lecture. Sometimes I change the answers once I hear more information and gain more understanding from the lectures. The clicker questions, along with the lab sheets are great study tools for exams."

"In the future I think explaining the answer would be helpfuly when the majority of the class gets it wrong the first try."

"Clickers were fun! Many students got a real kick out of it, but they have to be involved with other students and class participation. I feel as though many find the material extremely difficult, but discussing the magnitude of each clicker questions makes them very interesting by opinion, as well as allows the students to gain a TRUE understanding of the subjects studied."

"I think the clickers were fine to use in class during lecture to help get the concepts across, but I did find it very difficult to answer clicker questions before we had even learned about let alone discussed the topic(s) that we were being asked about."

"I felt like clickers could have actually been used a little bit more to go over the material more thoroughly."

"Clickers were a great experience really. I just had a hard time with the quizes because it seemed we got ahead of things in our lecture compared to what we were testing on."

"WOOOOOOOOOOOOOO!"

"i think more clicker use would be good. i also think that better study guides for tests and quizzes would help. It was kind of hard to know what to study in this class."

"I think Clickers would be more effective if we spent review days only doing clicker questions. I think that during some lectures, we spend too much time doing clickers and in class activities."

"LOVED THIS CLASS!!!"

"Class was fun"

"I like clickers and P-dawG!"

"It's comforting to see that other people are confused too."

"I had a fun experience in Astronomy. I went into it thinking it wouldn't interest me, but by the end of the semester i enjoyed learning about it. Pdogg is the man, one of the best teachers ive had throughout my college experience."

"luved the class"

"Clickers are nice, but being taught the material prior to being asked the ?s is imperative."

"it really helped show if the class was understanding the material."

"Helped me have a good stance on knowing what I needed to improve on!"

"Using clickers was so beneficial to the learning experience provided by Dr. Len. Classes that do not use clickers are just short-changing the students education. The clickers are click-tastic!"

"Good learning device! it helps out when we discuss the questions afterwards!! great class"
Previous post:
Education research: preliminary feedback on clickers (Astronomy 210, Cuesta College, Spring Semester 2009)
Discussion of preliminary Astronomy 210 student opinions from this semester.

20090527

Education research: end-of-semester feedback on clickers (Cuesta College, Physics 205A, Fall Semester 2008)

Cuesta College students taking Physics 205A (college physics, algebra-based, mandatory adjunct laboratory) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Physics 205A Spring Semester 2009 sections 30880, 30881
(N = 41)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 2 : **
4. Agree 21 : ********************* [4.3 +/- 0.7]
5. Strongly agree 17 : *****************

II.2 Doing assigned homework, to be entered using clickers.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 9 : *********
4. Agree 15 : ***************
5. Strongly agree 17 : ***************** [4.2 +/- 0.8]

II.3 Doing practice homework.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 8 : ********
4. Agree 18 : ****************** [3.8 +/- 1.1]
5. Strongly agree 10 : **********

II.4 Using clickers to participate in class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 4 : ****
4. Agree 21 : ********************* [4.3 +/- 0.6]
5. Strongly agree 16 : ****************

II.5 Reading the textbook.
1. Strongly disagree 4 : ****
2. Disagree 8 : ********
3. Neutral 13 : ************* [3.1 +/- 1.3]
4. Agree 11 : ***********
5. Strongly agree 4 : ****

II.6 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 25 : ************************* [4.0 +/- 0.7]
5. Strongly agree 8 : ********

II.7 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 6 : ******
4. Agree 16 : **************** [4.2 +/- 0.8]
5. Strongly agree 16 : ****************

II.8 Interacting with other students outside of class.
1. Strongly disagree 3 : ***
2. Disagree 1 : *
3. Neutral 13 : *************
4. Agree 17 : ***************** [3.6 +/- 1.1]
5. Strongly agree 6 : ******

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 6 : ******
4. Agree 18 : ****************** [4.2 +/- 0.8]
5. Strongly agree 16 : ****************

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 10 : **********
4. Agree 21 : ********************* [4.0 +/- 0.7]
5. Strongly agree 10 : **********

III.3 I would recommend using clickers in future semesters of Physics 205A.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 3 : ***
4. Agree 21 : ********************* [4.3 +/- 0.6]
5. Strongly agree 17 : *****************

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 21 : ********************* [1.6 +/- 3.3]
2. Disagree 17 : *****************
3. Neutral 2 : **
4. Agree 1 : *
5. Strongly agree 0 :

III.5 Clickers were a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 1 : *
4. Agree 24 : ******************* [4.3 +/- 0.6]
5. Strongly agree 15 : ***************

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 8 : ********
2. Disagree 22 : ********************** [2.1 +/- 1.4]
3. Neutral 9 : *********
4. Agree 2 : **
5. Strongly agree 0 :

III.7 Too many clicker questions were asked.
1. Strongly disagree 15 : ***************
2. Disagree 17 : ***************** [1.9 +/- 2.4]
3. Neutral 8 : ********
4. Agree 1 : *
5. Strongly agree 0 :

III.8 Clickers should be used to collect assigned homework.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 8 : ********
4. Agree 20 : ******************** [4.0 +/- 0.9]
5. Strongly agree 11 : ***********

III.9 Using clickers was difficult.
1. Strongly disagree 22 : ********************** [1.6 +/- 3.4]
2. Disagree 17 : *****************
3. Neutral 0 :
4. Agree 2 : **
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Physics 205A.
The following are all of the student responses to this question, verbatim and unedited.
"Overall clickers were a positive experience."

"Interaction with clickers, especially 'think (pair) share,' helped tremendously when I didn't understand a certain idea."

"i love using the clickers, they make beeing in class that much more fun."

"Clickers were good."

"Not about the clickers. I just wanted to say it's been a pleasure having you as a teacher and I hope you have a great summer."

"I think you should keep using them, they really helped me understand the material"

"The use of the clickers helped a lot in the lecture because I could get instant feedback on the questions, and then it would be explained right away. Also, I think that a large portion of why the clicker use is successful is the wording of the clicker questions. It seems as though they were well thought out to address the common mistakes that people will make, and I think that throwing a few 'trick' questions in there to illustrate what not to do is just as valuable as the regular questions."
Previous post:
Education research: preliminary feedback on clickers (Cuesta College, Physics 205A, Spring Semester 2009)
Discussion of preliminary Physics 205A student opinions from this semester.

20090311

Education research: Rudolph Presentation "A National Study on the Effect of Interactive Learning in the Astro 101 Classroom"

Dr. Alexander L. Ruldolph (Associate Professor of Physics, Physics Department, California State Polytechnic University, Pomona) presents findings on peer instruction and lecture tutorials in introductory astronomy classes ("A National Study on the Effect of Interactive Learning in the Astro 101 Classroom") on February 26, 2009 at California Polytechnic State University, San Luis Obispo, CA. Photos by Cuesta College Physical Sciences division instructor Dr. Patrick M. Len.

090226-1080305
http://www.flickr.com/photos/waiferx/3320075216/
Originally uploaded by Waifer X

Radio frequency iClicker electronic response units.


090226-1080308
http://www.flickr.com/photos/waiferx/3320077038/
Originally uploaded by Waifer X

Dr. John Keller (California Polytechnic State University, San Luis Obispo) introduces Dr. Rudolph.


090226-1080313
http://www.flickr.com/photos/waiferx/3320078438/
Originally uploaded by Waifer X

Dr. Rudolph summarizes how instructors can get involved with implementing and evaluating interactive learning techniques in introductory astronomy courses.


090226-1080320
http://www.flickr.com/photos/waiferx/3319254389/
Originally uploaded by Waifer X

Dr. Rudolph answers questions from the audience at the end of the presentation, facilitated by Dr. Keller.

20090306

Education research: preliminary feedback on clickers (Chemistry 210FL, Cuesta College, Spring Semester 2009)

Cuesta College students taking Chemistry 210FL (introductory chemistry) at Cuesta College, San Luis Obispo, CA use clickers (Classroom Performance System, einstruction.com) during lecture.

Through the fifth and sixth weeks of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Chemistry 210FL Spring Semester 2009 sections 30729, 30730, 30731
(N = 39)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 5 : *****
4. Agree 17 : ***************** [4.2 +/- 0.8]
5. Strongly agree 15 : ***************

II.2 Working in groups on FAL (Facilitated Assisted Learning) activities.
1. Strongly disagree 2 : **
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 7 : *******
5. Strongly agree 22 : ********************** [4.2 +/- 1.2]

II.3 Using clickers to participate in class.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 9 : *********
4. Agree 17 : ***************** [3.7 +/- 1.1]
5. Strongly agree 8 : ********

II.4 Reading the textbook.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 6 : ******
4. Agree 25 : ************************* [3.7 +/- 0.8]
5. Strongly agree 4 : ****

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 16 : **************** [3.7 +/- 0.8]
4. Agree 15 : ***************
5. Strongly agree 7 : *******

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 11 : ***********
4. Agree 12 : ************
5. Strongly agree 15 : *************** [4.1 +/- 0.9]

II.7 Interacting with other students outside of class.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 10 : **********
4. Agree 14 : ************** [3.9 +/- 1.0]
5. Strongly agree 13 : *************

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 14 : ************** [3.5 +/- 1.1]
4. Agree 13 : *************
5. Strongly agree 7 : *******

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 3 : ***
2. Disagree 6 : ******
3. Neutral 18 : ****************** [3.1 +/- 1.1]
4. Agree 8 : ********
5. Strongly agree 4 : ****

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 3 : ***
2. Disagree 2 : **
3. Neutral 13 : *************
4. Agree 16 : **************** [3.5 +/- 1.1]
5. Strongly agree 5 : *****

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 12 : ************
2. Disagree 14 : ************** [2.2 +/- 2.2]
3. Neutral 8 : ********
4. Agree 2 : **
5. Strongly agree 2 : **

III.5 Clickers were a positive experience.
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 14 : **************
4. Agree 15 : *************** [3.5 +/- 1.0]
5. Strongly agree 5 : *****

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 7 : *******
2. Disagree 22 : ********************** [2.2 +/- 1.4]
3. Neutral 6 : ******
4. Agree 2 : **
5. Strongly agree 2 : **

III.7 Too many clicker questions were asked.
1. Strongly disagree 9 : *********
2. Disagree 20 : ******************** [2.2 +/- 1.7]
3. Neutral 7 : *******
4. Agree 1 : *
5. Strongly agree 2 : **

III.8 Using clickers was difficult.
1. Strongly disagree 16 : ****************
2. Disagree 17 : ***************** [1.7 +/- 2.6]
3. Neutral 6 : ******
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Chemistry 210FL.
The following are all of the student responses to this question, verbatim and unedited.
"I feel that the interactive learning among other students has been the most helpful. The lectures in class have been very clear and helpful in learning the concepts."

"I like using them, it is a quick way to get feedback on how I am doing on that particular subject. I think they are helpful to me in this class."

"I like that we get immediate results with the clickers.

"they are a neat idea, but scantrons are more cost effective. The cost of the clicker and registering it probably could have bought all the scantrons needed for the two years at Cuesta, and then some."

"Clickers are too expensive, we don't get nearly enough use out of them, not resell-worthy! I do believe: Clickers should be used as an alternative to paper and/or other supplies but in our class I have noticed that there is still a high rate of paper waste -- we used the printed answer sheet with A,B,C,D to answer in class questions, Also our most recent test had an unnecessary cover sheet, and the teacher uses paper instead of the projector to write pages and pages of notes every class. On top of all that, we had to buy over $200.00 worth of other supplies for this class. If the entire school promoted the use of clickers, i think they would be a great alternative learning method and the school would save money. If we are going to use clickers then we should be dedicated to using them, and incorporating them into as many things possible."

"Clickers are pretty helpful and I like that we get to work together with classmates. It really helps me fully comprehend how to do problems."

"The clickers were a very good way of quizzing to see what we know, but without the tense feeling of taking a test. I think there should be more clicker questions asked throughout the lecture, if time permits."

"Would be much more simple to just pay your membership fee when you buy your clicker, with your books. Not everyone has a credit card to pay for it online. Plus, it feels like your getting nickle and dimed. Money for ICH, money for labs, money for text, money for clicker, then money to pay for a membership."

"I think that the FAL actually needs to be longer because so far there has been a lot of info to cover and you have to do the homework anyway."

"I don't feel that the clickers really add much to the class except that they're fun buttons to push every now and again. In terms of extra learning experience, it doesn't help."

"I appreciate using clickers. My instructor (Kahane) was very helpful in explaining how to use the clickers."

"The only bad thing about the clickers is how expensive they end up being, especially if they will not be used in future classes."

"I think that they are not necessary, and VERY expensive for a college student. I beleive the concept is good and could be very helpful but it just doesnt seem necessary. We could do the same thing with peices of paper or raising our hand."

"Expensive to buy and register with no sell back option or any use in the future. Other schools use similar thing but is already in the classroom at every seat on a cord."

"I think that the clickers are fun! execpt when i forget mine... then i feel left out."

"i understand the clickers help the teachers to recieve immediate feedback and how they are beneficial to the class, i just don't like the fact that i had to buy something additional for the class and then pay again to register it. i felt like i was being nickled and dimed in a class that was already very expensive."

"I think the usage of clickers is positive and beneficial, but I do think they are a little expensive, and would be better if we could sell them back or reuse them for other classes."

"I think that the use of clickers is a good way to make sure students are keeping up on regular reading and assignments. I think how we can get the grades immediately and not waste paper. Talking about the clicker question also helps build relationships with other students in the class."

"clickers help the teacher and the student interact and know what each other was thinking. Trying to take a survey about any thing is a click away and we all can see the results fast. Some studnts wont ask a teacher a question even if they are confused. the clicker seems to side step this problem because clicker cause you to talk to your neighbor and get feed back.
I like using the clickers in class because I felt like they were kind of mini-tests, I felt like they were exercising what I had just learned of what a should have been learning. It keeps me on my toes."

"I really like the clickers, not only because it's a faster way of answering multiply choice questions, but also because we are given a chance to discuss the answers with people around us."

"It is a huge waste of money for us students to use that when we simply could just go over our papers out loud as a class. We have to pay for a lot of other stuff during school and the clicker is very unnecessary."

"I think clickers are a good tool to make sure students are doing homework and keeping up with class, however I don't feel they should be used in every class period. To me they should be used about once a week. In the end I don't mind them, I just feel that if I accidently miss class than I am going to miss points and I really am trying hard not to miss any points."

20090305

Education research: preliminary feedback on clickers (Cuesta College, Astronomy 210, Spring Semester 2009)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA use clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

Through the fifth and sixth weeks of instruction (third and fourth weeks of using clickers), students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Spring Semester 2009 sections 30674, 30676
(N = 49)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 1 : *
2. Disagree 5 : *****
3. Neutral 8 : ********
4. Agree 21 : ********************* [3.9 +/- 1.0]
5. Strongly agree 14 : **************

II.2 Working in groups on in-class activities.
1. Strongly disagree 3 : ***
2. Disagree 3 : ***
3. Neutral 10 : **********
4. Agree 21 : ********************* [3.7 +/- 1.1]
5. Strongly agree 11 : ***********

II.3 Using clickers to participate in class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 8 : ********
4. Agree 21 : ********************* [4.1 +/- 0.8]
5. Strongly agree 18 : ******************

II.4 Reading the textbook.
1. Strongly disagree 2 : **
2. Disagree 4 : ****
3. Neutral 13 : *************
4. Agree 20 : ******************** [3.7 +/- 1.0]
5. Strongly agree 10 : **********

II.5 Demonstrations/videos in class.
1. Strongly disagree 1 : *
2. Disagree 2 : **
3. Neutral 8 : ********
4. Agree 20 : ******************** [4.1 +/- 0.9]
5. Strongly agree 18 : ******************

II.6 Interacting with other students during class.
1. Strongly disagree 2 : **
2. Disagree 3 : **
3. Neutral 5 : *****
4. Agree 26 : ************************** [3.9 +/- 1.0]
5. Strongly agree 13 : *************

II.7 Interacting with other students outside of class.
1. Strongly disagree 2 : **
2. Disagree 10 : **********
3. Neutral 24 : ************************ [3.0 +/- 0.9]
4. Agree 11 : ***********
5. Strongly agree 1 : *

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 1 : *
2. Disagree 3 : ***
3. Neutral 6 : ******
4. Agree 24 : ************************ [4.0 +/- 0.9]
5. Strongly agree 15 : ***************

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 8 : ********
4. Agree 30 : ****************************** [3.8 +/- 0.8]
5. Strongly agree 7 : *******

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 6 : ******
4. Agree 27 : *************************** [4.0 +/- 0.8]
5. Strongly agree 13 : *************

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 19 : *******************
2. Disagree 27 : *************************** [1.7 +/- 2.7]
3. Neutral 3 : ***
4. Agree 0 :
5. Strongly agree 0 :

III.5 Clickers were a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 5 : *****
4. Agree 33 : ********************************* [4.1 +/- 0.6]
5. Strongly agree 10 : **********

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 13 : *************
2. Disagree 27 : *************************** [2.0 +/- 2.0]
3. Neutral 5 : *****
4. Agree 4 : ****
5. Strongly agree 0 :

III.7 Too many clicker questions were asked.
1. Strongly disagree 14 : **************
2. Disagree 28 : **************************** [1.9 +/- 2.1]
3. Neutral 5 : *****
4. Agree 1 : *
5. Strongly agree 0 :

III.8 Using clickers was difficult.
1. Strongly disagree 31 : ******************************* [1.6 +/- 4.5]
2. Disagree 14 : **************
3. Neutral 1 : *
4. Agree 1 : *
5. Strongly agree 2 : **

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"Did I do this survey already, when you first announced it, or is this another one? The clickers are a great benefit for both the student and teacher. The student can print the clicker questions prior to class, and circle the answers in pencil, then correct them during lecture. This is a great study tool for the tests. For the teacher, they have immediate feedback and can better manage their lecture time. They can devote more time, or less time to a topic depending on the level of understanding the students are showing."

"I really do enjoy the clickers in class. It really is away of making me stop and really think over what I just learned and just how to apply that information to the questions asked. I would enjoy having the use of clickers in other classes like History."

"Clickers helped make the answers to questions clear. It helped the teacher see when the class wasn't understanding and gave many opportunities for students to discuss with each other the answers. It promoted discussions and made class interaction a necessity."

"I like the idea of clickers because you get to see how much the class is understanding overall."

"Clickers were fine in class because the instructor was able to help you then and there with things you had questions about. Sometimes I think though that some students were just messing around and purposefully clicking on wrong questions with the i don't know answer (i heard a kid next to me mention he was gonna click that option)."

"These are really cool devices!!"

"I like the clicker questions but when they are the first things that are done in class it is difficult to understand the marerial. I realize that we are supposed to read the chapter ahead of time but even when that has been done it is still difficult to answer questions about the lecture before the lecture. Same thing with in-class activities."

"Suggest to people they keep their clicker in their car or bag as to not forget it for class."

"I enjoy using clickers in class, they are an interactive learning tool that is very helpful"

"I think it's helpful at the end of lectures to use clickers but when we do it at the beginning before we have heard the lecture the questions we have to answer are sometimes difficult and i don't understand what we're talking about until the class is almost over or until the next class. I do read the chapters before class and for me, it's easier to see a powerpoint presentation then answer a bunch of questions."

"I like using clickers, but they are way too expensive."

"This was the first time I have used clickers in a class, for those that are finacially strapped it was a burden. But using them during class did help with some lecture that I was confused on."

"Never used a clicker before. Found it very useful in my learning. Can also see how helpful it is to the instructor in letting him know how well we are understanding the material."

"P-Dog ROCKS MY WORLD!!!!!!!!!"

"Clickers nice unless one has misplaced his or her's/ the batteries die."

"I think clickers are very helpful, but I would like the information to be described in greater detail before we begin the group projects, or are asked to answer clicker questions."

"the clicker questions arent that bad its just hard to get them to read so u end up pushing the button a hundred times."

"I like clickers :)"

"Clickers are a fun way to participate and interact in class."

"I think it's great that everyone has the opportunity to respond. It's good that the instructor knows where students stand. A downside for me is that I'm often in the minority of those who don't get it. I've never had such a hard time with a class & it's bothering me immensely, so I'm sure that's affecting my ratings."

"Clickers are a fun way to be active during class and it helps students try to answer study questions on their own, and if they are wrong they recieve information as to why a different answer is correct."

"I like using the clickers in class. It's a good way to participate without having to be called on unwillingly. It also lets you know that other people may answer the same way as you because a common misconception. I also really like the clickers because it is sometimes easier to have a student explination rather than a highly scientific explination."

"This was my first time using a clicker in class. I know that if we spent more time using the clickers then I would perform better on the quizzes. So in conclusion I believe we do not spend adequate time using the clickers. More Clicker-Time please!!! -Star Geek"

"I think using clickers is a good way to get the whole class involved without having to use up paper, its a more fun way to take a quiz."

"clickers are da bomb!!!"

"Clickers are a fun and interactive way to participate in class."