The ALLS is administered as a pre-test on the first laboratory meeting, before any introduction/instruction took place; and as a post-test on the last laboratory meeting.
The results from the pre- and post-test questions follow below. Values for the mean and standard deviations are given next to the modal response category for each question, along with a Student t-test for the probability of null hypothesis rejection, and the class-wise Hake gain. (Matched-pair Hake gains were not calculated for each student, as pre-instruction values such as "5" would result in undefined values.) For statistical purposes, blank entries were treated as "3. Neutral," and multiply-circled entries such as "12," "23," "34," and "45" were treated as "1," "2," "4," and "5" respectively.
Cuesta College
Astronomy Laboratory Learning Survey (ALLS)
Pre- and post-instruction results
Astronomy 210L Fall 2010 sections 70178, 70186, 70200
1. I am interested in using a telescope or binoculars for astronomy.
Pre-instruction
1. Strongly disagree 3 : ***
2. Disagree 11 : ***********
3. Neutral 12 : ************
4. Agree 35 : *********************************** [3.6 +/- 1.1]
5. Strongly agree 16 : ****************
Post-instruction
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 12 : ************
4. Agree 27 : *************************** [4.1 +/- 0.7]
5. Strongly agree 19 : *******************
Student t-test p = 0.0050 (t = -2.86, sd = 0.949, dof = 133)
Class-wise <g> = +0.35
2. Astronomy has little relation to what I experience in the real world.
Pre-instruction
1. Strongly disagree 11 : ***********
2. Disagree 36 : ************************************ [2.4 +/- 0.9]
3. Neutral 20 : ********************
4. Agree 7 : *******
5. Strongly agree 2 : **
Post-instruction
1. Strongly disagree 9 : *********
2. Disagree 28 : **************************** [2.3 +/- 0.9]
3. Neutral 16 : ****************
4. Agree 3 : ***
5. Strongly agree 2 : **
Student t-test p = 0.74 (t = 0.332, sd = 0.932, dof = 132)
Class-wise <g> = -0.02
3. I know where and how to look up astronomy information.
Pre-instruction
1. Strongly disagree 8 : ********
2. Disagree 25 : *************************
3. Neutral 25 : ************************* [2.7 +/- 1.0]
4. Agree 16 : ****************
5. Strongly agree 2 : **
Post-instruction
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 7 : *******
4. Agree 30 : ****************************** [4.2 +/- 0.7]
5. Strongly agree 20 : ********************
Student t-test p < 0.0001 (t = -9.47, sd = 0.888, dof = 132)
Class-wise <g> = +0.64
4. I know where and how to find objects in the night sky.
Pre-instruction
1. Strongly disagree 11 : ***********
2. Disagree 25 : *************************
3. Neutral 21 : ********************* [2.7 +/- 1.1]
4. Agree 16 : ****************
5. Strongly agree 4 : ****
Post-instruction
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 9 : *********
4. Agree 37 : ************************************ [4.0 +/- 0.6]
5. Strongly agree 11 : ******
Student t-test p < 0.0001 (t = -7.93, sd = 0.942, dof = 133)
Class-wise <g> = +0.57
5. I am interested in news that is related to astronomy.
Pre-instruction
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 13 : *************
4. Agree 43 : ******************************************* [4.0 +/- 0.7]
5. Strongly agree 17 : *****************
Post-instruction
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 12 : ************
4. Agree 24 : ************************ [4.0 +/- 0.9]
5. Strongly agree 19 : *******************
Student t-test p = 0.76 (t = 0.311, sd = 0.802, dof = 132)
Class-wise <g> = +0.04
6. I often ask myself questions related to astronomy.
Pre-instruction
1. Strongly disagree 2 : **
2. Disagree 10 : **********
3. Neutral 27 : ***************************
4. Agree 28 : **************************** [3.4 +/- 1.0]
5. Strongly agree 10 : **********
Post-instruction
1. Strongly disagree 2 : **
2. Disagree 8 : ********
3. Neutral 14 : ************** [3.6 +/- 1.1]
4. Agree 23 : ***********************
5. Strongly agree 11 : ***********
Student t-test p = 0.47 (t = -0.727, sd = 1.01, dof = 133)
Class-wise <g> = +0.08
7. I am comfortable using a calculator to make complex calculations.
Pre-instruction
1. Strongly disagree 9 : *********
2. Disagree 4 : ****
3. Neutral 18 : ******************
4. Agree 33 : ********************************* [3.5 +/- 1.2]
5. Strongly agree 13 : *************
Post-instruction
1. Strongly disagree 2 : **
2. Disagree 3 : ***
3. Neutral 13 : *************
4. Agree 24 : ************************ [3.8 +/- 1.0]
5. Strongly agree 16 : ****************
Student t-test p = 0.062 (t = -1.88, sd = 1.11, dof = 133)
Class-wise <g> = +0.24
8. I can make sense of equations and scientific notation numbers.
Pre-instruction
1. Strongly disagree 4 : ****
2. Disagree 5 : *****
3. Neutral 21 : *********************
4. Agree 36 : ************************************ [3.6 +/- 1.0]
5. Strongly agree 10 : **********
Post-instruction
1. Strongly disagree 0 :
2. Disagree 5 : *****
3. Neutral 11 : ***********
4. Agree 30 : ****************************** [3.8 +/- 0.9]
5. Strongly agree 12 : ************
Student t-test p = 0.088 (t = -1.72, sd = 0.930, dof = 132)
Class-wise <g> = +0.20
9. I prefer to work independently rather than in groups.
Pre-instruction
1. Strongly disagree 7 : *******
2. Disagree 20 : ********************
3. Neutral 34 : ********************************** [2.9 +/- 1.1]
4. Agree 4 : ****
5. Strongly agree 12 : ************
Post-instruction
1. Strongly disagree 9 : *********
2. Disagree 17 : *****************
3. Neutral 19 : ******************* [2.7 +/- 1.2]
4. Agree 6 : ******
5. Strongly agree 7 : *******
Student t-test p = 0.38 (t = 0.887, sd = 1.17, dof = 133)
Class-wise <g> = -0.09
10. I can understand difficult concepts better if I am able to explain them
to others.
Pre-instruction
1. Strongly disagree 2 : **
2. Disagree 14 : **************
3. Neutral 23 : ***********************
4. Agree 26 : ************************** [3.4 +/- 1.0]
5. Strongly agree 12 : ************
Post-instruction
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 11 : ***********
4. Agree 28 : **************************** [3.9 +/- 0.9]
5. Strongly agree 14 : **************
Student t-test p = 0.011 (t = -2.58, sd = 0.995, dof = 133)
Class-wise <g> = +0.28
11. I can understand difficult concepts better if I am able to ask lots of
questions.
Pre-instruction
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 17 : ************
4. Agree 40 : **************************************** [3.9 +/- 0.8]
5. Strongly agree 15 : ***************
Post-instruction
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 10 : **********
4. Agree 29 : ***************************** [3.9 +/- 0.8]
5. Strongly agree 15 : ***************
Student t-test p = 0.57 (t = 0.562, sd = 0.814, dof = 132)
Class-wise <g> = +0.07
12. Knowledge in astronomy consists of many pieces of information each of which
applies primarily to a specific situation.
Pre-instruction
1. Strongly disagree 0 :
2. Disagree 6 : ******
3. Neutral 44 : ******************************************** [3.3 +/- 0.7]
4. Agree 19 : *******************
5. Strongly agree 5 : *****
Post-instruction
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 28 : ****************************
4. Agree 19 : ******************* [3.6 +/- 0.8]
5. Strongly agree 9 : *********
Student t-test p = 0.028 (t = -2.22, sd = 0.753, dof = 130)
Class-wise <g>> = +0.17
13. I am good at math.
Pre-instruction
1. Strongly disagree 9 : *********
2. Disagree 13 : *************
3. Neutral 17 : *****************
4. Agree 33 : ********************************* [3.2 +/- 1.1]
5. Strongly agree 5 : *****
Post-instruction
1. Strongly disagree 6 : ******
2. Disagree 12 : ************
3. Neutral 14 : ************** [3.2 +/- 1.2]
4. Agree 19 : *******************
5. Strongly agree 7 : *******
Student t-test p = 1.00 (t = 0.00331, sd = 1.17, dof = 133)
Class-wise <g> = 0
14. I am good at science.
Pre-instruction
1. Strongly disagree 3 : ***
2. Disagree 11 : ***********
3. Neutral 22 : ********************** [3.4 +/- 1.0]
4. Agree 35 : ***********************************
5. Strongly agree 6 : ******
Post-instruction
1. Strongly disagree 3 : ***
2. Disagree 6 : ******
3. Neutral 23 : *********************** [3.3 +/- 1.0]
4. Agree 20 : ********************
5. Strongly agree 6 : ******
Student t-test p = 0.79 (t = 0.265, sd = 0.971, dof = 133)
Class-wise <g> = -0.03
15. This course will be/was difficult for me.
Pre-instruction
1. Strongly disagree 2 : **
2. Disagree 29 : *****************************
3. Neutral 30 : ****************************** [2.8 +/- 0.9]
4. Agree 13 : *************
5. Strongly agree 3 : ***
Post-instruction
1. Strongly disagree 9 : *********
2. Disagree 19 : ******************* [2.5 +/- 1.0]
3. Neutral 24 : ************************
4. Agree 4 : ****
5. Strongly agree 2 : **
Student t-test p = 0.048 (t = 1.99, sd = 0.917, dof = 133)
Class-wise <g> = -0.15
A statistically significant (p < 0.05) positive shift was observed for the interest in using telescopes/binoculars in astronomy (question 1); there was a statistically insignificant positive shift in Spring 2010, and notably a statistically significant (p < 0.05) negative shift in Fall 2009!
Also no statistically significant (p > 0.05) shifts were observed for relating astronomy to personal experience (question 2), interest in astronomy-related news (question 5), pondering astronomy-related questions (question 6), self-efficacy in use of calculators and math in astronomy (questions 7 and 8), individual/group learning habits (questions 9 and 11), and self-efficacy in math/science (questions 13 and 14).
However, there are statistically significant (p < 0.05) gains in being able to find astronomy-related news/information (question 3), finding night sky objects (question 4), understanding concepts better by explaining (question 10), disconnectedness in astronomy concepts (question 12), and rating the expected/experience difficulty of this course (question 15). The first two of these positive self-reported shifts correlate well with two of the student learning outcomes for this course:
- Keep abreast of present-day discoveries and developments in astronomy (current events).
- Construct and use devices to measure locations and sizes on the celestial sphere (observational astronomy).
- Apply laws of spectroscopy and gravitation to remotely determine properties of satellites, planets, and stars (astronometry).
- Develop and test physical models of the properties of solar system bodies (planetology).
- Collect data, evaluate the data using error analysis, draw conclusions from the data.
- Explain the information in a laboratory report.
- Education research: ALLS pre- to post-instruction opinion results (Cuesta College, Spring 2010).
- Education research: ALLS post-instruction opinion results (Cuesta College, Spring 2010).
- Education research: ALLS demographic results (Cuesta College, Spring 2010).
- Education research: ALLS pre- to post-instruction attitude shifts (Cuesta College, Fall 2009).
- Education research: ALLS post-instruction opinion results (Cuesta College, Fall 2009).
- Education research: ALLS demographic results (Cuesta College, Fall 2009).
- Education research: Astronomy Laboratory Learning Survey (ALLS), pre- and post-instruction forms.
No comments:
Post a Comment