20110107

Education research: SASS and student learning outcomes (fall semester 2010)

Student achievement of course learning outcomes are assessed by administering an Student Assessment of Skills Survey (SASS), a five-point Likert scale questionnaire (Patrick M. Len, in development) to Astronomy 210 students at Cuesta College, San Luis Obispo, CA. This is a one-semester, introductory astronomy course (with an optional adjunct laboratory), and is taken primarily by students to satisfy their general education science transfer requirement.

The SASS is administered online during the last week of instruction, to be completed before the final exam.

The results for SASS from this semester are compiled below. Values for the mean and standard deviations are given next to the modal response category for each question. Also listed is the percentage of students who have self-assessed themselves as having successfully achieving a learning outcome (responding "average," "above average," or "excellent") as opposed to not achieving success with a learning outcome (responding "very poor" or "below average").

Cuesta College
Student Assessment of Skills Survey (SASS)
Astronomy 210 Fall 2010 sections 70158, 70160

The questions below are designed to characterize your understanding of
astronomy concepts.

The item scale has 5 possible responses; the responses range from 1
(very poor) through 3 (average) to 5 (excellent).

Please read each question.

From the 5-point scale mark the response that most clearly represents your
agreement with the statement. Use the entire 5-point scale.

Try not to think too deeply about each response; there are no correct or
incorrect answers.

1. Predict positions and cycles of stars, using a starwheel.
(Achieved: 98%, unachieved: 2%)
1. Very poor 0 :
2. Below average 1 : *
3. Average 23 : ***********************
4. Above average 25 : ************************* [3.8 +/- 0.8]
5. Excellent 15 : ***************

2. Explain sun cycles and seasons.
(Achieved: 83%, unachieved: 17%)
1. Very poor 0 :
2. Below average 11 : ***********
3. Average 24 : ************************ [3.4 +/- 0.9]
4. Above average 22 : **********************
5. Excellent 7 : *******

3. Explain and predict lunar phases and times.
(Achieved: 95%, unachieved: 5%)
1. Very poor 0 :
2. Below average 3 : ***
3. Average 21 : *********************
4. Above average 25 : ************************* [3.8 +/- 0.8]
5. Excellent 15 : ***************

4. Relate planets in the sky to a solar system map.
(Achieved: 86%, unachieved: 14%)
1. Very poor 1 : *
2. Below average 8 : ********
3. Average 30 : ****************************** [3.3 +/- 0.9]
4. Above average 19 : *******************
5. Excellent 6 : ******

5. Explain differences between models of planetary motion.
(Achieved: 88%, unachieved: 13%)
1. Very poor 1 : *
2. Below average 7 : *******
3. Average 27 : *************************** [3.4 +/- 0.9]
4. Above average 22 : **********************
5. Excellent 7 : *******

6. Explain evidence for the heliocentric model of planetary motion.
(Achieved: 78%, unachieved: 22%)
1. Very poor 2 : **
2. Below average 12 : ************
3. Average 19 : *******************
4. Above average 23 : *********************** [3.4 +/- 1.0]
5. Excellent 8 : ********

7. Describe how optical telescopes work.
(Achieved: 86%, unachieved: 14%)
1. Very poor 0 :
2. Below average 9 : *********
3. Average 25 : ************************* [3.5 +/- 0.9]
4. Above average 19 : *******************
5. Excellent 11 : ***********

8. Describe different powers of optical telescopes.
(Achieved: 83%, unachieved: 17%)
1. Very poor 0 :
2. Below average 11 : ***********
3. Average 22 : ********************** [3.5 +/- 1.0]
4. Above average 18 : ******************
5. Excellent 13 : ********

9. Explain which telescopes should be funded based on relevant criteria.
(Achieved: 92%, unachieved: 8%)
1. Very poor 0 :
2. Below average 5 : *****
3. Average 12 : ************
4. Above average 28 : **************************** [4.0 +/- 0.9]
5. Excellent 19 : *******************

10. Explain how stars produce energy.
(Achieved: 91%, umachieved: 9%)
1. Very poor 0 :
2. Below average 6 : ******
3. Average 24 : ************************
4. Above average 25 : ************************* [3.6 +/- 0.8]
5. Excellent 9 : *********

11. Explain the relationship between star brightness and distances.
(Achieved: 100%, unachieved: 0%)
1. Very poor 0 :
2. Below average 0 :
3. Average 16 : ****************
4. Above average 29 : ***************************** [4.0 +/- 0.7]
5. Excellent 18 : ******************

12. Predict the size of a star based on brightness and temperature.
(Achieved: 95%, unachieved: 5%)
1. Very poor 0 :
2. Below average 3 : ***
3. Average 17 : *****************
4. Above average 26 : ************************** [3.9 +/- 0.9]
5. Excellent 18 : ******************

13. Explain different stages a star will go through, based on its mass.
(Achieved: 91%, unachieved: 9%)
1. Very poor 1 :
2. Below average 5 : *****
3. Average 17 : *****************
4. Above average 29 : ***************************** [3.7 +/- 0.9]
5. Excellent 12 : ************

14. Explain evidence for the shape/size/composition of our Milky Way galaxy.
(Achieved: 88%, unachieved: 12%)
1. Very poor 1 : *
2. Below average 7 : *******
3. Average 28 : **************************** [3.4 +/- 0.9]
4. Above average 21 : *********************
5. Excellent 7 : *******

15. Explain evidence for how our Milky Way galaxy came to be.
(Achieved: 86%, unachieved: 14%)
1. Very poor 1 : *
2. Below average 8 : ********
3. Average 27 : *************************** [3.4 +/- 0.9]
4. Above average 22 : **********************
5. Excellent 6 : ******

16. Explain how the speed of light affects observations of distant objects.
(Achieved: 83%, unachieved: 17%)
1. Very poor 0 :
2. Below average 11 : ***********
3. Average 12 : ************
4. Above average 28 : **************************** [3.7 +/- 1.0]
5. Excellent 13 : *************

17. Explain evidence for the expansion of the universe.
(Achieved: 95%, unachieved: 5%)
1. Very poor 0 :
2. Below average 3 : ***
3. Average 28 : **************************** [3.6 +/- 0.8]
4. Above average 22 : **********************
5. Excellent 11 : ***********

18. Describe characteristics of the universe a long time ago.
(Achieved: 81%, unachieved: 19%)
1. Very poor 0 :
2. Below average 12 : ************
3. Average 23 : ***********************
4. Above average 24 : ************************ [3.3 +/- 0.9]
5. Excellent 5 : *****

19. Explain evidence for how our solar system came to be.
(Achieved: 83%, unachieved: 17%)
1. Very poor 1 : *
2. Below average 10 : **********
3. Average 25 : *************************
4. Above average 25 : ************************* [3.3 +/- 0.8]
5. Excellent 3 : ***

20. Describe key features of terrestrial planets.
(Achieved: 94%, unachieved: 6%)
1. Very poor 0 :
2. Below average 4 : ****
3. Average 20 : ********************
4. Above average 28 : **************************** [3.7 +/- 0.8]
5. Excellent 11 : ***********

21. Describe key features of jovian planets.
(Achieved: 97%, unachieved: 3%)
1. Very poor 0 :
2. Below average 2 : **
3. Average 19 : *******************
4. Above average 31 : ******************************* [3.8 +/- 0.7]
5. Excellent 9 : *********

22. Explain why Pluto is not currently categorized as a planet.
(Achieved: 94%, unachieved: 6%)
1. Very poor 0 :
2. Below average 4 : ****
3. Average 14 : **************
4. Above average 21 : *********************
5. Excellent 25 : ************************* [4.0 +/- 0.9]

23. Describe plausible requirements for life.
(Achieved: 98%, unachieved: 2%)
1. Very poor 0 :
2. Below average 1 : *
3. Average 21 : *********************
4. Above average 30 : ****************************** [3.8 +/- 0.7]
5. Excellent 12 : ************

24. Explain difficulties in investigating the possibility for extraterrestial life.
(Achieved: 91%, unachieved: 9%)
1. Very poor 0 :
2. Below average 6 : ******
3. Average 20 : ********************
4. Above average 26 : ************************** [3.7 +/- 0.9]
5. Excellent 12 : ************


Of the 24 student learning outcomes in the SASS, 18 were self-reported as being achieved by at least 85% of students, listed below in order of decreasing success:
11. Explain the relationship between star brightness and distances. (100%)
1. Predict positions and cycles of stars, using a starwheel. (98%)
23. Describe plausible requirements for life. (98%)
21. Describe key features of jovian planets. (97%)
3. Explain and predict lunar phases and times. (95%)
12. Predict the size of a star based on brightness and temperature. (95%)
17. Explain evidence for the expansion of the universe. (95%)
22. Explain why Pluto is not currently categorized as a planet. (94%)
20. Describe key features of terrestrial planets. (94%)
9. Explain which telescopes should be funded based on relevant criteria. (92%)
10. Explain how stars produce energy. (91%)
13. Explain different stages a star will go through, based on its mass. (91%)
24. Explain difficulties in investigating the possibility for extraterrestial life. (91%)
5. Explain differences between models of planetary motion. (88%)
14. Explain evidence for the shape/size/composition of our Milky Way galaxy. (88%)
4. Relate planets in the sky to a solar system map. (86%)
7. Describe how optical telescopes work. (86%)
15. Explain evidence for how our Milky Way galaxy came to be. (86%)

However, 6 student learning outcomes were self-reported as being achieved by less than 85% of students, listed below in order of decreasing success:
2. Explain sun cycles and seasons. (83%)
8. Describe different powers of optical telescopes. (83%)
16. Explain how the speed of light affects observations of distant objects. (83%)
19. Explain evidence for how our solar system came to be. (83%)
18. Describe characteristics of the universe a long time ago. (81%)
6. Explain evidence for the heliocentric model of planetary motion. (78%)

As per the ACCJC (Accrediting Commission for Community and Junior Colleges), results from this assessment tool will be used for course/program improvement by increasing emphasis on these lowest six student learning outcomes in instruction in future semesters.

No comments: