20140530

Education research: SASS, ECCE and student learning outcomes assessment (Cuesta College, spring semester 2014)

Student achievement of course learning outcomes are assessed by administering an Student Assessment of Skills Survey (SASS), a five-point Likert scale questionnaire (Patrick M. Len, in development), and a shortened version (22 out of 45 questions) of the Electric Circuit Concept Evaluation (David Sokoloff, University of Oregon) to Physics 205B students at Cuesta College, San Luis Obispo, CA. This is the second semester of a two-semester introductory physics course (college physics, algebra-based, mandatory adjunct laboratory).

The SASS is administered online during the last week of instruction, to be completed before the final exam. The ECCE is administered in class during the last week of instruction.

The SASS results from this semester are compiled below. Values for the mean and standard deviations are given next to the modal response category for each question. Also listed is the percentage of students who have self-assessed themselves as having successfully achieving a learning outcome (responding "average," "above average," or "excellent") as opposed to not achieving success with a learning outcome (responding "very poor" or "below average").

Cuesta College
Student Assessment of Skills Survey (SASS)
Physics 205B spring semester 2014 sections 30882, 30883
N = 37

The questions below are designed to characterize your achievement of each of the learning outcomes by filling in a bubble on the rating scale provided to the right of each statement.

Mark the level of achievement that best describes your learning at the completion of the course.

1. Quantify the frequency, speed and wavelength of light.
(Achieved: 92%, unachieved: 8%)
Very poor.  * [1]
Below average.  ** [2]
Average.  ************** [14]
Above average.  ********** [10]
Excellent.  ********** [10]

2. Analyze the polarization of light.
(Achieved: 97%, unachieved: 3%)
Very poor.  [0]
Below average.  * [1]
Average.  **************** [16]
Above average.  ********** [10]
Excellent.  ********** [10]

3. Analyze reflection, refraction, and total internal reflection.
(Achieved: 92%, unachieved: 8%)
Very poor.  [0]
Below average.  *** [3]
Average.  ************* [13]
Above average.  ************** [14]
Excellent.  ****** [6]

4. Analyze images produced by lenses.
(Achieved: 86%, unachieved: 14%)
Very poor.  [0]
Below average.  ***** [5]
Average.  **************** [16]
Above average.  *********** [11]
Excellent.  **** [4]

5. Understand optical systems such as cameras, eyes, simple magnifiers, microscopes and telescopes operate.
(Achieved: 73%, unachieved: 27%)
Very poor.  * [1]
Below average.  ********* [9]
Average.  **************** [16]
Above average.  ********** [10]
Excellent.  * [1]

6. Analyze the constructive/destructive interference of waves.
(Achieved: 89%, unachieved: 11%)
Very poor.  [0]
Below average.  **** [4]
Average.  ************** [14]
Above average.  ************** [14]
Excellent.  ***** [5]

7. Understand how double-slits produce constructive/destructive interference.
(Achieved: 92%, unachieved: 8%)
Very poor.  [0]
Below average.  *** [3]
Average.  **************** [16]
Above average.  **************** [16]
Excellent.  ** [2]

8. Analyze the diffraction produced by a single-slit.
(Achieved: 94%, unachieved: 6%)
Very poor.  [0]
Below average.  ** [2]
Average.  ******************* [19]
Above average.  ************** [14]
Excellent.  * [1]

9. Understand how charges behave differently in conductors and insulators.
(Achieved: 76%, unachieved: 24%)
Very poor.  *** [3]
Below average.  ****** [6]
Average.  **************** [16]
Above average.  ************ [12]
Excellent.  [0]

10. Understand how a source charge exerts a force on a test charge (the direct model).
(Achieved: 86%, unachieved: 14%)
Very poor.  * [1]
Below average.  **** [4]
Average.  *************** [15]
Above average.  *************** [15]
Excellent.  ** [2]

11. Analyze the electric force exerted on a test charge by several source charges.
(Achieved: 81%, unachieved: 19%)
Very poor.  * [1]
Below average.  ****** [6]
Average.  *************** [15]
Above average.  ************** [14]
Excellent.  * [1]

12. Understand how a source charge creates an electric field, which exerts a force on a test charge (the two-step field model).
(Achieved: 78%, unachieved: 22%)
Very poor.  * [1]
Below average.  ******* [7]
Average.  ************** [14]
Above average.  ************ [12]
Excellent.  *** [3]

13. Analyze the electric field created by several source charges.
(Achieved: 86%, unachieved: 14%)
Very poor.  * [1]
Below average.  **** [4]
Average.  ****************** [18]
Above average.  ********** [10]
Excellent.  **** [4]

14. Understand the relationship between electric potential and electric potential energy.
(Achieved: 75%, unachieved: 25%)
Very poor.  ** [2]
Below average.  ******* [7]
Average.  *************** [15]
Above average.  ********** [10]
Excellent.  ** [2]

15. Analyze the characteristics of parallel plate capacitors.
(Achieved: 81%, unachieved: 19%)
Very poor.  * [1]
Below average.  ****** [6]
Average.  *************** [15]
Above average.  ********* [9]
Excellent.  ****** [6]

16. Quantify (using Ohm's law) the resistance, electric potential difference, and current of a circuit element.
(Achieved: 89%, unachieved: 11%)
Very poor.  * [1]
Below average.  *** [3]
Average.  ************** [14]
Above average.  ************* [13]
Excellent.  ****** [6]

17. Understand how to reduce configurations of resistors to an equivalent resistance.
(Achieved: 89%, unachieved: 11%)
Very poor.  * [1]
Below average.  *** [3]
Average.  *********** [11]
Above average.  ********** [10]
Excellent.  ************ [12]

18. Understand how to apply Kirchhoff's circuit rules (the junction rule and the loop rule).
(Achieved: 86%, unachieved: 14%)
Very poor.  ** [2]
Below average.  *** [3]
Average.  ************** [14]
Above average.  ********* [9]
Excellent.  ******** [8]

19. Analyze the power used or supplied by circuit elements.
(Achieved: 89%, unachieved: 11%)
Very poor.  [0]
Below average.  **** [4]
Average.  *************** [15]
Above average.  *********** [11]
Excellent.  ****** [6]

20. Understand how a source magnet or current-carrying wire creates a magnetic field, which exerts a force on a moving charge or current-carrying wire (the two-step field model).
(Achieved: 86%, unachieved: 14%)
Very poor.  [0]
Below average.  ***** [5]
Average.  *************** [15]
Above average.  *********** [11]
Excellent.  ****** [6]

21. Analyze the direction of a magnetic fields and forces using the appropriate right-hand rules.
(Achieved: 89%, unachieved: 11%)
Very poor.  [0]
Below average.  **** [4]
Average.  ********** [10]
Above average.  ************ [12]
Excellent.  *********** [11]

22. Understand how generators work.
(Achieved: 74%, unachieved: 26%)
Very poor.  * [1]
Below average.  ******** [8]
Average.  *********** [16]
Above average.  ******** [8]
Excellent.  ** [2]

23. Understand how changing the magnetic flux through a wire loop produces an induced emf and an induced current (Faraday's law and Lenz's law).
(Achieved: 81%, unachieved: 19%)
Very poor.  * [1]
Below average.  ****** [6]
Average.  ******** [8]
Above average.  ************ [12]
Excellent.  ********** [10]

24. Analyze the step-up and step-down behavior of transformers.
(Achieved: 76%, unachieved: 24%)
Very poor.  * [1]
Below average.  ******** [8]
Average.  ************** [14]
Above average.  ********* [9]
Excellent.  ***** [5]

25. Understand the conditions for stability and instability in atomic nuclei.
(Achieved: 76%, unachieved: 24%)
Very poor.  ** [2]
Below average.  ******* [7]
Average.  ****************** [18]
Above average.  ******* [7]
Excellent.  *** [3]

26. Analyze various radioactive decay processes (alpha, beta-plus, beta-minus, electron capture, and gamma).
(Achieved: 75%, unachieved: 25%)
Very poor.  ** [2]
Below average.  ******* [7]
Average.  *************** [15]
Above average.  ******* [7]
Excellent.  ***** [5]

27. Analyze the time-dependent nature of radioactive decay activity.
(Achieved: 70%, unachieved: 30%)
Very poor.  **** [4]
Below average.  ******* [7]
Average.  ********** [10]
Above average.  ************* [13]
Excellent.  *** [3]

28. Understand how Feynman diagrams are used to depict fundamental subatomic processes and interactions.
(Achieved: 73%, unachieved: 27%)
Very poor.  * [1]
Below average.  ********* [9]
Average.  ********** [10]
Above average.  ************* [13]
Excellent.  **** [4]

Of the 28 student learning outcomes in the SASS, 15 were self-reported as being achieved by at least 85% of students, listed below in order of decreasing success:
2. Analyze the polarization of light. (97%)
8. Analyze the diffraction produced by a single-slit. (94%)
1. Quantify the frequency, speed and wavelength of light. (92%)
3. Analyze reflection, refraction, and total internal reflection. (92%)
7. Understand how double-slits produce constructive/destructive interference. (92%)
6. Analyze the constructive/destructive interference of waves. (89%)
16. Quantify (using Ohm's law) the resistance, electric potential difference, and current of a circuit element. (89%)
17. Understand how to reduce configurations of resistors to an equivalent resistance. (89%)
19. Analyze the power used or supplied by circuit elements. (89%)
21. Analyze the direction of a magnetic fields and forces using the appropriate right-hand rules. (89%)
4. Analyze images produced by lenses. (86%)
10. Understand how a source charge exerts a force on a test charge (the direct model). (86%)
13. Analyze the electric field created by several source charges. (86%)
18. Understand how to apply Kirchhoff's circuit rules (the junction rule and the loop rule). (86%)
20. Understand how a source magnet or current-carrying wire creates a magnetic field, which exerts a force on a moving charge or current-carrying wire (the two-step field model). (86%)

However, 13 student learning outcomes were self-reported as being achieved by less than 85% of students, listed below in order of decreasing success:
11. Analyze the electric force exerted on a test charge by several source charges. (81%)
15. Analyze the characteristics of parallel plate capacitors. (81%)
23. Understand how changing the magnetic flux through a wire loop produces an induced emf and an induced current (Faraday's law and Lenz's law). (81%)
12. Understand how a source charge creates an electric field, which exerts a force on a test charge (the two-step field model). (78%)
9. Understand how charges behave differently in conductors and insulators. (76%)
24. Analyze the step-up and step-down behavior of transformers. (76%)
25. Understand the conditions for stability and instability in atomic nuclei. (76%)
14. Understand the relationship between electric potential and electric potential energy. (75%)
26. Analyze various radioactive decay processes (alpha, beta-plus, beta-minus, electron capture, and gamma). (75%)
22. Understand how generators work. (74%)
5. Understand optical systems such as cameras, eyes, simple magnifiers, microscopes and telescopes operate. (73%)
28. Understand how Feynman diagrams are used to depict fundamental subatomic processes and interactions. (73%)
27. Analyze the time-dependent nature of radioactive decay activity. (70%)

Student learning outcomes 16, 17, 18, and 19 for this semester were also directly assessed using a shortened version of Electric Circuit Concept Evaluation.

As per the ACCJC (Accrediting Commission for Community and Junior Colleges), results from this indirect assessment SASS tool, along with the direct assessment ECCE tool will be used for course/program improvement by increasing emphasis on these lowest three learning outcomes in instruction in future semesters.

No comments: