- Selected Examples of Several of the Different Genres of SOTL -
Original article by Craig E. Nelson
Indiana University, Bloomington Additional summaries have been added
These examples illustrate several of the genres (A-M) of Scholarship of Teaching and Learning (SOTL), as I currently understand them. The genres overlap and could be combined or subdivided variously. The particular examples illustrate the importance of SOTL for improving learning and teaching and learning.
Two opening points: 1. Learning and teaching are complex activities where approximate, suggestive knowledge can be very helpful, and, indeed, may often be the only kind that is practical or possible ( Schön, D. A. (1995). Knowing-in-action: The new scholarship requires a new epistemology. Change, 27, 26-34). 2. Much important expertise on teaching resides in the day to day practices of good faculty. Typically, this knowledge remains private and is totally lost when its possessor retires. A key task in this field is systematically making much more of this expertise public.
A. It worked!
Important pieces of our expert knowledge as experienced practitioners can be preserved by writing up examples approaches to content or pedagogy that work especially well in our own classes. In this genre, the teacher's own impressions of the effectiveness frequently serve as sufficient assessment. The trend now is to try to document the effectiveness a bit more formally using classroom assessment techniques (CATs) and classroom research (see citations in "B" and at the end of this bibliography). Numerous examples can be found in many of the disciplinary journals listed on the web site for Indiana University's Scholarship of Teaching & Learning Program (http://www.indiana.edu/~deanfac/sotl/).
Examples include an article about the professional development of a teacher, subsequent changes in small-group reading instruction and the co-occurrence of increased student achievement (Estrada, P. (2005). The courage to grow: A researcher and teacher linking professional development with small-group reading instruction and student achievement. Research in the Teaching of English, 39(4), 320-364)
B. Before & After: Qualitative Assessments of Changes in Practice.
The many examples of this genre in Angelo and Cross include a calculus class (pp. 69-72) in which the professor wanted to help students improve their problem solving skills. This example illustrates the process of refining the pedagogical questions and the successive modifications that are often necessary to make new pedagogical approaches work successfully. In this case, the new pedagogy improved student success sufficiently that no student made an F, despite the maintenance of high academic standards. (Angelo, T. A . & Cross,K.P. ( 1993). Classroom assessment techniques: A handbook for college teachers. The Jossey-Bass higher and adult education series. San Francisco: Jossey-Bass.)
C. Before & After: Quantitative Assessments of Changes in Practice.
Fullilove, R. E. & Treisman, P. U. (1990). Mathematics achievement among African American undergraduates at the University of California, Berkeley: An evaluation of the mathematics workshop program. Journal of Negro Education, 59(3), 463-478. The impetus was finding that about 60% of the African Americans who took calculus were unsuccessful (D/F/W). Initial work used extensive interviews and observations of students to establish differences in study approaches that distinguished the more successful groups of students. These group-study approaches were then incorporated into the requirements for the workshop program, which dropped the D/F/W rate to 4%. For additional discussion of the initial study and of faculty preconceptions that had to be overcome, see also: Treisman, U. (1992). Studying students studying calculus: A look at the lives of minority mathematics students in college. College Mathematics Journal 23(5), 362-372.
D. Essays Developing Good Ideas
Shulman, L. S. (1993). Teaching as community property. Change, 25(6), 6. Good articulation of a central rationale for SOTL. Greater recognition and reward for teaching will come from changing the status of teaching from private to communal property.
E. Summaries of Expert Knowledge Gained by Self-Reflection and Experimentation in Ones Own Teaching.
Frederick, P. (1981). The dreaded discussion: Ten ways to start. Improving College & University Teaching, 29(3), 109-114.
Techniques for initiating good discussion in class include: examining goals and values, noting concrete images in text, generating questions among students, finding illustrative quotations, small group discussion, generating truth statements, forced debates, role playing, non-structured scene-setting, and eliciting opinions of the text.
Frederick, P. J. (1986). The lively lecture--Eight variations. College Teaching, 34(2), 43-50.
Techniques for providing variety and effectiveness within the lecture format include the oral essay, participatory lecture, problem-solving approach, alternating mini-lectures and discussions, modeling analytical skills, debate, simulation and role-playing, and the affective/emotional media lecture.
F. Integration of Larger Frameworks with Classroom & Curriculum Practice
Coppola, B. P., Ege, S.N. & Lawton, R.G. (1997). The University of Michigan undergraduate chemistry curriculum. 2. Instructional strategies and sssessment. Journal of Chemical Education, 74(1), 84-94. Not just a report of UM changes, but an integration with related work.
Herron, J. D . (1975). Piaget for chemists: Explaining what "good" students cannot understand. Journal Chemical Education, 52(3), 146-150. One factor that explains why bright, hard-working students can do poorly and how we can help them. Easily applicable in all quantitative fields.
Kloss, R. J.. (1994). A nudge is best: Helping students through the Perry scheme of intellectual development. College Teaching 42(4), 151-158. Another factor that explains why bright, hard-working students can do poorly and how we can help them. Easily applicable across the curriculum.
Svinicki, M. D., & Dixon, N. M. (1987). The Kolb Model modified for classroom activities. CollegeTeaching 35(4), 141-146. Addressing heterogeneous learning styles using learning-cycles.
G. Qualitative Studies Designed to Explore a Key Issue. [3 Very Important Studies]
Perry, W. G. (1970). Forms of intellectual and ethical development in the college years; A Scheme. New York: Holt, Rinehart and Winston. The impetus here was the observation that students could flunk out of Harvard despite working quite hard at learning the course material. The longitudinal design used extensive interviews with students at the end of each of their four undergraduate years. Patterns of intellectual development were inferred and checked for inter-judge reliability. A very influential study. (A comparison of Perry with subsequent studies: Hofer, B., & Pintrich, P. (1997, March 1). The development of epistemological theories: Beliefs about knowledge and knowing and their relation to learning. Review of Educational Research, 67(1), 88-140.)
Rose, M. (2005). Lives on the boundary: A moving account of the struggles and achievements of America's educational underclass. New York, N.Y., U.S.A.: Penguin Books. How traditional pedagogy unintentionally and unnecessarily discriminates against less-privileged students and how to make teaching more equitable.
Shaughnessy, M. P.(1977). Errors and expectations: A guide for the teacher of basic writing. New York: Oxford University Press. Students' "errors" as windows into their thinking.
H. Quantitative Comparisons of Different Courses or Sections
Sundberg, M. D.& Dini, M. L. (1993). Science majors vs nonmajors: Is there a difference? Journal of College Science Teaching, 22(5), 299-304. Question: Does covering more teach more? Both courses taught with traditional pedagogy and by multiple instructors, but with different intensities of 'coverage.' Learning assessed with the ACT exam for AP Biology (which was already used as the exemption exam for both courses. Despite much higher rates of drop for the majors course: "The most surprising, in fact shocking, result of our study was that the majors completing their course did not perform significantly better than the corresponding cohort of nonmajors."
I. Comparisons of a Wide Array of Different Courses Using a Common Assessment
Hake, R. R. (1998). Interactive-engagement vs traditional methods: A six-thousand-student survey of mechanics test data for introductory physics courses. American Journal of Physics, 66(1), 64-74 (http://scitation.aip.org/ajp/). Uses qualitative multiple choice pre- and post-tests of the understanding of Newtonian physics, developed and validated by D. Hestenes, to compare increases in understanding achieved by a wide range of pedagogies in introductory physics courses at institutions ranging from high-schools to Harvard. Found that "interactive engagement" approximately doubles the amount of physics learned. An especially important model for emulation in other disciplines.
J. Experimental Analyses
Steele, C. M. (1997). A threat in the air: How stereotypes shape intellectual identity and performance. American Psychologist, 52(6), 613-629. [For further discussion see also: Steele,C. M. (1999). Thin ice: Stereotype threat and black college students. Atlantic Monthly, 284(2), 44-54.
K. Annotated Bibliographies.
R. N. Johnson, D. M. Enerson & K. M. Plank. 1996. Diversity: A Selected and Annotated Bibliography. Center for Excellence in Learning and Teaching. Pennsylvania State University.
L. Brief, Annotated Summaries Of Key Findings In The Research Literature.
Angelo, T. A. (1997). The campus as learning community: Seven promising shifts and seven powerful levers. AAHE Bulletin, 49(9), 3-6.
Barr, R. B. & Tagg, J. (1995). From teaching to learning: A new paradigm for undergraduate education. Change, 27(6), 12.
M. Formal (Quantitative) Meta-Analyses
Springer, L., Stanne, M.E. & Donovan, S.S. (1999). Effects Of Small-Group Learning On Undergraduates In Science, Mathematics, Engineering And Technology, A Meta-Analysis. Review of Educational Research, 69(1), 21-51. [average effect size "would move a student from the 50th percentile to the 70th" on a standardized curve.]
Angelo, T. A. (1998). Classroom assessment and research: An update on uses, approaches, and research findings. New directions for teaching and learning, no. 75. San Francisco: Jossey-Bass.
Cross, K. P., & Steadman, M. H. (1996). Classroom research: Implementing the scholarship of teaching. The Jossey-Bass higher and adult education series. San Francisco: Jossey-Bass.
Glassick, C. E., Huber, M. T., Maeroff, G. I., & Boyer, E. L. (1997). Scholarship assessed: Evaluation of the professoriate. San Francisco: Jossey-Bass.
Hutchings , P., Babb, M., & Bjork, C. (2002). An Annotated Bibliography of the Scholarship of Teaching and Learning in Higher Education. The Carnegie Academy for the Scholarship of Teaching and Learning.
Walvoord, B. E. F., & Anderson, V. J. (1998). Effective grading: A tool for learning and assessment. The Jossey-Bass higher and adult education series. San Francisco, Calif: Jossey-Bass.
Frechtling, J. A., & Sharp, L. M. (1997).User-friendly handbook for mixed method evaluations. Arlington, VA: NSF, Directorate for Education and Human Resources, Division of Research, Evaluation, and Communication.
College of Health and Public Affairs Teaching is a multidimensional activity that focuses on learning outcomes and the best methods for achieving those outcomes while measuring student achievement and providing feedback to students. Learning outcomes are directly related to the instructional objectives for a particular class. Al-though I teach...
College of Medicine I do not know if many educators formally construct their teaching philosophy before they walk into a classroom for the first time; I certainly did not when I started as an adjunct instructor at UCF in 1996 or when I became a full-time instructor in 2005. I am certain all educators think strongly about the kind o...
College of Sciences Learning is an imperfect process best tackled with a holistic approach. Strengths, weaknesses and work habits combine so that some students perform better than others; all students need to show strengths and address weaknesses as part of their learning. I provide diverse assessments while also working with student...