Noba Blog

Doctor Who and Metacognition – A First-Year Seminar

November 7, 2018

@DrArnal

A silhouette looking into the distance where a TARDIS stands on a hill. With the words "Doctor Who" superimposed on the image.
From BBCAmerica (Here)

A quote that reads: "Yes, it all started out as a mild curiosity in a junkyard…”The Doctor, The Sensorites (1964)"
Doctor Who and Metacognition?

As a professor at a teaching-focused institution, I am frequently encouraged to offer courses in service areas of the curriculum, such as our first-year program. My general approach when creating these courses is to start with a useful (and hopefully engaging) topic that can be presented through the lens of popular culture. I previously taught courses on the science of a zombie apocalypse (since converted to a summer science camp) and pranking as a form of communication (co-taught with Dr. Paul Muhlhauser–read about it here)(1). For the first-year program, I wanted to focus on metacognitive strategies that students would be able to use to become better learners. That was a topic that I, a cognitive psychologist, felt comfortable covering with a group of incoming students. I also needed to cover some of the basics on how to succeed as a college student and how to acclimate to what many find to be a very novel situation (i.e., being away at college). The goal was to come up with an overarching theme that would allow for the integration of these various topics. At the very least, I needed a numbered list of items (for the demonstration of simple mnemonics) and a story that focused on change. Enter, Doctor Who!

The first episode of the show, An Unearthly Child (1963), quickly establishes its premise and ends with the Doctor and his companions leaving Earth to start their first adventure. I showed this episode for the first meeting of the class during the orientation weekend. I used it to establish the program, but more importantly to establish what the course was going to be–a new adventure in which we would use pop culture to enhance academics(2). I also used a cheesy line about how they would all get to regenerate into whatever they wanted to be over the next four years. I wanted to make sure they knew what type of humor they were in for. It could only get better from there.

A quote that reads: “They call me The Doctor. I am a scientist, an engineer. I am a builder of things. The Doctor, The Aztecs (1964)”.
Who is the Doctor? Why Doctor Who?

Image depicting all of the Doctors Who
Image: From @Aaroonio

Perhaps it would be helpful to clarify some aspects of the show. The Doctor is a time-travelling alien who changes, or regenerates, into new forms and must frequently adjust to new worlds, new friends, and new bodies. On the surface, the show seemed to match the basic characteristics I wanted–the show focuses largely on change, and the various incarnations of the Doctor could serve as an ordered list. As a fan of the show, I decided to make the ultimate sacrifice (3) and dig even deeper into the rich history of the show (55 years and counting) to see what additional connections I could mine for lecture and discussion topics, assignments, and other class activities.

One such connection involved the various incarnations (4) of the Doctor and perspective taking, which might be used to enhance learning. I hoped that trying to take the perspective of various versions of the same character (in addition to a number of other strategies used in the course) would increase the likelihood of transferring the skills learned in this course to other situations (5). Each of the incarnations of the Doctor displays a different personality. I wanted to cover each of the incarnations during the semester so that students were exposed to all of the different versions of the character. At the time of the course, there were 13 canonical incarnations (6). The purpose of covering each was to expose the students to the differences in the personality of the character over time. A number of assignments asked them to take the perspectives of characters from the show, and I wanted to make sure they had viewed at least one story for each Doctor. Additionally, they were required to read the section about each incarnation from the book, The Doctors Are In: The Essential and Unofficial Guide to Doctor Who's Greatest Time Lord. The authors of that text do an excellent job explaining the characteristics of each version of the Doctor and highlighting a few key episodes.

A quote that reads: “First things first…but not necessarily in that order. The Doctor, Meglos (1980)”.
What Learning Objectives Were Considered?

In addition to the general goals I had for the course, it also needed to meet a number of student learning outcomes, some of which were required by McDaniel College. Many of these learning outcomes are similar to what one would find at other institutions and programs for first-year students.

McDaniel College General Education Outcomes for First-Year Seminars 1) Students demonstrate the ability to critically analyze college-level material 2) Students demonstrate effective oral communication, both in class presentations and informal discussions 3) Students demonstrate basic information literacy skills, including research, evaluation and citation. Course Outcomes 1) To learn to better evaluate research, scientific claims, and the limits of those claims 2) To create and implement a study plan based on empirical evidence 3) To learn how to be better college citizens 4) To be active participants in the accomplishment of the above objectives
A quote that reads: “I love humans. Always seeing patterns in things that aren’t there. The Doctor, Doctor Who (TV Movie, 1996)”.
How Did I Address the Learning Objectives?

The course needed to reach a number of goals, and the students and I would need to cover a lot of information over the course of the semester. To facilitate this process, I included a number of assignments that varied in scope and nature. The table below lists some brief information about each one.

Assignment 1: Study Plan Baseline. Description: Students described their current study plan and reasoning for it. They also interviewed a junior or senior and described that student’s current study plan and their reasoning. Reasons for the Assignment: 1) Establish a starting point 2) Get students to think about the reasons for their current strategies 3) Compare their strategies to those of senior students Assignment 2: Reaction to Campus Event I (e.g. speakers, sports, theatre, etc.). Description: Reaction paper, from both their perspective and the perspective of a character from DW (Doctor Who), to a campus event. Reasons for the Assignment: 1) Experience campus life 2) Learn to take other perspectives and use those as a metacognitive strategy. Assignment 3: Reaction to Campus Event II. Description: Refer to Assignment 2 for the second event. Reasons for the Assignment: 1) More practice with reasons for Assignment 2. Assignment 4: Group Article Presentation. Description: Students presented an empirical article on the metacognitive topic of the week. They also had to integrate pop culture when describing to the class how to apply the metacognitive strategy. Reasons for the Assignment: 1) Learn to better evaluate research, scientific claims, and the limits of those claims 2) Improve oral communication 3) Practice using pop culture to explain metacognitive strategies (repeated in blog assignment). Assignment 5: Study Plan II. Description: Students completed a detailed inventory (based on one from Stephen Chew) to help their current approach. They also proposed updates to their study plan. Reasons for the Assignment: 1) Learn to evaluate and revise a study plan 2) Integrate new methods based on empirical evidence. Final Blog Project. Description: Students’ final papers took the form of blog entries. Reasons for the Assignment: Please refer to the text that comes after this table for more details.

For the sake of brevity, I will not go into detail on the logic behind each assignment (7). I do, however, think it might be worthwhile to address the final blog project in more detail.

I wanted the course to be a little different from other first-year courses, especially the main writing assignment. The individuals who oversee the first-year program at McDaniel College strongly encourage staged writing assignments that include a lot of feedback to the students. It was also the case that the students would arrive with a variety of backgrounds (academic and otherwise). I wanted to present a staged writing assignment that would address the learning outcomes mentioned above and allow for the variability in their abilities and interests. I also wanted something that was not tied to a specific system of formatting that my students may not have previously used (8). I had heard of other instructors using blogs as part of writing assignments, and I thought that the variability in the media (word, images, sounds, etc.) students could use as part of the assignment would allow them to approach the assignment in ways that played to their strengths and experiences. This would also force the students to work on their writing and communication skills but also allow for a simplified formatting style that we could create together. I found examples of blog assignments online and spoke with a colleague from the English department who had recently taught a blogging course.

Additionally, this assignment was intended to address a number of learning outcomes (see Table 1) for the course. Specifically, the students would (hopefully) improve as writers and communicators, as evaluators and users of scientific research (improved information literacy), and in their ability to apply metacognitive strategies in various situations.

For the assignment, students were tasked with communicating scientific information to their reader in an approachable way. They were to do this by writing a blog post about a metacognitive strategy of their choice. Students needed to describe the strategy in detail and justify its use with empirical research. Finally, the students needed to show how to integrate the strategy through the use of pop culture. They were permitted to use any pop culture topic, not only Doctor Who (9).

The students responded well to the course assignments and seemed to enjoy them overall. A few questions remain, however: what connection were the students able to make and how effective were the approaches used in the course?

A quote that reads: “I used to believe in magic, but The Doctor has taught me about science. It is better to believe in science. Leela, Horror of the Fang Rock (1977)”.
Student Connections

The students were able to make a variety of connection between works from pop culture and academic topics. They conveyed these connections through various assignments, exam responses, and in-class discussions. Many of the academic topics came from our class, but some came from other classes the students were taking. As you might predict based on the courses first-year students are likely to take, many of those other topics came from introductory courses in psychology, sociology, history, and language. Here are some of the most interesting examples.

  • A number of students discussed examples of characters from the show suffering from confirmation bias.
  • A student used her blog to discuss a long-term approach to learning the canon of Doctor Who. She integrated metacognitive strategies such as prereading and priming in the context of schema building.
  • In a similar manner, a student used the complex canon and collection of characters from the show Supernatural. She suggested the use of semantic networks and concept mapping as the approaches to learning the information.
  • A student used the show The Walking Dead to explain illusion of knowledge and the Dunning-Kruger effect by discussing the various strategies used by characters in the show with leadership roles.
  • A student described detailed connections she noticed between Remembrance of the Daleks and a lecture about rising racial tensions given by visiting speaker and NAACP president Cornell Brooks. Remembrance used a story about the Daleks to comment on racial tensions in the 1960s, so connections to Brooks’ talk were well founded.
  • One of the groups used the episodes The Empty Child and The Doctor Dances as a starting point to teach the class about the Blitz as part of their group presentation. Both episodes take place during that part of World War II.
  • In her blog, a student used Doctor Who to explain structural formulas (chemistry) and connected these concepts to the metacognitive strategy of desirable difficulties. She also discussed false memory as a potential side effect.

I was very impressed by the variety and scope of the connections students displayed over the course of the semester. My hope is that students will continue to make these types of connections and transfer their learning in the future.

A quote that reads: “Time will tell. It always does. The Doctor, Remembrance of the Daleks (1988)”.
Were the Approaches Effective? (and What I Hope to Evaluate Next Time)

As this was my first time teaching the course, my main concern was to create a course that functioned smoothly. Given the time-consuming nature of these types of courses, I wanted to make sure all of the material was in place for the students to have a productive semester. With that said, any course like this should be evaluated for effectiveness. The future iterations will involve more formal measurements. For now, here is what I conclude based on admittedly weak evidence.

1. Some learning occurred.

Students performed reasonably well on the assignments and exams. Not all of the students, but most of them showed retention and application. Many of the students grasped the material at the same level or better than students in my upper-level cognitive psychology course (which is a challenging course).

2. Some information was transferred to other courses.

As the instructor of the course, I also served as the academic advisor for each of the students. This gave me an opportunity to talk with the students about their progression in other classes. They frequently mentioned use of the metacognitive strategies (especially, testing, interleaving, and spaced practice) when prepping for other classes. They also frequently admitted to cramming in some cases, despite knowing it was not ideal. At the very least, they seemed to be able to detect what they were doing inefficiently.

3. The students engaged in the college community.

The students overall gave positive reports about the two assignments that required them to attend campus events. They did not universally enjoy the events they attended, but they reported benefits from the assignment. A number of the students collaborated to start a Doctor Who club. They registered as an official campus organization so they could continue meeting and discussing the show.

Overall, the course appears to have been successful in its first iteration. For the next version (regeneration?) I hope to put into place more formal measures of learning, including some empirically validated assessments. I enjoyed teaching this course, and I hope to make it as effective as possible in the future.

Image: Students, teaching assistant, and instructor from a Doctor Who course at McDaniel College. Photo by Jack Arnal.
Image: Students, teaching assistant, and instructor from a Doctor Who course at McDaniel College. Photo by Jack Arnal.
A quote that reads: “It’s the end, but the moment has been prepared for. The Doctor, Logopolis (1981)".

Materials Available on the Open Science Framework (OSF)

Various course materials from this class can be found on the OSF. Please use them as you see fit. If you have questions or suggestions to make them better, please let me know!

The TL;DR Version

Image: A poster about this course was presented at NITOP 2018
Image: A poster about this course was presented at NITOP 2018

A quote that reads: “There’s no point in being grown up if you can’t be childish sometimes. The Doctor, Robot (1975)”.

Bio

Jack Arnal is a cognitive psychologist at McDaniel College. He received his Ph.D. in experimental psychology from the University of Arkansas. His research interests include prospective memory, false memory, and eyewitness testimony. Find him on Twitter @DrArnal or visit his website for more information.

Notes

1. I sometimes wonder how far I can push these topics before they won’t be approved. It is an empirical question, I guess.

2. This matches with the original remit for the BBC and the show: to educate and inform. Many of the older stories focused on historical events as a way of educating the audience.

3. The academic life can be difficult sometimes, but we persist.

4. Let’s skip the dissociative identity disorder jokes.

5. The likelihood of transfer relies on a number of factors, including appropriate retrieval and application at the correct time. Additional instructions and discussion in class was also part of the strategy. For a good review, see Barnett, S. M., & Ceci, S. J. (2002).

6. Of course, 13 is an oft-debated number. You see, the 9th incarnation did not call himself Doctor, and the 11th incarnation (referred to as the 10th Doctor) actually sent his regeneration energy into…I can see why people throw up their hands. Maybe I can turn this discussion into an activity about operational definitions and scientific communication?

7. But feel free to contact me for the details.

8. My experience has been that students come to college with limited experience with APA-style. I have not used MLA or any other type of formatting since the turn of the century. I had little interest in trying to learn a new formatting style for the purposes of one assignment.

9. Sherlock, Adventure Time, Supernatural, and sports were a few of the pop culture items used.

Tough questions and great thoughts: Advice from Richard Hamming

November 1, 2018

By Rodney Schmaltz

In the busyness of undergraduate studies, students sometimes lose sight of the big picture. Understandably, many students do not take the time to step back and make the connection between what they are doing in their studies and how this relates to who they want to be, and where they want to go. This might be a tough sell, but I’m going to make the argument that a grainy, lengthy, twenty-year old video of a lecture by a cantankerous mathematician is essential viewing for students. Not only that, but I believe this video can provide a springboard for instructors to facilitate meaningful class discussion regarding careers, motivation, and work habits. Enter Richard Hamming and his lecture, “You and Your Research” (https://youtu.be/a1zDuOPkMSw). This lecture provides instructors with a tool to help students focus on long-term goals while potentially providing a greater sense of purpose in the short term.

Richard Hamming and a cat seated on a couch, Hamming is wearing a checkered sport coat.
Richard Hamming and cat. Great thoughts deserve a great sport coat! [Image: kohala.com, https://goo.gl/uo8n7d]

Richard Hamming was a mathematician who was widely recognized for his contributions to computer science. In 1995, Hamming recorded a lecture focused on how to conduct research. This was not new material for Hamming, as a transcript of an earlier version of this presentation was published in 1986 (Hamming & Kaiser, 1986). An instructor could assign the transcript for students to read and not use class time for the video, but I believe this would be a mistake. The later version of this lecture provides greater insight from someone who reached the top of their field. While research is in the title of the talk, the content is really about how to excel in nearly any career. It is a rare opportunity for students to hear what it takes to excel at the highest level from someone who has done it, and is now looking back on their career.

Hamming discusses how he would set time aside every Friday for what he called, “Great Thoughts”. During this time, he focused on the important problems in the field, and more generally, he would consider the issues that really matter. The first time I showed the video to one of my classes, I asked them to set aside time for great thoughts. I wanted them to consider why they are interested in the field, and what contributions they wanted to make. The students were enthusiastic, and seemed to think this was a fine idea. At the end of the semester, I asked how many students regularly engaged in great thoughts. The answer was one. One single student. The rest of the students said they wanted to, but couldn’t find the time, and also reported that they didn’t know what to focus on. Although frustrated, I wasn’t ready to give up yet.

A quote that reads: "He who works with the door open gets all kinds of interruptions, but he also occasionally gets clues as to what the world is and what might be important".
Hamming dedicated 10% of his time to challenging himself with questions about the field. I decided that I would dedicate 10% of my 400-level senior seminar class to challenge students with thought-provoking questions, which I based around Hamming’s video. Students in this course watch the Hamming video early in the term, and are then given one “Great Thought” question a week with ten minutes of class time dedicated to discussion. The discussions are conducted in groups of three to four students, and following the small group discussion, we briefly discuss the question as a class. The feedback I’ve received has been overwhelmingly positive, and the discussions have been eye-opening both for me and for the students themselves.

Here's a sample of Hamming’s advice that I have found most inspiring for students, and examples of the questions that have been drawn from his talk.

Leading a significant life

Hamming said, “. . . you need to live the life you want to live, and you do this by doing something significant.” I ask students what is your definition of significant? The discussion does not have to focus on what is significant only in the field of psychology, but generally, what does it mean to the student to make a significant contribution. The most common response to this question, at least initially, is a blank look followed by a sombre, “I…don’t…know.”. This is where the group discussion is invaluable.

Luck favours the prepared

In “You and Your Research”, Hamming discusses the somewhat tired cliché of how luck favours the prepared. I’ve always found the notion that luck favours the prepared, while accurate, to be too vague to be of any use for most students. To challenge them to really consider what this means, I pose the following question, “It’s your lucky day, you’re at a conference and a professor you desperately want to work with at graduate school is there and you have an opportunity to talk to them. What type of preparation would be needed to ensure this bout of luck turns into something meaningful?”. The discussion can tie back into Hamming’s point that the way you lead your life from day to day is the way you prepare yourself for success or failure.

Students at a conference gathered around a poster presentation.
Having our students work through Hamming's great thoughts can bring more purpose to their current studies while also preparing them for future opportunities. [Image: Poster Session Interest, AnitaB.org, https://goo.gl/PmjW1w, CC BY-NC-ND 2.0]

You need a vision of what you want to do and who you are going to be

Hamming uses the clumsy metaphor of a pretty girl and a drunken sailor, but his point is solid. Without a clear vision of where you want to go, it can be difficult to focus on what is important, or to even know what is important. The question I have students discuss is, “Assuming that everything you want to do works out according to plan, where are you in ten years? Be specific, where are you working, what research are you doing, and what contributions have you made?”. It’s amazing how many students haven’t really thought through exactly what they want to achieve. For example, some want to go to graduate school, but don’t have a clear idea of what they hope to accomplish by doing this.

Study success closely and determine which elements of successful people you can adapt to your situation

Hamming tells a great story about his admiration of John Tukey. Hamming could not understand how someone Tukey’s age could know so much and was told that “you would be surprised how much you would know if you worked as hard as he did for that many years.” It’s valuable for students to look at people they admire, and then explore what it took for that person to succeed.

I ask students to discuss who inspires them and why. As a follow-up, if they could meet one psychologist, living or deceased, who would it be? The idea here is to get them to focus on people they admire, and then start to think about what aspects of these people they could incorporate into how they approach their career.

A quote that reads: "What you learn from others you can use to follow. What you learn from yourself you can use to lead".
Communication is the key

One student concern that is reliably brought to my attention is a fear of speaking in public. This is not particularly surprising as it is one of the most common phobias. Hamming has an interesting perspective. He points out that to be successful, people need to be able to effectively communicate orally, in written work, and casually. By orally, he is referring to giving a presentation, and by casually, he is referring to discussing research in an informal setting. Hamming states that when watching a presentation of any kind, be it a lecture or formal academic talk, one should be listening both for content and for style. The listener should look for what they like, what they don’t, and what aspects they can adapt to their own style. To facilitate this type of discussion, I ask students to name the best presentation they have seen, which does not have to be restricted to academics. Some students list motivational speakers, comedians, or even politicians. The goal here is to get students thinking about which aspects of successful speakers they can incorporate into their own style.

Great (Final) Thoughts

The goal of these discussion questions is to encourage students to think about some of the big picture issues. This can be difficult to do, but using Hamming’s video as a springboard has been successful in my courses. While Hamming provides a lot of solid advice, his approach is not the only way. I like to have students debate aspects of Hamming’s view on work-life balance, and contrast this with a great article by Radhika Nagpal, who has a different slant and is also highly successful (Nagpal, 2013). For other perspectives on Hamming, I highly recommend Erren et al.’s (2015) work on Hamming’s rules for lifelong learning and for doing your best research (Erren et al., 2007).

I encourage instructors to try adding at least a few “Great Thought” questions into their lectures, and I would love to hear what types of questions you use and the responses that you receive.

Bio

Rodney Schmaltz is an Associate Professor of Psychology at MacEwan University. His research focuses on pseudoscientific thinking, with an emphasis on strategies to promote and teach scientific skepticism.

References

Erren, T. C., Slanger, T. E., Groß, J. V., Bourne, P. E., & Cullen, P. (2015). Ten Simple Rules for Lifelong Learning, According to Hamming. PLoS Computational Biology, 11(2), e1004020–6. http://doi.org/10.1371/journal.pcbi.1004020

Erren, T. C., Cullen, P., Erren, M., & Bourne, P. E. (2007). Ten Simple Rules for Doing Your Best Research, According to Hamming. PLoS Computational Biology, 3(10), e213–2. http://doi.org/10.1371/journal.pcbi.0030213

Hamming, R., & Kaiser, J. F. (1986). You and your research. Transcription of the Bell Communications Research Colloquium Seminar. University of Virginia, 7.

Nagpal, R. (2013). The awesomest 7-year postdoc or: How I learned to stop worrying and love the tenure-track faculty life. Scientific American, Guest Blog.

Using Testing in All Aspects of Course Development

October 3, 2018

By Adam Persky

I have become a big fan of the bottom line up front concept (BLUF) so I will start with my recommendations and approaches to testing.

First, having students retrieve information from their memory improves the retention of information and skills. We have plenty of data (and meta-analyses) to show that. Typically, we ask students to retrieve information in the form of a test or quiz (hence it being called the testing effect). But we can functionalize this effect in a variety of ways within a course.

Three sheets of paper labeled "quiz, test, exam" with multiple-choice answer design
Several ways to retrieve stored information - quiz, test, exam

Pre-Course. Before the course even starts I give a multiple choice test. This serves 2 purposes. The first, broadly it assess what students know prior to starting my course. Second, it reactivates marginal knowledge – knowledge that may be stored within memory but has become inaccessible with time due to disuse. The information is in there but doesn’t come out easily.

Pre-Class. Before most classes I typically give an in-class, multiple choice quiz. This gives me some sense of what students have retained from pre-class preparation, and again it reactivates marginal knowledge. Also, I need to hold students accountable for their preparation, so a pre-class quiz is necessary. These pre-class quizzes are effective since students use points to assign importance. No points = they will skip preparing for class and if students are not prepared for class, it is challenging to teach them at higher levels of Bloom’s Taxonomy or get them to more deeply understand the material.

During class. I use several cases that have multiple choice questions – at least 3 or 4 per case. If I use clickers, I ask multiple choice questions regarding information covered during previous class periods. Why? To take advantage of the testing effect.

Post-Class. Most classes have extended learning opportunities – that is, homework. If there is homework, it usually consists of more open-ended questions so students have to generate responses. If they can generate the response during practice, it is easier to answer a multiple choice question on an exam. Harder if I reversed the order. These assignments also may take different perspectives from the class discussion to help students generalize the rules to problem solving.

Examinations. I give one maybe two high stakes exams, but they are cumulative and usually multiple choice. Cumulative is important because knowledge is cumulative, and because testing reinforces memory. If we spent time talking about it during class, I hope students retain the information over the semester. Why multiple choice? They’re just easier to grade, even though it can be challenging to write higher order multiple choice questions.

Well, now you know how the story ends. The rest is how I got to this point and more of the reasoning behind why I do things this way.

Teaching was easy when I knew nothing about learning or memory. As I learned about teaching, I started to learn more about learning and why what we did in the classroom should work. So for the past 10+ years, I’ve been teaching myself cognitive psychology. However, it was not until recently that I began to look at assessment as a learning tool. Yes, we typically think of formative assessment as a learning tool, but less so for summative. Typically we think of assessment to give feedback, however, assessment is a tool that can do so much more.

A quote that reads: "Teaching was easy when I knew nothing about learning or memory"
Here is the thing. To the student, the quiz or test is the most important thing. The assessment indicates to them what you find valuable for them to learn. This is probably why assessment is the second step in instructional design – develop learning objectives, figure how you will measure progress and if students meet those goals (i.e., assessment), and then design activities to help them achieve those goals.

Now, I work in a professional program. Students take prerequisite coursework and we hope they have remembered something. So as an instructor, I need to assess their prior knowledge, as it can make or break learning in my course. I also want students to apply their knowledge. However, in order for them to apply knowledge, they first need baseline knowledge. To do this, they need to prepare on their own and I need to assess where they are and what they know to hold them accountable. I also have to keep in mind that we forget very quickly and I need to go back and remind students of, again, prior knowledge. The good news, once information is learned, and then forgotten, it generally returns much faster than the time it took to originally learn that material. Ultimately, I need to make sure students have met the standards I set out for them, and testing can help me with this.

What is marginal knowledge? Think of a tip-of-the-tongue state. You know a word, what it may start with, about how long it is, but you can’t spit it out. Marginal knowledge is information that is stored well in your memory but you have not used it in a long time, so accessing it becomes problematic. Thus, you get the feeling of knowing the word but can’t quite access it. Beth Marsh and her graduate student Allison Cantor at Duke University demonstrated that we can reactivate marginal knowledge with a multiple-choice question if the answer choice is one of the choices. This is great, as it is much easier and more efficient to write a multiple-choice question than to re-teach information. Therefore, before the course or a class period, I use multiple choice questions to reactivate marginal knowledge and to assess student knowledge. Two birds – one stone.

An images of a brain with arms flexing weights and the traditional four answer options for tests - a, b, c, d, located at each corner of the image.
Now, during class, we know that the testing effect is a pretty powerful learning tool, so how can we get students to retrieve information? Well, I use a variety of methods to do so, including quizzes, cases, questioning techniques and to some degree, clickers. Oddly, most research shows no learning benefit of clickers (good for keeping attention – not so good for learning). I believe this is because we use clickers incorrectly in terms of strengthening memory. Typically, an instructor will teach and throw up a clicker question. While this is very helpful for students to act on information as soon as they learn it, they are probably going to be able to answer the question correctly without too much effort. However, if you ask the same question during the next class period, some forgetting has happened, and the task of retrieval is more difficult, but also much more impactful in strengthening memory (and more helpful in diagnosing learning). Thus, I use clickers mostly at the beginning of class over material from the last class – or material even further back. This practice is not only retrieval, but also spaced retrieval with feedback, and is supported by the three components that help memory: testing, feedback, and spacing.

Then there are the exams. These are multiple choice simply because I have 150+ students and I can now write questions pretty easily at the middle or higher levels of Bloom’s Taxonomy. While this is mostly to assess where students are, I try to provide feedback on performance so students can continue to learn from the test. This feedback is delayed – right after the exam or the next day – because delaying feedback improves memory. Why? Maybe because it also acts as a retrieval attempt. Students have to think about the question and what they were thinking when they answered it.

Bottom line, assessments are important and everything we do in the classroom needs to be efficient and powerful. We are missing opportunities to help student learning if we don’t do more with testing.

Bio

Adam Persky is a clinical professor at the UNC Eshelman School of Pharmacy. Within the pharmacy school, he teaches physiology and pharmacokinetics and has received several of the School’s teaching awards, including Best Overall Instructor. He was named a Distinguished Teaching Scholar by the American Associations of College of Pharmacy. He is the associate editor for the American Journal of Pharmaceutical Education and on the editorial board for College Teaching. He has given over 100 workshops across the country on a variety of topics related to teaching and learning and has numerous publications within the scholarship of teaching and learning. He also equates teaching to baking. Prepare the ingredients (mise en place) and follow the instructions until you get comfortable with the recipe. Then ad lib once you know how things work but make small changes at first!

Psi Beta: A Developmental Journey

September 27, 2018

By Jennifer Fox

Like many conception stories filled with eager promises, Northwest Vista College’s Psi Beta chapter was conceived in a moment of spontaneity - in front of a hiring committee - when I was asked, “What strengths will you be bringing to the psychology department? “ I fervently responded with, “I would love to start a Psi Beta chapter on this campus.” That reply was a defining moment for me. Once hired, a colleague and I began the exciting, yet arduous task of following through on my passionate promise by assembling our own chapter of the national honor society for psych majors at two-year colleges.

An image of Psi Beta Logo - blue circle with a yellow key that also has the appearance of the Greek letter "Psi" to denote "Psychology" and "b" for "Beta" and the words: "Psi Beta: The National Honor Society in Psychology for Community and Junior Colleges
Psi Beta Logo
Four years have passed – they grow up so fast – and since then the number of eligible Psi Beta candidates has more than doubled despite our declared psych major numbers remaining relatively stable. It’s clear too that our burgeoning chapter has significantly impacted our department. Students enrolled in psychology courses learn about Psi Beta during the first few days of class and our dynamic presence on campus is evident. Subsequently, psych majors are motivated to achieve academic excellence early on in their college career so that they too can be a part of something extraordinary. While raising a Psi Beta chapter isn’t child’s play, neither my colleague nor I anticipated the enormous benefits that our chapter would bestow upon us, our students, and our department.

If you would like to bring your own Psi Beta bundle of joy into the world, here are a few applicable life lessons we learned along the way:

What to Expect When You’re Expecting a Psi Beta Chapter

Lesson #1 – Choosing the Perfect Mate/Co-Advisor(s)

Select the right person to descend the rabbit hole with you. Thankfully, this proved to be an easy task for me. Dr. Cynthia Jacox, now retired, was a remarkably supportive co-advisor. No task felt too difficult with her by my side, and the encouragement she provided was invaluable. When establishing your chapter’s framework, it is extremely beneficial to have at least two different perspectives when considering the ways you’ll award academic excellence and support members’ interests. A joint effort by two well-intentioned advisors can make all the difference.

Lesson #2 – It Takes a Village

Everything you’ll need to provide sustenance for a successful chapter is located on the Psi Beta website. In fact, there is an entire section for potential Faculty Advisors that explains the application for the charter process and highlights the benefits of becoming an advisor. A bylaws template, chapter handbook, and sample letter seeking support from your college administration is also provided. The process is easy to navigate, and if questions arise, I can attest to the support that Dr. Jerry Rudmann, Executive Director of Psi Beta, and his staff as well as the Psi Beta Council will happily provide.

A screengrab of Psi Beta's Welcome Page. Contains a "Welcome Students" banner and various collections of information such as "What is Psi Beta" and "Membership"
Psi Beta Welcome Page

Birth of your Chapter and Associated Labor Pains

Lesson #3 – It’s a …… Psi Beta Chapter!

Once the charter has been approved by the Psi Beta Council, and you’ve followed your college’s Student Life protocol for new organizations, you are now ready for delivery. Your college’s Institutional Research Team should be able to assist in identifying potential Psi Beta candidates that meet your designated criteria as established in your bylaws. In my experience, notifying the potential candidates of their acceptance is one of the most exciting, but laborious aspects of an advisor’s duties. The reason for this is simple and something most college instructors already encounter on a weekly basis: Students aren’t the best at checking their college-issued email. In an effort to circumvent this minor obstacle, some chapters will deliver hand-written invitations to each eligible student.

Offering orientation sessions for Psi Beta candidates early in the semester is an excellent way to bring the new cohort together and provide introductory information, such as the chapter mission and goals, benefits, active membership requirements/bylaws, officer duties/vacancies and upcoming events.

Psi Beta: The National Society in Psychology for Community and Junior Colleges. The purpose of the organization shall be to recognize, stimulate and encourage scholarship and interest in behavioral sciences among students in community and junior colleges and in general, to nurture academic excellence in all fields of study. Northwest Vista College: Chapter, having made application, in hereby accepted and established as an active chapter with all the rights and privileges delegated to it by the national chapter and bylaws as long as it shall abide by and fulfill the requirements of that chapter and bylaws and the amendments. Chapter issued under date of the twenty-third day of October, A.D., 2014. Signed by the national president and the national executive director.
An example of Psi Beta Chapter Document.

Lesson # 4 – Celebrate Your New Additions

Commemorating new members’ entry into your Psi Beta chapter is a notable event. The induction ceremony honors those that have achieved academic excellence and are eager to become future contributors in the field of psychology. The Psi Beta website offers explicit guides on how to conduct various ceremonies, including the induction ceremony. Induction ceremonies can range from extravagant to low key depending on factors such as budget and time constraints. Our first few ceremonies were fairly elaborate. Families were invited, a classical guitarist played in the background, dinner was served, candles were lit, and our charismatic keynote speaker wore a bowtie and gave each new member a $20 bill. Since then, we have settled on a more informal, yet intimate ceremony that takes places during a regularly scheduled meeting.

The Early Years through Adolescence

Lesson #5 – Navigating the Playground

Now that your chapter has been established, it’s time to focus on exploration, growth and sustainability. As part of the development of our initial framework, we asked ourselves how our chapter would promote student development within the field of psychology. We identified four critical components that align with the mission of Psi Beta: Community Service, Educational Opportunities, Research, and Collaboration. Prior to each semester, advisors, officers, and interested members meet to brainstorm how we’ll best fulfill each component. The critical element in the design of your semester activities is that they should be student-driven. Let your officers/members dictate which guest speakers will present, which tours you’ll take, which service opportunities the chapter will engage in, and whether to participate in the annual Psi Beta research project, etc. Better yet, ask them to organize these events. Our job as advisors is to monitor and facilitate, analogous to the parental role on a playground. We have to fight the urge to swoop in and grip their legs as they traverse the monkey bars. Avoid over-advising when possible. Comparable to the adverse effects of over-parenting, over-advising can limit members’ sense of autonomy and defuse initiative.

Lesson #6 – The Graduation Speech

We have recently started a new tradition within our chapter. Graduating members are encouraged to stand during our last meeting in May and share their final thoughts/words of wisdom with the group. I am never prepared for what comes next. Words such as life-changing, transformative, gratitude, understood, supportive, and motivated emerge as a common thread in the tapestry woven before us. Tears are shed, people embrace, and the strong friendships forged are never more evident than at that moment in time. One student shared how she felt adrift at the beginning of her college career. It wasn’t until her discovery of psychology and her subsequent involvement in Psi Beta that she finally felt at home. This seems to be a mutual sentiment expressed by many within the chapter. Offering a Psi Beta chapter affords members an opportunity to prop each other up as they face obstacles and progress toward their goals. And as an advisor, hearing how the chapter has impacted your members’ lives is incredibly rewarding and motivating.

Emerging Adulthood and Beyond

Lesson #7 – Facilitating Collaboration

At Northwest Vista College, our psychology club and Psi Beta chapter are heavily intertwined. Our psychology club was well-established before the inception of our Psi Beta chapter. Both the club and the chapter are similar in purpose; however, the chapter encourages academic excellence, provides more research opportunities, and offers national recognition through various awards, scholarships, and grants. We found that layering the honor society on top of the existing psychology club was beneficial for all. The direct relationship between the two created a pathway so that lateral movement and participation is easy. Psychology club members are inspired to meet the criteria necessary for Psi Beta membership, and Psi Beta members placed on probation are encouraged to participate in psychology club pursuits. Either direction fosters continued growth as both the club and the chapter expose members to a myriad of developmental opportunities.

Lesson #8 – A Psi Beta Chapter (Life) Review

Over the past four years, I have been privy to a secret, something only known and whispered about by other Psi Beta and psychology club advisors. While some of our colleagues are dedicating their time to the latest college and state directed initiatives, we are joyfully working alongside students outside of the classroom setting. We are grooming our freshman and sophomore members for more than just the next course or transfer to a four-year university. Our ultimate goal is to prepare our members to become competitive applicants for graduate schools of their choice. Achieving this goal entails exposure to various aspects of the field and acquiring hands-on experience, such as conducting research and presenting at conferences, volunteering/interning at psychology-related organizations, and discerning which subfield of psychology bestfits their interests/skills. Here is the real secret, from the advisory perch we have a truly special view of something within our members that tends to be elusive – intrapersonal growth. We witness members evolve from academic drifters with an interest in psychology to self-assured colleagues who may eventually birth a Psi Beta chapter of their own.

An image of the May 2018 Commencement Ceremony at NW Vista College. Three women in caps and gowns. Two women on each side wearing black cap and gowns and the woman in the middle wearing a purple cap and gown holding a diploma.
A proud moment as we celebrate one of our member’s vast accomplishments at the May 2018 Commencement ceremony. From left to right: Cynthia Jacox, Diane Goguen, and Jennifer Fox.
“Psi Beta was beyond a worthwhile experience. It became the place for guidance; career-wise, as well as personally, there were opportunities and knowledge available. My fellow members and advisors changed my life.” – Diane Goguen, Former President of the Northwest Vista College Chapter


Bio

Jennifer Fox is an Assistant Professor of Psychology at Northwest Vista College in San Antonio, Texas. Prior to her role as co-advisor of Psi Beta, she served as a co-advisor for the psychology club at South Texas College for 8 years. She is passionate about promoting inter and intrapersonal growth among her students as they prepare to become future contributors to the field.

Why a Simple Pause at the End of Class Is So Powerful

September 6, 2018

By Gail Taylor Rice

@grice0

“Our students live in cacophony. Clamour, chatter and din fill their ears, and may even injure them…. We can educate ourselves to be models of intellectuals who trust and value silence, who practice what we have always known; when no one is speaking, someone is learning. We can create oases of silence where cool springs of insight trickle and flow.”(1)

A black button that says "Pause" on it in yellow letters

I slipped into an auditorium where nearly every seat was taken—150 medical and doctoral students in the basic sciences. The class on the topic of oral pathology was to be taught by a relatively new faculty member on our campus.

It didn’t take me long to see why this professor was considered to be one of the best. She had spent hours developing detailed slides to illustrate her topic. She used good examples. She spoke clearly and at a good tempo. But, she was the only one who spoke. She didn’t ask a single question of the students and the students didn’t ask a single question from her. There were no pauses for students to consult with each other, to apply the ideas presented to a case, or to write an answer to a thought question. Students simply sat and listened. When the time was up, everyone quickly left.

A couple of days later, I shared my notes with the professor. I showed her a number of positive strategies she used in her teaching and complimented her on her excellent learning materials. I shared my observations of the attention levels of the students, especially my awareness of the learner fatigue that seemed to be present toward the end of the hour, as students note-taking diminished, their eyes began to glaze over, and shoulders slumped. Some even took out their phones. The instructor took this feedback but didn’t ask me for any suggestions. As I was leaving, I mentioned that I would be happy to look at her next lecture plan to see if I might have any ideas to help with student engagement, if she would like. She looked quite surprised at this and asked, “What would you have done for this lecture?”

When I showed her that no one spoke but her and that we know that the person doing the talking is the one doing the learning, she responded, “Oh, I know. I love giving this lecture because it nails it down in my head.”

A few pauses during the hour-long session could have made a big difference—the difference between a well-delivered presentation and a powerful learning experience for students, but when I tried to suggest this, her reply was “Oh, no—I don’t have time for any of that—I must end on time and I have carefully planned for each minute so I am sure to cover all of the important points.” It was all about her. It was all about teaching, not about learning.

Myths That Keep Us from Pausing

How many times have we been in similar situations? Too much content to cover and not enough time—so we fill all of our allotted time with teacher talk? It is so hard for us to give up the myths that shape our classroom behavior:

  • If I don’t say it, they won’t learn it
  • If I DO say it, they WILL learn it
  • I must cover the content

Cognitive Science Research Supports Pausing

But we cannot ignore important studies, starting as early as the 70’s and 80’s and replicated within the last few years, which all report similar outcomes. These studies looked at pausing briefly during the lecture. Instructors in these studies taught two groups—one had lecture the whole time, the other took an occasional break, a 1-3-minute pause. The teachers who spent less time talking covered less content, but paused to allow students to briefly share their notes with each other, to discuss together, or to instruct each other. In every case, the group who had less lecture--less material covered--had the following results:

  • More content recalled from the presentation
  • Better test results, short term and long term
  • Higher evaluation scores for the presentation from participants (2-8)

Talking Equals Learning: Listening Rarely Does

These are outcomes we all seek as instructors, but yet we find it hard to believe that if we talk less our students will learn more. We have a difficult time giving up the podium. C. Bland Tomkinson says it well, “Cover less, discover more.”(9) In other words, it is wise to talk less and plan for pauses—opportunities for students to do some of the talking, because only when they share in the talking are they truly learning.

Herman has it figured out.

Herman, a student at school is looking up at this father saying: "They don't give us time to learn anything in school; we have to listen to the teacher all day".
Herman © 1977 LaughingStock International inc. Reprinted by permission by ANDREWS MCMEEL SYNDICATION for UFS. All rights reserved.

Pauses Are Important—Particularly at the Start, Middle, and Close of the Lesson

One small change in our teaching can lead to big changes in learning. A great way to try a small change is to insert an occasional pause into our lectures. In Part 2 of this blog post, we will examine characteristics of good pauses throughout the learning experience and we will see what the literature tells us about what constitutes a good starting pause, as well as a good middle pause, but let’s focus on closing pauses for now. Chip and Dan Heath (10) suggest that teachers can create memorable, meaningful moments by paying attention to endings—if something ends well, we tend to let that ending represent the entire experience. What we are discovering is that when we pause at the end, we can create these moments that will “add extra oomph into a lesson,” (11) or reverberate for hours after the lesson.(12)

Power of a Good Closing Pause: Get Students to Commit

Finley’s “extra oomph” will only happen when learners create and share their own meaning of the lesson. They must do more than merely think about it. If we seek behavior change, we will give students opportunities to make public commitments. We hear from motivational speakers and life change specialists that it is important to not only think about but also write or speak of our goals. An important study highlights this idea. Nearly 300 adults were asked about goals they had for the near future—things like losing weight, buying a house, selling a car. Some were asked to write down their goals. Others spoke to a partner about them and others were encouraged to simply think about their goals. After one month, the participants reported on their results. Those who had written down or spoken about their goals achieved those goals at a significantly higher rate than those who had merely thought about them.(13) This has such importance for us as instructors wanting to bring about significant change in our students. Why would we let them leave our classrooms or laboratories without tapping into this important strategy? Let’s get them to commit to more than just thinking about what they have learned. Let’s encourage them to write or talk about what they will do with what they are learning. In so doing, we not only increase retention, but we create the conditions for action. Those last few minutes of class are so powerful that we cannot afford to waste them with our summaries. Our students’ own written and spoken summaries and their ideas about how to apply their new knowledge —public commitments—will create memorable classes but also life-changing behavior change.

Questions We Can Ask in Closing

Writing or speaking answers to these kinds of questions will help students to create powerful endings:

  • What is one thing you learned today?
  • What concepts or insights were important to you from class?
  • What did you understand better after today’s class?
  • How would you summarize today’s class for someone who wasn’t here?
  • What will you do differently as a result of being in class today?
  • Why are you glad you were here today?
  • How will what we discussed today affect your professional or personal success?
  • What is your action plan after being here today?

Characteristics of a Good Closing Pause

These kinds of questions, posed at the close of learning, will contribute to an ideal closing pause, which may accomplish one or more of these goals:

  • Review content
  • Require personal reflection—develop new insights
  • Celebrate accomplishments
  • Motivate action/follow up
  • Bring full circle and create a bookend(14)

James Lang, in his article, “Small Changes in Teaching: The Last 5 Minutes of Class,”(15) gives a good example of bringing full circle. At the beginning of class give students a few questions that you plan to address. Then at the end, have them take a look back at the questions and share how their thinking has developed.

Examples of Closing Pauses Making a Difference

An image of the cover of Gail Taylor Rice's book "Hitting Pause"
Here is a good example of reviewing, reflecting, celebrating, and motivating. One of my colleagues looked for a powerful way to pause at the end of a workshop she presents to health professional students on the importance of being sensitive to the challenges of aging when they are providing care to patients. She has the students go through a series of activities, like putting Vicks in their nose and then trying to identify tastes or smells or putting a brace on their leg so it won’t bend and then trying to get in and out of an automobile. This was followed by a lecture/discussion. To close, she gave each student a sticky note on which they were to respond to the question, “What is the one thing you do not want to forget from our time together today?” Students completed their responses and then brought them to the front of the room. Finally, students were asked to select one of the sticky notes that best summarized all of the rest of the notes. The one they selected said, “I will never rush an old person again.” The student who had written this was applauded and given a small award.(16) It is hard to imagine any of the students present that day ever forgetting that class or the take-home messages they had publicly shared. I am sure that the closing pause resulted in at least one individual present who has never rushed an elderly patient since.

How many times have we taught classes with powerful messages but we lost much of the potential power of that class because we failed to provide that closing pause which asked the question, “What is the one thing you don’t want to forget from our time together today?” Because we didn’t ask it, students didn’t think about it and quickly forgot most of what we had hoped to achieve during our time together.

A Suggestion for the Basic Science Instructor

Here is an idea for our instructor of the large basic science class. During the last few minutes of class, she might ask students to write a multiple-choice exam question over the topic, share it with a neighbor, improve each other’s questions, write their names on the back of the card, and turn them in—with the promise of bonus points for each if a question is used on an upcoming exam. This would give them an opportunity to review the content of the hour, a chance to connect with a classmate, and an exciting opportunity to earn some recognition and a bonus point or two.(17) This pause is particularly well-suited for a content-heavy class, as it provides students with opportunities to review. It seems that this immediate review has advantages over the more typical review done some time later when students pull out their notes to prepare for the upcoming exam. When students review frequently during a class—most suggest every 15-20 minutes, but at least, at the close—retention is improved, both short- and long-term.

Importance of Keeping Pauses Fresh

Not only is it important to give our students those last few minutes of class to make meaning for themselves. It is also worth taking the time to change things up—to avoid becoming too predictable. We professors do tend to get into ruts fairly easily, and a minute paper every class period will get old quickly. Research supports the fact that the brain pays more attention to what is new or different than what has always been the same. So it is worth looking for different ways to help students review, value, and plan at the end of the learning session.

Students leaning over a table looking at various papers and notes discussing ideas
Help students find personal connections to new material with memorable pause activities before the end of class time. [Image: Public Domain]

Sources for Ideas for Closing Pauses

There are a number of creative and fresh ideas for closing learning with a meaningful pause. Hitting Pause: 65 Lecture Breaks to Refresh and Reinforce Learning, provides stories of closing pauses in chapters 5 and 7 and gives 26 closing pause ideas in the appendix. (See discount offer from Stylus Publications, LLC, below). The book also cites a number of websites for additional ideas.

Conclusion: We all hope that our classes have life-changing effects on our students. But the reality is that this rarely, if ever, happens. Every class period is largely taken up with lecture—lecture without any breaks or pauses—lectures which are pretty much like all of the previous lectures. Lang suggests that improving teaching requires minimal changes to our lecture plans and yet has the power to boost the learning in substantive ways. Perhaps if we focused on creating oases of silent, powerful pauses during those last few minutes of class, we might transform our classes into unforgettably meaningful experiences.

Stay Tuned

I’ll be back on the Noba blog soon with a follow-up post focused on the why and how of creating good Starting and Middle pauses.

Bio

Dr. Gail Rice is a professor at Loma Linda University, where she directs faculty development for the campus. She teaches for the Harvard Macy Institute for Education in the Health Professions in Boston and the USC Keck Medical School Innovations in Medical Education conference. She presents for organizations and campuses worldwide and has published books and articles for peer reviewed journals on various topics relating to creative, effective teaching in higher education. Her most recent publication is Hitting Pause: 65 Lecture Breaks to Refresh and Reinforce Learning, published by Stylus Publications. Gail and her husband, Richard, have devoted their lives to finding fresh and effective ways to teach university students.

You can contact Gail either through her website - www.drgailrice.com , or by email - [email protected]

Hitting Pause: 65 Lecture Breaks to Refresh and Reinforce Learning - Book Discount

Pauses constitute a simple technique for enlivening and enhancing the effectiveness of lectures, or indeed of any form of instruction, whether a presentation or in an experiential setting. This book presents the evidence and rationale for breaking up lectures into shorter segments by using pauses to focus attention, reinforce key points, and review learning. It also provides 65 adaptable pause ideas to use at the opening of class, mid-way through, or as closers.

For 25% off Hitting Pause, follow the link below and use code HP25 when ordering.

https://sty.presswarehouse.com/Books/BookDetail.as...

Offer expires 12/31/2018.

References

1.Marken, R. (2008) Silences. Ottawa, Ontario, Canada: Council of 3M National Teaching Fellows of the Society of Teaching and Learning in Higher Education, p 115.

2.Ruhl KL, Hughes CA, Schloss PJ. 1987. Using the pause procedure to enhance lecture recall. Teach Educ Spec Educ. 10:14–18.

3.Ruhl KL, Suritsky S. 1995. The pause procedure and/or an outline: effect on immediate free recall and lecture notes taken by college students with learning disabilities. Learn Disabil Q. 18:2–11

4.Stuart J, Rutherford RJ. 1978. Medical student concentration during lectures. Lancet. 2:514–516.

5.Lukas W. Richards, Amy T. Wang, Saswati Mahapatra, Sarah M. Jenkins, Nerissa M. Collins, Thomas J. Beckman & Christopher M. Wittich (2017) Use of the pause procedure in continuing medical education: A randomized controlled intervention study, Medical Teacher, 39:1, 74-78, DOI: 10.1080/0142159X.2016.1230664

6.Ghorbani, A and Ghazvini, K. 2016. Using paper presentation breaks during didactic lectures improves learning of physiology in undergraduate students. Adv Physiol Educ. Mar;40(1):93-97. Pubmed/26873895.

7.Zhang, N, Henderson, CN. 2016. Brief, cooperative peer-instruction sessions during lectures enhance student recall and comprehension. J Chiropr Educ. 2016 Oct 30(2):87-93. Pubmed 26967766.

8.Bachhel, R., Thaman, RG. 2014. Effective use of pause procedure to enhance student engagement and learning. J Clin Diagn Res. 2014 Aug 8(8)XM01-XM03. Pub med/25302251

9.Tomkinson, CB. 24 May 2018, [email protected]

10.Heath, C., Heath, D. 2017. The Power of Moments. New York, NY: Simon and Schuster.

11.Finley, T. 2015. 22 powerful closure activities. Retrieved from www.edutopia.org/blog/22-powerful-closure-activiti...

12.Lucero, R. 2017. Closure activities: making that last impression. Retrieved from tilt.colostate.edu/teachingResources/tips/tip.cfm?tipid=148

13.Matthews, G. (n.d.) Study focuses on strategies for achieving goals, resolutions. Retrieved from www.dominican.edu/dominicannews/study-highlights-strategies-for-achieving goals.

14.Lutsky, N. 2010. Teaching psychology’s endings: The simple gifts of a reflective close. In D. S. Dunn, B. B. Beins, M. A. McCarthy, & G. . Hill IV (Eds), Best practices for teaching beginnings and endings in the psychology major: Research, cases, and recommendations (pp. 331-349). New York, NY: Oxford University Press.

15.Lang, J. 2016. Small changes in teaching: The last 5 minutes of class. The Chronicle of Higher Education. March 7, 2016.

16.Rice, G. 2018. Hitting Pause: 65 lecture breaks to refresh and reinforce learning. Sterling, VA: Stylus Publications, LLC. (Sticky Note Closure, CP #45).

17.Rice, G. ibid. (Exam Question Challenge, CP #58).

The Beginning of the Semester: The perfect time to talk about the end of the semester

August 30, 2018

By Robert Biswas-Diener

@biswasdiener

Students often don’t seek help until it’s too late. Encouraging “preventative problem solving” may help.

Anyone who has been an instructor for even a single term can point to specific formative moments that influence their teaching. It may be the first time you catch a student cheating or a time a student gave you a thank you card. Perhaps it was the first time you said “I don’t know” in answer to a question or a time when an activity went perfectly. In my tenure as an instructor I accumulated many such moments.

One of them stands out acutely. I was teaching Social Psychology at Portland State University. Because of classroom constraints the course was held in the school’s old and uncomfortable movie theater. There were, of course, no windows, the seats could not be moved, and the projection of my class slides was of preposterous proportions. Despite these challenges my class was engaged, curious, and enjoyable. One young man—a foreign student from Kenya—attended regularly and paid attention. Then, toward the end of the term, he just quit showing up. I didn’t see him for the last two and a half weeks, including the day of the final. As I left the movie theater that last day with my bundle of completed exams in hand, the young man approached me on the sidewalk. It turned out that his brother had died several weeks before and he was grieving. The sudden loss has interfered with his studies and he pleaded—in a way that will be familiar to seasoned instructors—for “extra credit or any way to make up missed assignments.”

This episode revealed two insights to me. First, that students often view courses in terms of credits and points. This might sound obvious, but I—myself—never thought in this fashion. I always thought of my college courses in terms of the volume of learning; a yardstick for educational success that had only a modest correlation with test scores, grades, and extra credit. The second insight-- and the more important one—was the idea that students tend to deal with academic problems too late to be effective. This hypothesis was proven time and again as students came to me after missing huge amounts of class and assignments. I’ve had students show up on the last day of class, after missing virtually the entire course, pleading for consideration in order to save their scholarships, their GPAs, or their on-time graduation.

Person crossing out the word “Problems” and replacing it with a word “Solutions” in chalk on a blackboard.
Solutions Focus [Marco Verch. https://goo.gl/f6JtRt https://goo.gl/MpPBBM]
As a result of my experience with this young man, I changed my first day policy. Like most instructors, I use the initial class session to cover the syllabus. My students and I discuss norms and expectations, course content, technology and grading policy. And I throw in this piece of advice:

“There are 100 of you in this course. I know from past experience that some number of you— perhaps 10—will suffer some hardship this term. Maybe it will be a prolonged illness, or the death of a family member, or some other unforeseen event that legitimately interferes with your ability to study well. For some people, getting a little behind can be paralyzing. Then, the further they get behind, the more powerless they feel. I know that it is easy to feel guilty and crushed and desperate. Instead of that, here’s what I want you to do: I want you to remember this conversation. When some set back happens—and it might—please come see me immediately. You and I both want you to succeed and this is the best way to do that.”

I cannot, of course, generalize about the effectiveness of this policy. I can, however, tell you that, in my experience, it appears to be fruitful. Students routinely seek me out in the middle of the course for additional help. Their stories vary from the practical (I had to sell my car to pay for school and getting here is difficult for me) to the emotional (I got divorced). In each case, however, it is encouraging to see the students take charge of their educational destiny and I do my best to accommodate this effort.

One final note on the potential wisdom of preventative problem solving. It can also be used to effectively convey self-care information at the beginning of the term, before it is needed. We know that during the stressful period of mid-terms and finals, student health behaviors fall apart. They drink more coffee and alcohol, exercise less, sleep less, and engage in personal hygiene less. Pretty much exactly the opposite of what you would recommend for effective learning. The beginning of the term is the best possible time to encourage good diet, sleep and exercise. It reinforces information they are already receiving from other campus offices. Unlike many of those materials, however, your words can be more impactful than an e-mail or a poster. The students have a relationship with you, respect you (hopefully), and have frequent contact with you. Your encouragement also arrives before they need it and when they are most likely to be able to hear the message and build the health habits required.

Summary of preventative problem-solving advice I give to students:

  • If a major setback befalls you, come see me IMMEDIATELY so that we can address it together
  • Build health habits now so that they will be in place during the more stressful parts of the term
  • Don’t let exercise or sleep be the things you give up during exam periods; they are likely as important to your grade as are study sessions


Bio

Dr. Robert Biswas-Diener is the senior editor of the Noba Project and author of more than 50 publications on happiness and other positive topics. His latest book is The Upside of Your Dark Side.

Turning Students Into Scholars by Reducing Resistance to Learning

August 8, 2018

By Anton Tolman & Trevor Morris

Anton Tolman: I remember a moment, several semesters ago, in my Abnormal Psychology course. We were exploring diagnostic issues related to personality disorders. A student raised his hand and asked a relevant question. I paused, and because I wanted the class to apply the integrative biopsychosocial model we had been using all semester, I returned fire with a follow-up question, pushing them to think about the issues involved. In response, one student got an incredulous look on her face and with a come on, really? voice said out loud, “Why can’t you just answer the question?” 

I was surprised by this reaction. This was a normally good student overtly pushing back against my pedagogical approach. However, instances like this are not unique to my classes. “Student resistance” happens all the time, in all kinds of classes, whether we recognize it as resistance or not, and it is especially common in courses that emphasize active learning. 

. . .

Why is this important? As John Tagg in the forward to our book Why Students Resist Learning (Tolman & Kremling, 2016) wrote so well: 

The irony is blatant and really quite agonizing if we dwell on it. What works to get students to learn, to learn resiliently, to learn what they can use and when to use it, is something students do not naturally like nor are necessarily drawn to. They fight what is good for them. We have the cure for what ails them, but they resist the treatment. (Tagg, 2016, p.ix). 

The implications of resistance are far-reaching. When students resist course activities and assignments or put in minimal effort, they are not learning content nor are they building critical skills. Worse yet, they see resistance as necessary, a response to external demands instead of recognizing their own responsibility to learn. In a very real sense, student resistance threatens the purpose of education and its value to a civil society. The good news is that by understanding its sources, we can proactively address them, reduce resistance in our classes, improve learning, and enhance the joy of teaching. We’ll share some ideas of how to assess and intervene to lower student resistance. 

I Don’t Have Resistance in My Classes…..or Do I?

We would argue that it is fairly easy for faculty to not recognize resistance when it happens, for a variety of reasons. One of these is that the teaching literature has not really addressed this issue head on. Most of the time resistance is mentioned or described with lists of proposed reasons why students are behaving this way but lacking a coherent definition. So, we decided to propose one:

Student resistance is an outcome, a motivational state in which students reject learning opportunities due to systemic factors (Tolman & Kremling, 2016, p.3).

This definition is useful because it describes resistance as the outcome of interactive systemic factors -- in other words, it can be understood; it results from known, inter-dependent factors that can be assessed and for which interventions can be planned. 

Trevor Morris: I think I develop good rapport with my students. Their feedback is generally positive. I work to reduce resistance by explaining to them the rationale for the pedagogical methods I choose. As a result, I would classify resistance in my classes as low. 

However, student resistance can arise at any time even for faculty who do not often see it. For example, I had been using Eric Mazur’s peer instruction technique for three semesters. Students used clickers to respond to a question and then discussed it before answering again. Early on in the new semester, I explained the technique and how it has an impact on learning. But after a couple of class periods a student insisted that she couldn’t use the clicker because it caused her too much stress. Not only that, she had recruited another student to her position! I tried again to explain my reasons for using this particular technique, but to no avail. They insisted that I make accommodations for them because they wouldn’t be using clickers. 

. . .

Trevor’s example illustrates active student resistance, but resistance can come in many different forms, not all of them easily identified. Instructors are likely to dismiss active resistance as due to ego, perfectionism, entitlement, or other internal explanations. But as psychologists, we should recognize this as the Fundamental Attribution Error (FAE). To get past this common human foible and understand the deeper reasons for resistance requires a conceptual framework – an alternative way to understand and explain what is happening. Take a look at the Student Resistance Matrix.

We believe that resistance stems largely from two motivational sources: students are trying to protect themselves, to “get through” the class without taking too much damage, or to get grades to secure their future goals; alternatively, they may be “pushing back” against the teacher or a system that they believe is trying to force them to change who they are, or to adopt a set of ideas or a worldview they disagree with. This can include student perceptions of negative elements of societal power that often are embedded in our institutions or in our own thinking such as sexism, racism, and other -isms. Resistance can also take active or passive forms. 

While our two examples in this essay are active, it is even easier to dismiss passive resistance as student laziness or lack of interest. However, this should set off our FAE red-alert lights again. The situation is more complex than these easy-to-jump-to conclusions. The Student Resistance Matrix is the first step forward – it helps us recognize when resistance is occurring. It tells us that student resistance occurs for a reason – it has a purpose and a goal. It is a communication SIGNAL. Students are telling us something by these behaviors, and once we realize that, we can begin to figure out what is happening and how to reduce resistance to open up student motivation to learn rather than to resist. 

Systemic Forces

As noted in the definition of student resistance, these behaviors are the outcome, the result, of interactive systemic forces. Looking broadly across the pedagogical literature, we identified five systemic factors that usually interact to produce student resistance, each making their own contribution. We call this the Integrated Model of Student Resistance (IMSR):

As you can see in the graphic above, the IMSR consists of five interacting elements. We will skip the “institutional culture” element which shapes and influences both environmental forces and educational experiences because we want to focus primarily on interactions in the classroom. Here is a brief description with an example of the other four elements of the model. As you read these, consider how these forces would interact as well as shape both passive and active forms of student resistance in class.

1. Social and Environmental Forces: These include many different aspects of familial and social forces that shape student expectations about education, influence their thinking about the amount of effort that is “reasonable” to use in learning, and that contribute to student stress and sense of alienation in our classrooms. 

Example: Imagine a first-generation or immigrant student who is struggling to feel comfortable on campus; then a family member becomes ill, and she believes her primary moral obligation is to help her family rather than to study or turn in homework.

2. Negative Prior Experiences: Students do not come to our classes as blank slates. They bring with them their own histories of previous educational encounters with institutions and teachers; unfortunately, for many students these previous interactions have been negative and shape what students expect of their teachers and influence how they interpret and react to instructor behaviors. In our book (Tolman & Kremling, 2016), there are also stories of how instructor misbehaviors and lack of interpersonal attention and warmth towards students also has significant negative impact on student expectations and motivation to learn. Even though you may believe you are supportive and careful in your teaching, your students may bring with them the wounds of these prior experiences. 

Example: In the book, a student describes a history of painful interactions in elementary and middle schools (including being told she had a “dumb math brain”) that convinced her that she was academically incompetent and unable to succeed; it took her years and many experiences to convince herself that she was capable of success and to enter higher education. Imagine such a student in a class with an instructor who, for good reasons, is encouraging students to stretch beyond their comfort zones and to take risks.

3. Cognitive Development: Multiple scholars have documented the developmental paths in adult cognition that shape how students see the world around themselves and their view of the purpose and goals of education. At lower levels of development, students tend to be very concrete and believe that the goal of education is to learn “the right facts” and tend to be focused less on skill development and critical thinking and mostly on memorization and acquisition of factual knowledge. Students can make progress and develop, but it can take time as well as scaffolded and supportive experiences for this to happen. 

Example: Imagine a student who believes the instructor’s role is mostly to convey and describe important facts and concepts in a field being asked to work in collaborative projects with other students he views as being as ignorant as himself; he is likely to view the teacher as abdicating their proper role to teach.

4. Metacognition, or the Lack of It: Many students come to our classes with little awareness of study strategies or what produces better learning. Hopefully, they learn basic study skills in middle or high school, but many never progress beyond memorization. Even in higher education, students may learn some more effective study strategies, but they often do not transfer these skills to other courses. Thus, if they struggle in classes that are more demanding or that require them use critical thinking skills, they frequently see the problem not as their own fault, but as lack of competence by the instructor. 

Example: Imagine a student who mostly succeeds in school by doing exactly what the instructor asks and has honed efficient methods for memorization. She then takes a course requiring analysis of case studies and the use of problem-solving methods to solve complex cases. The exams use applied questions, and she finds herself consistently performing below her own expectations.

In addition to understanding each of the areas of the IMSR, it is helpful to consider how these elements interact. Consider a student entering school with consumerist expectations (learned at home or from others), who is also lower in cognitive development, unaware of his own mastery level with regard to important learning outcomes, and who has a history of being praised for quick memorization of vocabulary and definitions in the past. Now imagine that student entering a course where the rules are different, where collaboration and active participation are required, and where course objectives include demonstration of effective communication and problem-solving skills. Hopefully, the IMSR provides teachers with a lens on these important elements that contribute to resistance. To some degree, each student’s resistance is their own, but it is fairly common that there will be patterns across many students in a course of how these elements interact, depending on the nature of the institution, the schools that provided prior instruction to students, and the demographics and cultural elements of the region. 

 Getting Started

You’ve probably heard the question, “How do you eat an elephant?” The answer is “One bite at a time”. While we do not advocate consumption of pachyderms, this approach has some merit. Once an instructor begins to understand that resistance, both passive and active, is a signal and not noise, has begun to determine the motives that drive it, and uses the IMSR to determine what is causing it, the next step is to do something about it. The question is where to begin, and the answer is that it will vary with each instructor.

One idea is to begin where you can. It begins with understanding the signal the students are sending – and that signal may be different depending on the instructor, the course itself and where it fits into the major program, the student population, and other factors. Consider the course(s) you are teaching and given what you have determined about the sources of resistance, identify a target for change. This may involve redesign of the course, identifying new objectives, or better aligning assignments and assessments to those objectives or changing assignments to better develop and scaffold new skills; in another class, it might entail beginning the semester by involving students in discussions about the value of the pedagogy and how it will help them achieve their professional and personal goals (see Smith, 2008 for some ideas); another class may involve directly addressing concerns about stereotype threat and working to build support for open discussions from all perspectives, and so forth.

Consider the IMSR as a tool for intervention, not just assessment. Is the largest source of resistance coming from negative experiences students are bringing with them? If so, enhancing your relationship with students, being open and asking for their input and experiences may be very valuable. If it is lack of metacognitive awareness, consider using brief metacognitive tools, reflective assignments, and explicit instruction in how to succeed in class as key pieces to enhance student learning. (See the appendix of Tolman & Kremling, 2016 for some examples).

Learning to effectively and usefully address student resistance is a learning process for the instructor as well as the students. The more practice we gain at seeing resistance and using the IMSR, the more we are able to respond constructively. You don’t have to address all areas of the IMSR at once; resistance is a systemic outcome. This means a couple of important things: the system itself will resist change – systems tend to establish homeostasis and try to remain stable. On the other hand, by intervening at one strategic point, you can begin to influence the whole system; as you gain understanding and experience and have significantly addressed one part of the IMSR, you can shift to another and increase your success. One bite at a time.

We believe that student resistance is one of the major sources of frustration and burn-out for those who teach. The more we learn to reduce our students’ resistance to learning, the more joy and engagement we experience as teachers. We also help students develop into more responsible, actively engaged scholars in our classrooms. They begin to see the value of education more clearly in their lives, and we all improve as learners.

Additional Resources

For those who want to learn more about how to identify and overcome student resistance, the book Why Students Resist Learning is worth investigating. Available from Stylus Press, it can be purchased through the end of 2018 at a 20% discount by using code WSR20.

Bios

Anton Tolman received his degree from the University of Oregon (go Ducks!) and is Professor of Behavioral Science and former Director of the Faculty Center for Teaching Excellence at UVU. His research interests focus on classroom power dynamics, metacognition, and student resistance. He and his wife live at the feet of beautiful Mt. Timpanogos in Utah, and he is a strong advocate for the value of board games in bringing joy to life. Anton can be reached at [email protected]

Trevor Morris received his Master’s degree from Palo Alto University. He has taught as an adjunct faculty member for the Behavioral Science department for over six years. He is a Faculty Development Specialist for the Office of Teaching and Learning at UVU, and he has worked in faculty development for over seven years. Trevor can be reached at [email protected]

References

Smith, G.A. (2008). First day questions for the learner-centered classroom. National Teaching and Learning Forum, 17(5), 1-4.

Tolman, A.O. & Kremling, J. (2016). Why Students Resist Learning: A Practical Model for Understanding and Helping Students. Sterling, VA: Stylus.

Tagg, J. (2016). Foreward. In A.O. Tolman & J. Kremling (Eds). Why Students Resist Learning: A Practical Model for Understanding and Helping Students. Sterling, VA: Stylus. 

Stop Wrestling, Start Dancing: Supporting Student Success with Motivational Interviewing

July 31, 2018

By Jeni Dulek

@DoctorJeni

Brian is a first-generation college student with a family, full-time job, and a history of starts and stops in his community college education. He’s enrolled in four classes this semester—one of which he’s already failed once—and just a few weeks in, he’s already behind. He struggles to come to class on time—and sometimes doesn’t come at all. He skips assignments here and there, never the larger term projects, but he has missed enough of the formative assignments that his instructor is concerned about his progress. When she emails him about it, he doesn’t respond. When she attempts to discuss it with him after class, he shrugs and tells her he’s doing his best, but he’s got three other classes and a lot of things going on his life.

The Righting Reflex

Brian’s instructor knows a little about his life outside of school, but still can’t help question whether he’s truly motivated to learn. She recognizes that his failure to engage with her via email and in person is at least in part due to his hectic schedule, but she finds herself thinking, “If he really cared about school, wouldn’t he make the time to meet with me?”

Her thought process is a familiar one for me, and probably for many other college instructors, too. When we think about our students’ lives in relation to their educational goals and performance, so many of us start our thoughts with “You would think . . .”

You would think that low grades would cause her to come to office hours . . . join a study group . . . cut back work hours . . . show up to class on time . You would think that failing a class would . . .

You get the picture. As instructors we know what students need to do to be successful, if only they would heed our suggestions. When we do get a chance to speak with them about their performance in our courses, whether academic or behavioral, the temptation is to fill the conversation with these suggestions. This is known as the righting reflex, and while it’s certainly well-intentioned it’s often useless. Students don’t need to be told how to fix their problems; they need to find the motivation to change things for themselves. 

“But that’s what I’m doing when I offer them suggestions!” you may find yourself thinking. The problem is, students have likely already considered these solutions and found some reason or another why they won’t work. “Come to office hours? I have to get home so my wife can take the car to work.” “Comply with school dress code? I can’t afford the shoes you’re requiring me to wear.” “Cut back on work hours? I’ve already done that once and my boss said he’ll fire me if I cut back any more.” So in reality, you aren’t motivating students by offering these suggestions, just giving them a reason to argue against them.

Ambivalence

While change itself may happen quickly, getting ready to change takes time. Ambivalence is part of that “getting ready,” and it’s a normal human experience. “Should I change, or am I comfortable with the way things are?” we ask ourselves—about our careers, relationships, weight, and about nearly everything in life. We are constantly considering if doing something different would be possible, would help us reach our goals, or would make sense for us at this time. Sometimes we see many good reasons for change and we proceed; other times we decide it isn’t worth it, we aren’t ready, or we need to figure out a way to change in the future.

Our students are no different. One part of a student’s mind may want to change something about how he is going about school, but the other part argues against it. So when out of care and concern we approach a student with all the reasons why and how he should change, that part of the student’s brain that argues against change gets fired up and engaged. The student focuses on all the reasons why he can’t change, and stays stuck—sometimes failing a course, getting dismissed from school, or dropping out as a result.

Wrestling and Resistance

We often label this state of “stuck” as resistance, and in turn label the student who is experiencing it as “resistant.” We may experience our interactions as wrestling matches, with the student countering each move we make, seemingly entrenched in not allowing us to “help” him or her move forward. What we fail to realize here is that in attempting to provide the help, we actually caused the resistance by how we approached the conversation. Resistance doesn’t reside within the person but comes out of the interaction. This is good news—because we can’t control other people, but we can influence the kinds of interactions we have with them!

Motivational Interviewing

That’s where Motivational Interviewing, or MI, comes in. Simply put, Motivational Interviewing is a way of talking with people about change that can help resolve ambivalence and identify their own reasons to change. Notice that I said “talking with people” rather than “talking to” them. This is one of the key concepts in MI; it’s a collaborative approach that takes the instructor or counselor out of the expert role and recognizes that the student is the expert about his or her own life. Using MI leads to conversations focusing on the student’s perspective, beliefs, and desires rather than our own, and when it works, students make the arguments for change rather than against it; interactions become more of a dance than a wrestling match as the instructor allows the student to take the lead and matches his steps along the way.

MI originated in the 1980s as a technique used in the treatment of substance abuse, and since then has been applied and proven to be effective in many other situations requiring behavior change. I was originally trained to use MI with clients who have co-occurring mental illness and substance abuse, so when I started teaching in an occupational therapy program and encountered students who needed support in changing their behaviors, its practice immediately came to mind. I did some reading and found that it has indeed been researched in educational settings at both the K-12 and college levels.

Recent research has demonstrated the use of MI with helping students to make changes such as studying for exams (Reich, Sharp, & Berman, 2015), arriving on time to class, submitting assignments, participating in class discussion, improving compliance with policies, engaging in positive peer interaction, and seeking assistance from instructors and peers (Herman, Reinke, Frey, & Shepard, 2014; Rollnick, Kaplan, & Rutschman, 2016; Sheldon, 2010; White, Gazewood, & Mounsey, 2007). The best part for me as a busy instructor and program director is that most of these changes were demonstrated after just 15-20 minute interactions between students and instructors using MI.

Using MI with Students

MI not only can work quickly, it is fairly simple to learn. That doesn’t mean that it won’t take practice to master, but some basic knowledge and a willingness to try will set you on a path of dancing with your students toward change.

To establish that basic knowledge, let me introduce to you the spirit of MI and what are known as its “core skills.” I should point out before we begin that there are many other elements and skills useful in MI, including its principles and strategies. There are countless books, workshops, and other resources that can help you build your MI skills, and I encourage you to explore them. I will list a few at the end of this post for your reference. Keep in mind, too, that formal training in MI is available around the country and is well worth the investment. What I offer here should get you going in using MI and hopefully will spark your curiosity and passion to learn more.

The Spirit of MI

One of the primary things to keep in mind when learning and practicing MI is called “the spirit of motivational interviewing.” This sets MI apart from the more manipulative, sometimes pushy-salesperson-type approach that gets people to do things they don’t actually want to do. The goal with MI is to help clients resolve ambivalence so that they can take action toward their own goals and desires.

I’ve already mentioned collaboration, which is one of these vital aspects of the MI spirit. MI is done with and for students in a partnership toward change. It is not up to the instructor to tell the student what to do, but to guide the student in identifying the changes that he wants to make and figuring out how to make that happen. This shows respect for the student and honors the student’s expertise in his own situation and aspirations.

The second aspect of the MI spirit is acceptance. This key to MI means that while the instructor may not approve of the student’s choices or behaviors, there is a recognition that the student has strengths and a respect for the student’s autonomy.

The next consideration when using MI is compassion. This highlights the importance of helping students make changes that benefit them, not us. That’s not to say that the things we may help students change won’t be rewarding to us, but that we must focus on what our students choose for themselves, even if that means them making no change at all.

And lastly, we have evocation. The idea here is that students have within them the strengths and knowledge to be successful. While I recognize that there is always room to help students learn how to study more effectively, communicate more clearly, or present themselves more professionally, I know that my pre-MI attempts to cajole them into doing this got me—and them—nowhere. It isn’t until the student finds the motivation to make these changes that any advice I might give will be useful, so I choose instead to focus on helping my students evoke from within them exactly what they need to be successful. I look at ambivalence as the proof that students already have the arguments for change in their minds, and my role is to help bring these about so that students can use them to prompt action.

Core Skills of MI

Now that we have covered the spirit of MI, which will lay the foundation for you as you approach your students, you’re probably wondering “But what do I do? How do I know what to say in these conversations with my students?” That’s where the core skills of MI come in. They are: open-ended questions, affirmations, reflections, and summaries. As an acronym, this spells “OARS,” and they can be seen as the paddles that move your boat forward.

Open-ended questions are common in education, and have a pretty simple definition: Questions that can’t be responded to with a yes or no, but that require elaboration to sufficiently be answered. Asking something like,” What have you done in the past to keep up with your schoolwork?” can get students talking and sharing their perspectives rather than just agreeing (or disagreeing) with whatever their instructor has suggested. Asking open-ended questions of students helps them hear their own thoughts and to share them with you. This builds awareness and rapport.

Affirmations highlight students’ strengths and successes. They affirm for the student that he or she has been successful in the past and can do it again. An affirmation in MI shouldn’t come from you as the expert, but from what you’re hearing the student say about himself and his experiences. As an example, if a student responded to the open-ended question above by saying, “I used to have more energy to stay up late and get my homework done; sometimes I had to pull all-nighters,” I might respond by affirming the student’s dedication to his schoolwork, even if it seemed apparent that that wasn’t happening currently in my course. When students focus only on their struggles and problems in conversation, you might point out, “You’re talking with me today because learning is important to you.” Affirming students’ strengths and positive attributes helps to instill hope and generate motivation to try again.

The “R” in OARS stands for reflections, which is the most powerful of the core skills. Reflections of both content and feelings demonstrate that you’ve listened to the student and that you understand his perspective, and can help move the interaction forward by allowing the student to process what he has said. During conversation about improving in-class behavior, a student once told me all the reasons why her eye-rolling, arm-crossing, and sarcastic comments were justified. When I reflected these comments by stating, “Your instructor doesn’t deserve respect because she doesn’t know what she’s talking about,” she was taken aback, and went on to tell me several reasons why the instructor actually did deserve her respect. Pretty soon she was asking me to let her know if she ever demonstrated this behavior in the classroom again! That is how powerful a reflection can be. Good MI technique uses more reflections than any of the other core skills for this reason.

The last core skill is “S” for summaries, which are basically a collection of reflections. Summaries allow the instructor and the student to pause and reflect on what they have discussed, and to decide together what should happen next.   

Back to Brian

We began here by considering the case of Brian, a student struggling to come to class on time, skipping assignments, and dismissing his instructor’s attempts to reach out. Could a motivational interviewing approach have helped both Brian and his instructor explore and hopefully resolve this situation?

We don’t know much about how Brian’s instructor first approached him to talk about his performance, but if it was anything like how I used to approach my students, it was not with the collaboration, acceptance, and compassion that is the spirit of MI. Instead, it may have been something like, “Brian, you’re at risk for failing this class again. You’re not putting in the time you need, and you really need to work harder at this. You’re repeating the same behaviors you did last time, and that did not work out well for you. If you fail again, it’s going to cost you even more money and time. As your instructor, I recommend that you start getting to class on time and studying harder. You really need to pass this class.” With the instructor’s righting reflex, Brian’s defenses go up and he argues against change, sharing all of the reasons why these changes that she suggests are not possible—exactly the opposite of what the instructor intends and what Brian really needs.

With the concepts of MI in mind, the instructor’s approach moves away from the judgmental, authoritarian style that likely shut Brian down and caused him to shrug and say he was doing his best. Instead, motivational interviewing leads the instructor to partner with Brian to examine his situation and determine what, if any, changes he is motivated to make to improve his school performance. The goal is a conversation where Brian takes the lead in identifying his goals, strengths, and necessary actions, and the instructor simply guides him in this process:

Instructor: “I asked to meet with you today so we could talk a little about class. What are your experiences and thoughts about your performance so far?”

Brian: “I know I’ve been late a few times, and have missed a few assignments, but there’s just so much going on in my life right now. I’m doing the best I can.”

Instructor: “There’s some things getting in the way of you concentrating fully on class, and you’re doing everything within your power to focus on school.”

Brian: “Yeah. I mean, we only have one car between my wife and me so I have to drop her at work and the kids at school before I come to class. I’m working more so that we can buy another car, but that means less time for homework. I’m hoping to get another car next month, but until then, this is just the way it has to be.”

Instructor: “You’d like to focus on school more, and you plan to as soon as you’ve taken care of this setback with the car.”

Brian: “That’s the plan, yeah. School is important to me. I wouldn’t be doing all of this if it wasn’t. I would have withdrawn by now because this is really hard for me. And my family.”

Instructor: “You and your family are making many sacrifices for your education and a better future. What that means right now is that you may not get the grades you are capable of because sometimes you have to come late and miss assignments.” 

From here, they could go on to further explore what he had tried so far to address these barriers, but instead of focusing on these as reasons for his academic difficulties and reinforcing his belief that they are unchangeable, the focus would be on exploring how these issues align with Brian’s goals and steps that he might take to begin to change them. By reinforcing Brian’s strengths and highlighting his dedication to school even in the face of such barriers, the instructor could assist Brian to resolve his ambivalence and resistance, and begin to elicit motivation from within him to make changes to support his academic success.

Next Steps

My hope is that reading about Brian has helped you to examine your own views of student motivation and to see the possibilities of eliciting and evoking the motivation to change from within your own students. Just as in the sample interaction above, motivational interviewing has broadened my understanding of the challenges facing my students and has deepened my appreciation for the attempts they have made to focus on their learning, even when these attempts have not always resulted in success. It places the responsibility for change in the hands of my students while communicating my belief in them to find the resources and make and carry out plans to improve their likelihood of success. Changing my own approach to one of partnership and true respect has helped move interactions with students away from frustration and conflict to understanding and encouragement. The motivation that they have uncovered in the process has led to stronger communication skills, increased engagement, and improved academic success—and to dancing instead of wrestling.

Bio

Dr. Jeni Dulek is an occupational therapist, educator, and lifelong learner. She is a founding member and Program Director of the Occupational Therapy Assistant Program at American Career College in Anaheim, California, where she uses the motivational interviewing skills that she learned in clinical practice to help her students succeed. She holds a clinical doctorate in occupational therapy with an emphasis in education, and is currently pursuing a masters in instructional design and technology. In her free time, she enjoys reading, running, baking, and spending time with her family, friends, and rescue dog, Holly.

My professional portfolio: http://jenidulek.weebly.com

My MI page from my portfolio: http://jenidulek.weebly.com/motivational-interviewing.html

My MI playlist on YouTube: https://www.youtube.com/playlist?list=PLDckO-Sn0WlgsEtfRBNJYqwJ5MyMXmjEU

References

Herman, K. C., Reinke, W. M., Frey, A. J., & Shepard, S. A. (2014). Motivational interviewing in schools: Strategies for engaging parents, teachers, and students. New York, NY: Springer Publishing Company.

Reich, C. M., Howeard Sharp, K. M., & Berman, J. S. (2015). A motivational interviewing intervention for the classroom. Teaching of Psychology, 42(4), 339-344.

Rollnick, S., Kaplan, S. G., & Rutschman, R. (2016). Motivational interviewing in schools: Conversations to improve behavior and learning. New York, NY: Guilford Press.

Sheldon, L. A. (2010). Using motivational interviewing to help your students. The NEA Higher Education Journal, 153-158.

White, L. L., Gazewood, J. D., & Mounsey, A. L. (2007). Teaching students behavior change skills: Description and assessment of a new motivational interviewing curriculum. Medical Teacher, 29(4), 67-71.

Recommended Reading

Miller, W. R., & Rollnick, S. (2013). Motivational interviewing: Helping people change (3rd ed.). New York, NY: Guilford Press.

Miller and Rollnick’s book is the classic text on Motivational Interviewing, and covers all the basic skills and applications. This is highly recommended as a complete overview of the practice of MI no matter the setting or population.

North, R. A. (2017). Motivational interviewing for school counselors. (n.p.): Author.

Reagan North has self-published this simple and accessible book detailing the use of MI in a school setting. His focus is on working with high school students, but the application is the same no matter the population. Not only does North do an excellent job making the case for using MI with students, he offers very powerful examples of how it can be applied in this setting to help students foster change.

Rosengren, D. B. (2018). Building motivational interviewing skills: A practitioner workbook (2nd ed.). New York, NY: Guilford Press.

This is a very practical resource for learning to use MI, as it is a workbook designed for self-study. It includes very clear guidance and examples to follow, so if you’re ready to jump right in to learning and using MI, this is an excellent place to start, as it will cover what you need to know and will challenge you to apply this as you complete the worksheets.

Improving Study Habits and Test Scores with a “Learning How to Learn” Assignment

June 27, 2018

By Carolyn Brown-Kramer

A student ambushed me as I returned from the drinking fountain. “Hey professor,” he began, “I want to talk to you about my test grade.” He explained how carefully he had read and reread the assigned chapters, showed off his heavily highlighted textbook, and demonstrated his memory for the definitions on his flash cards. “I studied for twelve hours. How could I have gotten a D?” he finally concluded.

In reply to this all-too-common complaint, I asked, “What do you think about when you study?” He looked confused. I continued: “Do you ever think about how the content is related to other material or to your own life? Do you draw your own diagrams or make your own detailed outlines? Do you practice answering or writing test questions before you go in to take the test?”

The student was flummoxed. Why, he reasoned, would he need to do these things when rereading, highlighting, and flash cards had gotten him through high school just fine?

A tired college student sleeps with his head on his desk with his laptop nearby.
Unfortunately for our students, effort and time spent studying do not always lead to the results they want. But with the right kind of assignment, we can show them how to use that effort and time more effectively. [Image: Svein Halvor Halvorsen, https://www.flickr.com/photos/sveinhal/25338, CC BY-NC-ND 2.0]

The Problem

For years I’ve been trying to tell students about better learning strategies than the ones they’re in the habit of using. There are well-established guidelines for more effective strategies (practice testing, distributed practice, self-explanation, interleaving) and less effective strategies (summarizing, highlighting or underlining, rereading; Bartoszewski & Gurung, 2015; Dunlosky et al., 2013).

But as it turns out, there are two problems with this “tell them what they need to know” approach. First, it’s hard to reach the students who are most in need of a study habit tune-up, because relatively few of them come to see their instructors for help. (Check out Christie Cathey’s blog post for a neat way to address this issue: http://noba.to/fwevqhy7.) Second, those who do come in often seem to want a simple trick to fix the problem—something like, “Just read your book one more time” or “More flashcards!” In other words, just because students are introduced to better practices it doesn’t mean they will adopt them (Balch, 2001). If my suggested methods don’t meet their initial, low-effort expectations, they are likely to reject those suggestions and continue on with their current, ineffective strategies.

My Previous Attempts

I started trying to address students’ problematic study behaviors a few years ago. Each semester I teach Introduction to Psychology, I take time in the first week to introduce students to Stephen Chew’s excellent “How to get the most out of studying” YouTube video series). In class, we complete a version of Chew’s levels-of-processing demonstration (from video part 2 of 5) and follow up by watching the “Cognitive principles for optimizing learning” video (part 3 of 5). Students discuss the demonstration and video, we talk through it as a class, and the content is represented on the first exam to increase accountability and attention. I find that while many students can answer questions correctly about why spaced studying works and highlighting doesn’t, they often don’t take the next step of applying better learning strategies to themselves—hence the frequent conversations with students like the one above.

Dr. Chew stands in front of a board in a classroom with the word 'metacognition' written on it.
A still frame from one of the summer's blockbuster superhero movies starring Dr. Stephen Chew.

I also post a 1-page document on my course website called “How to be successful in this class” (available at https://drive.google.com/open?id=1wEzOtJzrOEAWG_7mjSjjxzOe8HK-IveK). The document presents evidence-based recommendations for increasing processing depth, spacing studying, self-testing effectively, and more. Sadly, many of my students who really need help with their study habits ignore this helpful tool.

In the fall of 2017, I decided to try a more in-depth way to show them. And it actually worked.

What I Did and Why I Did It

I implemented a learning strategy intervention sneakily disguised as a term paper assignment in my Introduction to Psychology class. I had four goals:

1. To increase students’ knowledge of psychological research methodologies via reading and writing about an empirical research article, as they always do in this class;

2. To improve students’ study habits via metacognition;

3. To improve students’ performance in the class as a result of their improved study habits; and

4. To do all of this without increasing the grading load—an important consideration for a class of 400-plus students.

I already had a paper assignment in which students read an empirical psychological research article and wrote a short paper summarizing and analyzing its methodology. In fall of 2017, all students read an empirical research article about two studies that tested a particular learning strategy. They then wrote a paper doing the same methodological analysis and critique as I used in previous semesters, and added a brief commentary on how they could apply the learning strategy to their own life.

Here’s the catch: There were actually four different empirical research articles, each covering a different learning strategy. Students were randomly assigned to read and write about one of the four articles. This allowed me to compare the effects of the assignment on students’ study behaviors and performance across the articles. All articles were matched for length, difficulty, and research design. The learning strategies included:

  • Distributed practice (Seabrook, Brown, & Solity, 2005, experiments 2 & 3)
  • Rereading (Rawson & Kintsch, 2005)
  • Repeated testing (i.e., the testing effect; McDaniel et al., 2011)
  • Imagery use (Schmeck et al., 2014)

Again, the idea was to see if getting students to read an entire research article about a learning strategy, making them think about the evidence underlying the strategy, and having them consider how it applies to themselves would convince them to change their studying behavior more effectively than the tactics I’d tried in the past.

Did It Work?

In a word, yes.

Because the paper assignment still focused on research methodology, as it always had, it met goal 1. Because it involved the addition of only one short section on how students could apply the learning strategy to their own life, it met goal 4. The big questions were whether it could meet goals 2 and 3.

Study habits

I surveyed students at the beginning and again at the end of the semester about their learning strategies (based on Bartoszewski & Gurung, 2015). Students used more high-utility practices (practice testing, self-explanation, interleaving, and use of keywords) and fewer low-utility practices (underlining/highlighting, summarizing, and rereading) at the end of the semester than at the beginning. Goal 2: Met.

Interestingly, there wasn’t much difference among groups in students’ use of the learning strategy they had been assigned to read about. For instance, students who read the article about the benefits of self-testing increased their use of self-testing and spaced practice, and also decreased their use of underlining/highlighting and rereading… but so did students who read the other three articles.

This suggests that, rather than making students reconsider their use of a particular study habit, the assignment primarily strengthened their metacognition about all their study habits—good and bad—and reminded them about how they should be studying overall.

Test performance

What about actual performance in the course? If students use better learning strategies as they complete course work and study, they should achieve better scores on exams. And that’s exactly what I found.

In order to see whether the new version of the paper assignment improved student performance, I kept the course as similar as possible to the previous fall semester— the same textbook, lectures, exams, attendance requirements, enrollment, and student characteristics—and varied only this one assignment. I compared student performance on the four exams from fall 2016 (control semester) to fall 2017 (experimental semester) when I introduced the learning strategies variation on the paper assignment.

Students were assigned the articles halfway through the semester in both courses. Scores on the first two exams—before the articles were assigned—were equivalent across semesters. Scores diverged on the third and fourth exams, however. Students in the experimental semester scored 3.7 percentage points higher on exam 3, and 2.6 percentage points higher on exam 4, compared to students in the control semester.

Perhaps more impressively, students in the experimental semester earned about 1/3 of a letter grade higher—an average of 80.9% (B-) in the experimental semester versus 78.9% (C+) in the control semester. The improvement was especially strong among underperforming students—the percentage of students earning Ds or Fs in the course dropped from 22% in the control semester to 15% in the experimental semester. I consider that a win for goal 3.

What about differences across learning strategy article conditions?

I compared exam scores across groups. Students who read about repeated testing did the best on average, beating the previous semester’s exam 3 and 4 scores by 7% and 4%, respectively. Students who read the article about distributed practice did the worst on average, performing no better than the previous semester’s students on exams 3 and 4.

Not surprisingly, the same pattern held for overall course grades: Students in the repeated testing condition did the best, earning about 5.5 percentage points higher overall (B vs. C+) compared to the previous semester. Students in the distributed practice condition did the worst, earning about 1 percentage point lower overall than those in the previous semester.

Surprises, Cautions, and Recommendations

A pretty easy tweak to the term paper assignment I’d been using for years actually worked. By substituting the research articles I had used in the past with articles about learning strategies, and by adding a short application section to the paper assignment, not only were students still learning about research methodology, but they were also gaining better study skills and earning higher grades on exams and in the course overall. There were, however, some surprises and bumps along the way.

Surprises

As mentioned above, students’ study habits improved pretty much across the board, regardless of which article they read. It seems that thinking hard about learning strategies encourages students to improve their studying, even if they don’t adopt the particular strategy they’ve been reading about.

It might be that reading in depth about certain learning strategies for their individual assignment influenced students to make better use of other strategies from Chew’s videos or the “How to be successful in this class” document. Introducing these resources early and then directing students back to them mid-semester as they reconsidered their study habits was very effective for my students.

Cautions

There are two important caveats I should mention based on my experience with this assignment. First, despite my efforts to select articles that were well matched on length and difficulty, students really struggled with the article on distributed practice (Seabrook et al., 2005). This article wasn’t as novice-friendly as the others because it was more methodologically complex and introduced several new operational definitions that students weren’t familiar with. Many students came away frustrated and confused by distributed practice because they misunderstood the samples and methodologies in the article—for instance, that distributed practice pertains only to young children, it can only be used in a laboratory setting, or it includes only studying in three 2-minute chunks throughout the day. Students who read the other three articles had a much stronger grasp on both the methodologies and the take-home messages of what they had read.

The second caveat is that my student evaluations of teaching (SETs) took a small but substantial hit in the semester I implemented this project. Compared to the control semester, my summary evaluations dropped about 1/3 of a point on a 7-point scale. This could be a concern for new faculty members or those whose departments or institutions scrutinize every small fluctuation in SETs. In my opinion, having slightly less happy students is a reasonable price to pay for a 2% improvement in overall course grades, and a 7% drop in the number of students earning Ds and Fs. In the future, I will try to manage student expectations and anxiety by talking about how I will grade fairly and consistently across articles, posting the rubric earlier in the semester, and breaking the assignment into smaller pieces so students have a strong understanding of their article before writing the paper.

Recommendations

Here are some suggestions based on my experience, which hopefully can help save you a lot of hassle as you encourage the adoption of high-utility learning strategies in your own classes:

  • Select one article with the greatest benefit, and have all students read it. Of the four articles I tested, I recommend Mark McDaniel and colleagues’ 2011 article on repeated testing. It produced the greatest benefit in terms of student exam and overall course performance, and is probably the most readable for first-year undergraduates. Choosing just one article will also curtail student concerns about grading fairness and consistency.
  • Talk about learning strategies early and often. My students respond positively to Stephen Chew’s videos, but often forget about them by the second exam. Return to the topic of learning strategies periodically, and get students to discuss why some study habits are better than others. You can easily incorporate this into your Intro Psych course material by talking about principles of human memory, reinforcement and punishment, and even belief perseverance (e.g., students’ persistent belief in the importance of matching their “learning style” with how a class is taught).
  • Incorporate self-reflection and planning. We all learn by making information self-relevant. By having students reflect on their current versus ideal learning strategies, and by having them make explicit plans for implementing high-utility strategies, they are much more likely to use what they’ve learned rather than treat it as just another academic paper. You can do this as part of a formal assignment, or as a journal or group discussion—whatever gets them thinking about what they do now, how they can do it better, and why they’d want to change.

High-utility learning strategies are valuable tools. As experts in learning, it’s our job to help students like the young man who ambushed me in the hallway—the one with the rereading, highlighting, and flash card habit—learn to use those more effective tools themselves.

Bio

Dr. Carolyn Brown-Kramer is an Assistant Professor of Practice at the University of Nebraska-Lincoln. A social psychologist by training, she teaches courses in introductory psychology, social psychology, advanced social psychology, and motivation and emotion. Outside the classroom, she loves food, music, reading, and spending time with her spouse and two young children. She is always on the lookout for good audiobook suggestions.

R – The Future of Psychology Statistics is Open Source

June 21, 2018

By Robert Franklin

Four years ago, I threw out everything I knew and changed how I taught statistics. I started teaching statistics using R, a free and open-source program used for statistical analysis. Previously, my students used other programs with point-and-click menus, which resembled spreadsheets where they entered data and selected their analyses from menus. But now I took the plunge into the world of teaching statistics using a program with typed commands, where there were very few textbook resources for help.

The logo of the open source statistics software "R".

Why did I take the plunge into teaching R? And why should you? The reason is simple: R is the future. I’m going to try to use this blog entry as a way to explain why we should teach R to undergrad psychology statistics students, and advocate for the development of free and open resources to help students learn, using R.

The field of statistics, especially how it applies to psychology, has reinvented itself in the last decade. Data science and data analytics are growing career fields as businesses and other organizations are increasingly using data in order to inform decisions. Interactive, informative, and beautiful data visualizations have now created a sub-field of journalism, as popularized by examples like Vox , FiveThirtyEight and The Upshot. These fields, which combine the data analytics of statistics and the theory of research methods, represent new opportunities for our students. Psychologists have been training students in statistics and research methods since long before “Data Science” became trendy, but our classes need to change in order to stay at the forefront of these changes.

A student-created statistics visualization representing concepts like probability distribution and regression analysis.
A 2017 Kantar Information is Beautiful Award winner created by a team of undergraduates at Brown University.[Image: Daniel Kunin, Tyler Dae Devlin, Jingru Guo, and Daniel Xiang, https://goo.gl/i4PFF5]

At the same time, a series of crises has changed how psychology research uses statistics. The basic theories taught in stats classes a generation ago, including null hypothesis testing, are increasingly under attack. In 2016, the American Statistical Association issued a statement designed to “steer research into a ‘post p< .05 era’”. In addition, the inability to reproduce basic research findings in psychology and biostatistics has led many, such as the Center for Open Science , to call for researchers to openly share data and findings in a way that allows for observers to reproduce statistical analyses.

These issues require many answers, and embracing R is a first step in revolutionizing psychology statistics. There are many advantages of using R. First, R is open source, so that it is free for anyone to download, use, and modify. Students do not need to visit computer labs or buy student versions of other software, which are expensive and often limited in what they can do. Because R is open-source and free to modify, over 10,000 free packages, or add-ons, exist to do any possible statistical technique, from complex visualizations to models. Almost any new statistical technique developed comes with a new package in R. This flexibility and power is why graduate programs in psychology are increasingly teaching in R.

Nonetheless, R is rarely taught in undergraduate psychology statistics courses. As part of a poster I presented in NITOP in January 2018, I found that of the sampling of fifty statistics syllabi I collected, only two undergrad courses used R. At the same time, the use of R has grown exponentially in psychology research, as indicated by citations in journal articles.

So why isn’t R popular in the undergrad classroom? R is a statistical programming language, using typed commands to enter data and do statistical tests. The downside is that this makes it hard for students to see the data and often leads to more errors from misspelled commands. Though there are add-ins to R that allow for point-and-click menus, such as R Commander, the command line approach is very powerful because it allows for students to learn good data practices incorporating reproducible data analysis from the very beginning of their training.

Another problem for adopting R is the lack of educational resources for teaching R in psychology statistics. Even though R is becoming more popular, very few of the most popular textbooks for teaching basic psychology statistics incorporate materials using R. Most of the educational resources for R are geared for students with a more significant math background, making it hard for students to apply the material. The lack of resources to teach using R, along with the inherent difficulty of teaching a command-line based approach, probably explain why R is not popular in the classroom.

There are a few good resources for learning R, such as Field’s Discovering Statistics Using R. In addition, many resources were featured in the May 2017 edition of the APS Observer. However, many of these resources are geared for advanced students, which underscores the necessity of developing undergraduate instructional materials for teaching R to psychology stats students. As part of a grant from the Center of Innovation in Digital Learning at Anderson University, I developed a freely-available open source textbook using R, which is available in a beta form on iBooks.

Cover of Dr. Franklin's statistics book titled, Statistics: The Story of Numbers

The final reason for teaching R is anecdotal. Students feel accomplished conducting analyses in R. The initial learning curve becomes a sense of accomplishment when students learn how to do their own command-line based analyses, edit their own scripts, and then apply this knowledge. Several of our students have commented how helpful this is in graduate work, where their knowledge of R has let them jump right into graduate research projects.

The use of open-source software in teaching statistics is both the future of psychology and in the spirit of the Noba Project and the broader open-education movement that aim to remove barriers to college. Though R is free, and as such reduces the financial burden on students, we need additional accessible and freely available materials to use R in the classroom. I encourage other teachers of psychology stats and research methods to contribute to this effort by looking into using R in the classroom, and creating and sharing open-source resources to teach R. I am open to any collaboration or initiative to help develop these resources, so please contact me if you have any feedback on the textbook or would like to collaborate on developing more resources.

Bio

Dr. Robert Franklin is an Assistant Professor of Psychology at Anderson University, in Anderson SC, where he teaches courses in neuroscience, statistics, and research methods. His research interests involve understanding how people read social information from faces and how aging affects these processes. His teaching interests involve student collaborations with research and spreading the good news about R. Robert is also co-author of the Noba learning module Attraction and Beauty. You can find out more at his website: rfranklin.netlify.com