The Elevate Blog banner: Real Classrooms. Practical Ideas. Higher Expectations. Three students climb a rocky ridge at sunrise, each pulling the next one up, toward a teacher reaching down to help.

Author: Clay Shumate

  • Summarizing Strategies for Grades 6–12: Why the Research Disagrees With Itself

    Summarizing Strategies for Grades 6–12: Why the Research Disagrees With Itself

    By Clay Shumate

    Summarizing strategies teach students to cut a text down to what matters: delete what repeats, delete what does not carry the argument, replace lists with the category they belong to, and state the main idea in a sentence. The research scores this skill at 0.82 and at 0.44 depending on which question it asks, and both numbers are honest.

    Key Takeaways

    • The two research literatures on summarizing disagree, and the disagreement is the useful part. Writing Next puts summarization at an effect size of 0.82, tied for the top of its eleven elements for grades 4–12. A meta-analysis of ten study techniques puts it at d = 0.44, tied for last.
    • They are measuring different outcomes. Writing Next measured the “completeness and accuracy of summaries” — whether students got better at the skill. The study-technique reviews measured whether summarizing helped students remember the content afterwards. A student can improve sharply at one while the other barely moves.
    • The low rating comes with an admission. One of the review’s own authors wrote that whether summarization works is “difficult to answer, as it has been implemented in many different ways”. That is a verdict on a messy literature, not on the skill.
    • Almost none of the study-technique evidence is about teenagers. In that ten-technique meta-analysis, 65% of participants were undergraduates and only 11% were secondary students — and 93% of the outcomes were surface-level, with 74% of post-tests taken within a day.
    • Summarizing is not one of the well-studied elements even in the writing research. Writing Next says only four of its eleven elements rested on ten or more studies, and summarization is not one of them. Its own authors warn that many of the effect sizes “differ only minimally.”

    What are summarizing strategies?

    Summarizing strategies are the taught procedures a student uses to reduce a text to its essential content in their own words. The common rule-governed version has four moves: delete information that repeats, delete information the main point survives without, replace a list of items with the category that covers them, and state the main idea in a sentence — using the text’s own topic sentence if it has one, and writing one if it does not.

    Writing Next describes the instructional approaches in this element as ranging from explicitly teaching summarization strategies to progressively “fading” models of a good summary, and notes that students can learn to write better summaries from either a rule-governed or a more intuitive approach. The four moves above are the standard rule-governed form. They are widely taught and widely attributed to a single early study; that paper sits behind a paywall and was not read for this article, so no citation for them appears here.

    Four numbered cards showing the moves that turn a retelling into a summary: delete what repeats, delete what does not matter, replace a list with its category, and find or write the topic sentence.
    Four moves. The third one is the move students skip and the one that proves they understood.

    The third move is the one worth watching. Deleting is easy and students will happily cut until a paragraph is three words long. Replacing “muskets, cannon and powder” with “weapons” requires a student to know what those three things have in common, which is a content judgment dressed up as a literacy skill. A student who can do it has understood the passage. A student who cannot will copy the list.

    Why does the research on summarizing disagree with itself?

    Because the two bodies of research are asking different questions and reporting the answers under the same word. One asks whether instruction makes students better at writing summaries. The other asks whether the act of summarizing makes students remember a text better. Those are separate claims and they have separate answers.

    Four rows explaining why summarization scores 0.82 in writing research and 0.44 in learning-science research, covering the different outcomes, populations and tests.
    Four differences that explain the gap. None of them is a mistake by either side.

    This matters because teachers get handed one number or the other depending on which professional-development deck they are sitting in. The literacy coach has the 0.82. The cognitive-science enthusiast down the hall has the low-utility rating. Both are quoting real research accurately, and the argument between them is not resolvable until somebody says out loud what each number measures.

    What does Writing Next actually say about summarization?

    That explicit summarization instruction produced a consistent, strong, positive effect on students’ ability to write good summaries, at an effect size of 0.82, in a meta-analysis of writing instruction for students in grades 4 through 12. That is the whole claim, and it is a solid one.

    Three pieces of context the 0.82 usually travels without. First, it is tied, not first: writing strategies instruction also scored 0.82, and the report orders the elements by average effect while warning that many of them differ only minimally. Second, the outcome measured was the completeness and accuracy of the summaries students produced — not their comprehension scores, not their retention, not their overall writing quality. Third, summarization was not among the four elements that yielded ten or more studies. Those were strategy instruction, word processing, the process writing approach, and writing-to-learn activities.

    None of that is a reason to discount it. It is a reason to quote it correctly: teaching adolescents to summarize reliably makes them better at summarizing, on a modest evidence base, by the report’s own accounting.

    What do the learning-science reviews say?

    That summarizing is one of the weakest of the common study techniques for remembering content. The widely cited review of ten techniques rated summarization low utility, and the meta-analysis that followed it up put the number at d = 0.44 across 234 effects — tied for last with underlining.

    A table ranking ten study techniques by effect size, with distributed practice at 0.85 at the top and summarization at 0.44 tied for last with underlining.
    Ten techniques, ranked. Summarization sits at the bottom, alongside underlining.

    The reasoning behind the low rating is worth reading rather than repeating. Writing for a general audience, one of the review’s authors said whether summarization works is “difficult to answer, as it has been implemented in many different ways”, and that it is unknown whether summarizing small pieces or large chunks of a text works better, or whether the length, readability or organization of the material matters. That is not a finding that summarizing fails. It is a finding that the studies were too heterogeneous to say.

    The follow-up meta-analysis adds the conditions. Summarization works better when assessments are performance-based or generative rather than closed or multiple choice, it “can require extensive training to use optimally,” and younger and less able students are not as good at it. Its headline finding across all ten techniques — that effects were much greater for lower than higher ability students — cuts in an interesting direction for a secondary classroom.

    And the limitation the authors name themselves is the one that should govern how any of this gets used: the majority of studies rested on surface or factual outcomes, with 93% of outcomes coded as surface-level and 74% of post-tests taken within a single day. They urge caution in applying the findings to deeper and more relational outcomes. A technique that looks weak on a next-day factual quiz has not been tested on the thing a history or science teacher actually wants.

    Does summarizing help students remember what they read?

    On short-delay factual tests, less than practice testing or spaced practice does. That comparison is the fair one and summarizing loses it. If the goal is retention of facts for a quiz, a retrieval activity is the better use of ten minutes.

    But the comparison most teachers are actually making is not summarizing versus retrieval practice. It is summarizing versus reading the chapter and hoping. On that comparison, d = 0.44 against a control is a real effect, and the same meta-analysis puts re-reading at 0.47 and underlining at 0.44 — which means summarizing is roughly as good at content recall as the two things students do by default, while also building a skill they are assessed on directly.

    The honest position: do not teach summarizing as a memory technique. Teach it as a comprehension and writing skill, and use spaced and mixed practice or retrieval when the goal is remembering. Different jobs, different tools, and a department that argues about which one is “evidence-based” is arguing about nothing.

    How do you teach summarizing in grades 6–12?

    Teach the moves on a paragraph before you ask for a page. Most summarizing instruction fails because students are handed a chapter and a word limit, which tests a skill nobody taught them. Seven steps, spread across a unit rather than a period.

    1. Start with one paragraph and a hard word limit. Fifteen words. The constraint does the teaching, because at fifteen words a student has to decide, and deciding is the skill.
    2. Model the deleting out loud, crossing lines out on the projector and saying why each one goes. A student who has never heard an adult reason through a cut assumes the right answer is to shorten everything evenly.
    3. Teach the category move on its own. Give three lists from the text and ask for the one word that covers each. This is the move that separates a summary from a retelling, and it deserves its own ten minutes.
    4. Show a bad summary and a good one side by side without saying which is which, and make students argue it. Writing Next describes progressively fading models of a good summary as one of the approaches in this element.
    5. Move from a paragraph to a section, then a chapter, raising the word limit proportionally. Expect the quality to drop each time the text gets longer; that is the skill being stressed, not lost.
    6. Make them summarize something they disagree with. A student who can restate an argument they reject has done the work that structured disagreement depends on, and the summary stops being a compliance exercise.
    7. Give the summary a reader. A summary written for a partner who missed class, who then has to answer a question from it, gets a quality of attention that a summary written for the teacher never gets.

    Budget more time than feels reasonable. The meta-analysis is explicit that summarization can require extensive training to use well, and a single lesson on it is the version of this that does not work.

    Why do students write retellings instead of summaries?

    Because a retelling is what you produce when you do not know what the point was. Writing down everything in order is the safe move for a student who cannot tell which parts matter, and it looks like effort, which is why it survives so long without being corrected.

    The tell is sequencing language: and then, after that, next. A summary is organized by importance; a retelling is organized by the order things appeared. When a student’s summary tracks the text paragraph by paragraph at a fixed ratio, they are compressing, not summarizing, and no amount of “make it shorter” fixes it.

    The fix is upstream. A student who cannot name the main idea cannot summarize, so the problem is comprehension wearing a writing costume. Go back to the text, ask what the author is arguing, and sort that out before asking for a summary at all. Reciprocal teaching runs summarizing as one of four rotating roles for exactly this reason — it puts summarizing next to questioning and clarifying rather than treating it as a standalone task.

    Which summarizing strategy is worth your time?

    The one matched to what you are actually assessing. A gist sentence builds the skill fastest; a one-sentence-per-section outline supports studying; a written paragraph is the only one that produces something you can grade against a writing standard.

    StrategyWhat students doTimeBest forMain drawback
    Gist sentenceOne sentence, hard word limit, per paragraph2–3 minBuilding the skill from scratchToo small to assess as writing
    Section outlineOne sentence per section of a chapter10–15 minA study artifact students keepSlides into compressing rather than summarizing
    Written summary paragraphA paragraph in their own words, under a word cap20–30 minAssessing against a writing standardSlow to grade; needs a rubric
    Headline and subheadWrite the text a news headline and deck5 minForcing a judgment about importanceRewards cleverness over accuracy
    Summarize for a partnerWrite for someone who missed it, who then asks a question10 minGetting real effortNeeds a class that will tell the truth

    How do you grade a summary?

    Against the two things the research actually measured: completeness and accuracy. Did the summary include everything essential, and is everything in it true to the text? Those two questions carry almost all the useful information and they are fast to apply.

    Add a third only if you are assessing writing rather than reading: is it in the student’s own words? Lifted phrasing is the most common way a summary looks complete and accurate while demonstrating nothing. Mark it, but mark it as a separate line, because a student can genuinely understand a passage and still default to the author’s wording. A single-point rubric handles this well — three criteria, one column of expectations, and your comments in the margins on either side.

    What not to grade: length. A word cap is an instructional constraint, not a standard. A student who nailed it in eleven words when you asked for fifteen has done the thing better, not worse.

    What goes wrong when you teach summarizing?

    • It gets taught once. The meta-analysis says the technique can require extensive training to use optimally, and the usual treatment is a single mini-lesson in September followed by eight months of being asked to do it.
    • The text is too long too early. A chapter summary is the final assessment of this skill, not the practice for it.
    • It is sold as a memory strategy. It is not a strong one, the research says so, and students find out quickly that summarizing the chapter did not help them on the quiz. That costs you credibility you need for the strategies that do work.
    • The category move never gets taught. Deleting is intuitive and superordinating is not, so students get the easy half of the skill and plateau there.
    • Nobody reads the summaries. A summary with no reader is a worksheet, and teenagers calibrate their effort to the audience accurately.

    Clay’s take: stop arguing about the number

    This is the clearest case I have run into of two honest research literatures being used to have a dishonest argument. One side quotes 0.82 and calls summarizing a high-impact strategy. The other quotes a low-utility rating and calls it a waste of a period. Neither side is misreporting. They are just answering different questions and not saying which.

    What I would want a department to agree on is narrower than either slogan. Teaching students to summarize makes them better at summarizing, on an evidence base the authors themselves describe as modest. Summarizing is a weak way to memorize content, on evidence that is mostly undergraduates taking factual tests the next day. Both of those can be true on a Tuesday, and they point to the same practical conclusion: teach it as a reading and writing skill, assess it as one, and use something else when the goal is retention.

    The part I would not give up is the category move. Making a fifteen-year-old find the one word that covers a list is a comprehension check disguised as a literacy exercise, it takes ninety seconds, and it tells you more about whether they followed the passage than a page of questions does. No meta-analysis has isolated that move, so that is my judgment rather than a finding, and it should be read as one.

    What to do next

    Pick one paragraph from the text you are teaching this week and run the fifteen-word gist. Model one, do one together, then let them try one alone, and spend the time you were going to spend on the rest of the lesson arguing about which cuts were right. Then do it again next week on a paragraph from a different section, because once is not instruction.

    If you are already teaching summarizing and it is not landing, check the category move before you change anything else. Give students three lists from the reading and ask for the covering word. If they can do that, the problem is the length of the texts you are assigning. If they cannot, the problem is comprehension, and no summarizing strategy will fix it.

    Frequently Asked Questions

    What are the main summarizing strategies?

    The standard rule-governed set has four moves: delete information that repeats, delete information the main point survives without, replace a list of items with the category covering them, and state the main idea in a sentence, using the text’s topic sentence if it has one and writing one if it does not. Classroom formats include gist sentences, section outlines, and written summary paragraphs.

    Is summarizing an effective learning strategy?

    It depends on what you want from it. For getting better at writing summaries, the Writing Next meta-analysis reports an effect size of 0.82 across grades 4 to 12. For remembering content, a meta-analysis of ten study techniques puts it at d = 0.44, tied for last, and Dunlosky’s review rated it low utility. Teach it as a literacy skill, not a memory technique.

    Why do researchers disagree about summarizing?

    Because they measure different outcomes. Writing Next assessed the completeness and accuracy of the summaries students wrote. The study-technique reviews assessed whether summarizing improved recall of the content, mostly on surface-level tests taken within a day, with 65 percent of participants being undergraduates. Both results are accurate answers to different questions.

    What is the difference between a summary and a retelling?

    A summary is organized by importance; a retelling is organized by the order things appeared in the text. The giveaway is sequencing language such as and then, after that, next. A retelling compresses everything at a fixed ratio, while a summary makes judgments about what can be cut and what categories cover which details.

    How long should a student summary be?

    Short enough to force a decision. Start at a hard fifteen-word limit on a single paragraph and raise the cap proportionally as the text gets longer. The constraint is what teaches the skill, because at fifteen words a student cannot include everything and has to decide what matters. Do not grade length itself.

    How do you grade a summary in middle or high school?

    Grade completeness and accuracy, which are the two things the research itself measured: does the summary contain everything essential, and is everything in it true to the text? Add a separate line for whether it is in the student’s own words if you are assessing writing rather than reading. Do not grade word count.

    Does summarizing work for struggling readers?

    The meta-analysis of ten techniques found effects were much greater for lower than higher ability students across the board, which is encouraging. But it also notes that younger and less able students are not as good at summarization, and that the technique can require extensive training to use well. Both can be true: they gain more and they need more instruction.

    Sources

    • Graham, S., & Perin, D. Writing Next: Effective Strategies to Improve Writing of Adolescents in Middle and High Schools. A Report to Carnegie Corporation of New York. Alliance for Excellent Education, 2007. Full text (PDF); ERIC record ED517367. Source of the 0.82 effect size for summarization (p. 16) and the identical 0.82 for writing strategies (p. 15), the grades 4–12 range, the statement that the outcome assessed was the “completeness and accuracy of summaries,” the description of approaches ranging from explicit strategy teaching to fading models, the note that only four elements yielded ten or more studies and that summarization was not among them, the warning that many effect sizes “differ only minimally” (p. 12), and the totals of 176 effect sizes with 41 (23%) involving low-achieving or disabled students (p. 25).
    • Donoghue, G. M., & Hattie, J. A. C. A Meta-Analysis of Ten Learning Techniques. Frontiers in Education, Vol. 6 (2021), 581216. Full text. Source of the summarization figure of d = 0.44 (SEM 0.055, 234 effects), the full ranking of the ten techniques, the participant breakdown of 65% undergraduate and 11% secondary, the finding that 93% of outcomes were surface-level and 74% of post-tests were taken within one day, the statement that summarization works better on performance or generative assessments than closed or multiple-choice tests and “can require extensive training to use optimally,” the note that younger and less able students are less good at it, the abstract’s finding that effects were much greater for lower than higher ability students, and the confirmation that Dunlosky and colleagues categorised summarization as “low” support. The paper’s own grade-level moderator table could not be read reliably, so no secondary-specific effect size from it is quoted here.
    • Willingham, D. T. What Works, What Doesn’t. Scientific American, SA Special Editions Vol. 23, No. 5s, p. 40. Article. A popular write-up by one of the authors of the ten-techniques review, read in place of the 2013 monograph in Psychological Science in the Public Interest, which was not reachable. Source of summarization’s placement among the low-utility techniques, the definition of it, and the authors’ reasoning that whether it works is “difficult to answer, as it has been implemented in many different ways,” with the open questions about summary length and text organization.
    • A source deliberately not cited. The four summarizing moves in this article are usually credited to a single early study of summarization macrorules. Three routes to that paper were tried and all were blocked, so its rule list, sample and age range could not be checked. The moves are presented here as the standard rule-governed approach, without a citation, rather than attributed to a study nobody on this end has read.

    About Clay Shumate

    Clay Shumate is a certified secondary Social Studies teacher in the public schools of West Alabama, with seven years of classroom experience, a B.A. in History, and an M.Ed. in Secondary Education. He writes about project-based learning, student responsibility, respect, and practical ways to hold young people to a higher standard while giving them room to learn from mistakes. He is a member of the Society of Professional Journalists and writes to its Code of Ethics; this site’s editorial standards and corrections policy are published in full. More about Clay.

  • Philosophical Chairs: How to Run It in Grades 6–12 Without It Turning Into an Argument

    Philosophical Chairs: How to Run It in Grades 6–12 Without It Turning Into an Argument

    By Clay Shumate

    Philosophical chairs is a whole-class discussion structure built on one debatable statement. Students who agree sit on one side of the room, students who disagree sit on the other, and anyone may change seats the moment an argument persuades them. The rule that does the real work is smaller than the furniture: summarize the last speaker before you answer them.

    Key Takeaways

    • The rules are published, free, and more demanding than the seating chart. The AVID handout lists eight rules of engagement, and two of them carry the structure: summarize the previous speaker before you respond, and after you speak, three other people on your side have to speak before you go again.
    • There is no effect size for philosophical chairs. The academic controversy work everyone points to reports its achievement comparison as a table of labels — High for controversy, Moderate for debate, Low for concurrence-seeking — with no number attached in either accessible text.
    • The discussion research that does carry numbers is mostly elementary. The field’s meta-analysis says a majority of its studies were run in grades 4 through 6, and its own conclusion is that few discussion approaches raised literal or inferential comprehension, or critical thinking and reasoning.
    • The strongest secondary evidence is about climate, not format. In 2,811 American 14-year-olds, an open classroom climate predicted appreciation of political conflict (.15) and informed voting (.14), and partly compensated for low socioeconomic status — but the author says plainly he cannot tell which way the arrow points.
    • Switching sides is not evidence of learning. The AVID handout says so itself: moving does not necessarily mean a student’s mind changed, only that an argument was compelling enough to sway opinion.

    What is philosophical chairs?

    Philosophical chairs is a discussion structure in which a single debatable statement divides the room physically. Students who agree sit on one side, students who disagree sit facing them, a neutral mediator sits between, and students may change seats at any point in the period when another side’s argument moves them.

    The structure is a practitioner tradition rather than a research program, and it is worth being precise about where it comes from. The most widely used strategy page for it, published by the K20 Center in 2020, attributes the strategy to a single source: McAndrews, S. (2013), AVID Elementary: Foundations Implementation Resource. That is an elementary AVID publication, and the same page lists the strategy as suitable from preschool through twelfth grade. Nobody is hiding anything — but a teacher who has been told this is a rigorous secondary structure should know the citation underneath it.

    The fuller procedural version comes from AVID’s own handout, which sets out eight rules of engagement, a mediator role, an optional undecided section, and a closing round. That handout makes no research claims at all.

    Eight numbered cards listing the philosophical chairs rules of engagement, including summarizing the previous speaker and waiting for three others to speak before speaking again.
    The eight rules as AVID’s handout gives them. Rules four and five are the ones that change the period.

    What are the rules of philosophical chairs?

    Eight rules, and most teachers only enforce the first three. The two that actually change what happens in the room are rules four and five.

    1. Understand the central statement before the discussion, and decide which side to sit on.
    2. Listen carefully and seek to understand an argument even when you disagree with it.
    3. Wait for the mediator to recognize you. Only one person speaks at a time.
    4. Briefly summarize the previous speaker’s argument before you respond to it.
    5. After you have spoken, wait until three other people on your side have spoken before you speak again.
    6. Address the ideas, not the person stating them.
    7. Keep an open mind, and move to the other side or the undecided section if an argument shifted your thinking.
    8. Support the mediator by helping keep order and keeping the discussion moving.

    Rule four is the whole thing. A student who has to restate your point before answering it cannot have spent your turn loading their own. It is the same requirement that sits underneath accountable talk and underneath every protocol that gets teenagers to build on each other instead of taking turns announcing. Rule five is the one that stops three confident kids from owning the period, and it is the first rule to get quietly dropped when the clock is tight.

    How do you run philosophical chairs, step by step?

    Nine moves, inside one class period. The setup takes about five minutes if students have done it before, and considerably longer the first time, because the first time you are teaching the rules, not the content.

    1. Write the statement on the board and leave it there. One claim, phrased so a reasonable person could land on either side.
    2. Give students the text or the evidence first. AVID’s version has students read a short article and build a two-column list of points for and against before anyone speaks. Skipping this is what turns the period into an opinion swap.
    3. Arrange the chairs facing each other, roughly half the room each way, with a seat between for the mediator.
    4. Have students sit according to their position. If a student cannot choose, AVID’s instruction is to sit with the side they agree with most, even without full agreement.
    5. Take the mediator seat yourself the first several times. The handout is explicit that in the middle grades the teacher almost always supplies the topic and runs the discussion, and that by the junior and senior years students should be writing the statement and mediating it.
    6. Call on the agree side first, then alternate. Enforce the summary rule from the first speaker, out loud, every time, until it stops needing enforcing.
    7. Let students move whenever they want. Movement can go back and forth, and it can happen mid-sentence from someone else.
    8. Close with a final statement from each side, and if the clock allows, a round where each student names their current position and which argument was the most convincing one they heard. That second question is the one worth protecting.
    9. Leave time to write. AVID’s own evaluation note is to reserve time at the end of the period for reflection, started in class and finished at home if needed. A discussion nobody writes down is a discussion you cannot grade or revisit.

    Two optional pieces are worth knowing. You can seat three or four students as observers who take notes instead of arguing and debrief the class at the end — useful for the student who will not speak in week one. And once a class is fluent, you can add an undecided section in the middle, on the condition that everyone still sitting there has to choose a side before the period ends.

    Is philosophical chairs research based?

    Not in the way the phrase usually implies. There is no randomized trial of philosophical chairs, no effect size for it, and the handouts that teach it make no research claims. What exists is evidence about a close cousin, and evidence about classroom discussion generally, and both come with real limits.

    The cousin is structured academic controversy, David and Roger Johnson’s format in which pairs argue one side, then argue the other, then drop advocacy and build a joint position. It is the thing people mean when they say philosophical chairs is research-based, and it is a different activity — it is run in fours, it requires you to argue the position you rejected, and it ends in agreement rather than in a count of who moved.

    Reading the Johnsons’ own accessible write-ups is instructive. Their 1988 Educational Leadership article says structured controversy produces greater mastery and retention, better generalization, higher-quality decisions and more creative insight than concurrence-seeking, debate and individualistic learning — and gives not one number. Their 1997 chapter summarizes achievement across the four conditions in a table reading High, Moderate, Low, Low. Both point back to a 1985 study in the American Educational Research Journal as the source. That paper is paywalled and was not read for this article, so no sample size or figure from it appears here.

    Both texts also carry a caveat worth more than the claims. The 1988 article says positive outcomes “do not automatically appear every time students disagree intellectually,” and the 1997 chapter lists the conditions controversy depends on: a cooperative context, heterogeneous participants, information actually distributed among them, social skills, and rational argument. Run philosophical chairs without those and you are not running a weaker version of the research. You are running something the research did not study.

    Four rows contrasting common claims about philosophical chairs with what the published sources actually report, including the High-Moderate-Low table and the grades four to six study population.
    Four claims teachers hear, and what the sources underneath them actually say.

    What does the research on classroom discussion actually show?

    Mixed results, on younger students than the people quoting it usually mention. The standard reference is Murphy and colleagues’ 2009 meta-analysis of classroom discussion in the Journal of Educational Psychology, and its abstract is blunter than its reputation.

    Several discussion approaches produced large increases in student talk and matching reductions in teacher talk, plus substantial improvements in text comprehension. Then this: few approaches to discussion were effective at increasing students’ literal or inferential comprehension, or their critical thinking and reasoning. Effects were moderated by study design, by the outcome measure, and by student academic ability. And on population: while the ages were wide, a majority of the studies were conducted with students in fourth through sixth grade. ERIC catalogues the whole thing under elementary education.

    That is not a reason to skip discussion. It is a reason to stop quoting a number at it. The one that circulates most is a 0.86 effect size for argumentation and classroom discussion on Visible Learning MetaX — and that page pools five meta-analyses covering computer-supported collaborative argumentation, science argumentation and text-comprehension discussion, which are not the same construct. Its own table footer reports the average as 0.79 while the headline reads 0.86. A figure that contradicts itself on its own page is not a figure to put on a slide for your department.

    The most useful secondary evidence is a different kind. Campbell’s analysis of the 1999 civic education study looked at 2,811 American fourteen-year-olds in 124 schools, measuring how far students felt free to disagree with teachers, express minority opinions, and hear several sides of an issue. A one-standard-deviation rise in that climate predicted a .15 gain in appreciation of conflict and .14 in informed voting intent, against a smaller .06 for civic knowledge — about two percentage points on a 49-item test.

    Two honest caveats travel with it. The design is cross-sectional and the author says so: it remains unclear whether perceiving a lot of discussion produces engagement, or whether engaged adolescents perceive more discussion. And the compensation finding — that an open climate narrows the gap for students with lower expected education — held for appreciation of conflict and voting, at −.04 on both interactions, and did not hold for civic knowledge. The honest version is that giving teenagers somewhere to argue well may matter most for the students who get the fewest chances elsewhere, and that this is a correlation with a plausible story attached, not a settled result.

    How is philosophical chairs different from a debate or a Socratic seminar?

    A debate assigns you a side and declares a winner. A Socratic seminar has no sides at all. Philosophical chairs sits between them: you pick your own side, you are expected to change it if the argument earns it, and nobody wins.

    StructureWho picks the positionCan you change it?How it endsBest for
    Philosophical chairsThe studentYes, at any moment, by movingFinal statements; no winnerA single contested claim students already have evidence about
    Classroom debateAssigned by the teacherNo — you argue your side regardlessA judged resultBuilding argument construction and rebuttal under pressure
    Socratic seminarNobody — there are no sidesNot applicableOpen; often a written reflectionOpening up a difficult text rather than resolving a question
    Structured academic controversyAssigned, then reversedRequired — you must argue the other side tooA joint position the group agrees onForcing genuine perspective-taking in groups of four
    Four cornersThe studentYes, but usually onceA quick count and a reasonA fast read of where a class stands before you teach

    The practical consequence is about what you are assessing. If you want to see whether a student can build a case on demand, run a classroom debate and assign the sides. If you want to see whether a student can be moved by evidence, philosophical chairs is the only one of the five that makes that visible, because changing your mind is the designed behavior. A Socratic seminar is a different job again — it belongs to the text, not to the question.

    What makes a good philosophical chairs statement?

    A statement works when a reasonable, informed person could sit on either side of it, when the evidence to argue it is already in students’ hands, and when nobody in the room is the subject of the debate. Most failed philosophical chairs periods were lost at the statement, not during the discussion.

    Four numbered criteria for a philosophical chairs statement: both sides defensible, arguable from what students have read, a single claim, and nobody in the room as the topic.
    Four tests. A statement that fails any one of them will not produce a discussion.

    The fourth test is the one that needs saying out loud. AVID’s own handout ships with a list of sample topics, and some of them put a student’s family, legal status, body or beliefs up for a show of hands by their classmates. In a grades 6–12 room, somebody in those chairs is living the topic. The exercise asks them to sit on a side while peers argue against their life, and no amount of structure makes that a thinking task. Pick a different statement. There are plenty that are contested without being personal — whether a historical decision was justified, whether a policy achieved what it promised, whether a character in the text was right.

    A few that work, and work for a reason:

    • “The Marshall Plan was a humanitarian act.” Both sides are defensible from the same documents, which is the whole point.
    • “A government should be able to compel citizens to serve in a war it declares.” Abstract enough that nobody has to defend their own family, concrete enough to argue.
    • “Our school should grade on effort as well as accuracy.” Students have direct evidence, and you will learn something about your own classroom expectations that you cannot learn any other way.

    Why won’t students switch sides?

    Because in most classrooms changing your mind in public has only ever been punished. A teenager who moves chairs is announcing, in front of thirty peers, that they were wrong a minute ago. The structure cannot fix that on its own, and the teacher’s framing is what decides it.

    Three things help, none of them complicated. Name movement as the goal in the first thirty seconds, every time, before anyone has a position to defend. Praise the argument that caused a move rather than the person who moved, which keeps the spotlight off the student who conceded. And run the closing round where every student names the most convincing argument they heard from the other side, whether or not they moved — that gives a student a way to acknowledge a good point without having to get out of their chair to do it.

    It is also worth saying the quiet part: a class that never moves is not necessarily failing. The AVID handout notes that moving does not necessarily mean a person’s mind is changed, only that an argument was compelling enough to sway opinion. The reverse holds too. A student who stays put and can now state the opposing case accurately has done the work the exercise exists for.

    How do you grade philosophical chairs?

    Grade the written reflection, not the talking. Participation grades in a discussion reward the students who were already comfortable speaking and punish the ones the structure is supposed to help, which inverts the reason you ran it.

    What a reflection can fairly ask for is specific and checkable: state your position now, state the strongest argument from the side you did not take, say whether and why you moved, and cite one piece of evidence from the reading. That is four lines and it tells you more than a tally of who spoke. The second item is the one to weight — a student who can state the opposing case accurately has demonstrated the perspective-taking the whole structure is built to produce.

    If you want a live record, the observer seats do it better than a clipboard. Rotate who sits there, and the student who has not spoken all semester gets a way in that is not speaking.

    What goes wrong with philosophical chairs?

    Four failures account for nearly all of it, and three of them happen before the discussion starts.

    • No evidence in the room. If students have not read anything, they argue from what they already believed when they walked in, and the loudest prior wins. The reading is not a warm-up, it is the fuel.
    • The summary rule gets dropped. It slows the period down, so it is the first thing to go, and the moment it goes you have two monologue lines facing each other. Enforce it even when it costs you three speakers.
    • The statement had an obvious answer. One side ends up with four students and the room learns that disagreement is a performance.
    • Somebody’s life was the topic. This is the one that does lasting damage to the trust in a room, and it is entirely avoidable at the planning stage.

    A fifth, subtler one: running it too often. Used monthly it is an event students prepare for. Used weekly it becomes the thing you do when the unit plan ran thin, and teenagers can tell the difference immediately. For the ordinary Tuesday, a 90-second structured pair buys more talk per minute than a whole-class format ever will.

    Clay’s take: the structure is a delivery system for one rule

    I have read the sources for this one twice, because the gap between how confidently philosophical chairs is recommended and what is actually published underneath it is wider than usual. The most-cited strategy page traces to an AVID elementary resource. The research everyone gestures at belongs to a different activity and reports its achievement finding as a word in a table. The meta-analysis with real numbers is mostly fourth through sixth grade and concluded that few discussion approaches moved comprehension or reasoning at all.

    None of that makes it a bad use of a period. It makes the usual justification for it wrong. The case for philosophical chairs is not that a study says it raises achievement. The case is that it is the only common classroom structure whose designed outcome is a student publicly changing position because of evidence, and that teenagers almost never see an adult model that, let alone get asked to do it.

    If I had to defend one element of it, it would not be the chairs. It would be rule four. Make a sixteen-year-old restate an opponent’s argument before answering it and you have taught something that outlasts the unit, whether or not anybody moves seats. You can enforce that rule on a Tuesday with no furniture rearrangement at all, and it belongs in every discussion you run, not just this one.

    What to do next

    Pick one statement from a unit you are already teaching — one where the text you have assigned genuinely supports both sides — and run it the way AVID describes, with the reading first and the two-column list before anyone speaks. Take the mediator seat yourself. Enforce the summary rule out loud from the first speaker, and accept that the first run will feel slow, because you are teaching a procedure rather than the content.

    Then close with the written reflection and read the second question first: the strongest argument from the side they did not take. That is where you will find out whether the period was worth it. If most of the class can state the opposing case accurately, run it again next month. If they cannot, the problem was the statement or the evidence, and both are fixable before you blame the structure.

    Frequently Asked Questions

    What is philosophical chairs in simple terms?

    It is a whole-class discussion where one debatable statement splits the room. Students who agree sit on one side, students who disagree sit facing them, and a mediator between the sides calls on speakers who alternate. Students may change seats whenever an argument persuades them, and the discussion ends with final statements rather than a winner.

    How long does philosophical chairs take?

    AVID’s handout says the discussion usually runs one class period. Expect the first run to take longer in real terms, because you are teaching the eight rules as well as the content. Budget time at both ends: reading and building a pros and cons list before anyone speaks, and a written reflection after the final statements.

    Is philosophical chairs the same as structured academic controversy?

    No, and the difference matters because the research belongs to the second one. Structured academic controversy runs in groups of four, requires each pair to argue the opposing position after arguing their own, and ends in a joint position the group agrees on. Philosophical chairs is whole-class, self-selected, and ends without agreement.

    Is there research proving philosophical chairs works?

    Not for philosophical chairs specifically. No randomized trial or effect size for it exists, and the AVID and K20 handouts make no research claims. The Johnson and Johnson academic controversy work reports achievement as High, Moderate and Low in a table rather than as numbers, and the main classroom-discussion meta-analysis was mostly conducted in grades 4 to 6.

    What grade levels is philosophical chairs for?

    The format holds across grades, with the teacher’s role shrinking as students get older. AVID’s handout says that in the middle school years the teacher almost always supplies the topic and mediates, and that by the junior and senior years students should be writing the central statement and running the discussion themselves.

    How do you include quiet students in philosophical chairs?

    Use the observer seats. AVID’s version allows a few students to take notes on the quality of arguments instead of participating, then debrief the class at the end. That gives a reluctant speaker a real job and a real product. The closing round, where every student names the most convincing argument they heard, also gives everyone one short scripted turn.

    What topics should you avoid in philosophical chairs?

    Any statement that puts a student in the room up for debate: a classmate’s family, immigration status, body, faith or identity. Somebody in a grades 6 to 12 classroom is living most of those topics, and asking them to sit on a side while peers argue against their life is not a thinking exercise. Contested historical, policy and literary questions work without that cost.

    Should philosophical chairs be graded?

    Grade the written reflection rather than the talking. A participation grade rewards students who were already comfortable speaking and penalizes the ones the structure is meant to help. A four-part reflection works well: your position now, the strongest argument from the other side, whether and why you moved, and one piece of evidence from the reading.

    Sources

    • K20 Center. Philosophical Chairs. University of Oklahoma K20 Center, published 16 September 2020. Strategy page. Source of the five-step procedure, the agree/disagree seating, the elbow-partner pros and cons chart, the listed PreK–12 grade range, and the strategy’s sole attribution to McAndrews, S. (2013), AVID Elementary: Foundations Implementation Resource, AVID Press. The page cites no research.
    • AVID. Philosophical Chairs. Handout distributed via Pasco County Schools. Full text (PDF). Source of the eight rules of engagement, the mediator role, the seven procedural steps, the observer option, the undecided section and its closing condition, the one-class-period duration, the middle-versus-upper-grades guidance, the end-of-period reflection instruction, and the statement that moving “does not necessarily mean that a person’s mind is changed.” No author or date is printed on the document, and it makes no research citations.
    • Johnson, D. W., & Johnson, R. T. Critical Thinking Through Structured Controversy. Educational Leadership, May 1988, pp. 58–64. Full text (PDF). Source of the directional claims for structured controversy against concurrence-seeking, debate and individualistic learning, and of the caveat that positive outcomes “do not automatically appear every time students disagree intellectually.” The article reports no effect sizes, sample sizes or study populations.
    • Johnson, D. W., & Johnson, R. T. Academic Controversy: Increase Intellectual Conflict and Increase the Quality of Learning. Chapter 10 in Campbell, W. E., & Smith, K. A. (Eds.), New Paradigms for College Teaching, Interaction Book Company, 1997. Full text (PDF). Source of the High / Moderate / Low / Low achievement table across controversy, debate, concurrence-seeking and individualistic efforts, and of the five conditions controversy depends on. Also reports no numbers. Both Johnson texts point to a 1985 study in the American Educational Research Journal as their evidence base; that paper is paywalled, was not read for this article, and nothing is cited from it here.
    • Murphy, P. K., Wilkinson, I. A. G., Soter, A. O., Hennessey, M. N., & Alexander, J. F. Examining the effects of classroom discussion on students’ comprehension of text: A meta-analysis. Journal of Educational Psychology, Vol. 101, No. 3 (2009), pp. 740–764. ERIC record. Abstract and catalogue record read; the full text was not reachable. Source of the finding that few approaches raised literal or inferential comprehension or critical thinking and reasoning, that effects were moderated by design, outcome measure and student academic ability, and that a majority of studies were conducted with students in fourth through sixth grade.
    • Campbell, D. E. Voice in the Classroom: How an Open Classroom Climate Fosters Political Engagement Among Adolescents. Political Behavior, 2008. DOI 10.1007/s11109-008-9063-z. Full text (PDF). Source of the 2,811 students in 124 schools from the 1999 IEA Civic Education Study, the six-item climate index, the coefficients of .06 for civic knowledge, .15 for appreciation of conflict and .14 for informed voting, the two-percentage-point reading of the knowledge result, the −.04 interactions with expected education, and the author’s own statement that it remains unclear which way the relationship runs.
    • Visible Learning MetaX. Argumentation / Classroom discussion. Influence page. Source of the 0.86 weighted mean effect size drawn from five meta-analyses, 165 studies and 169 effects, and of the discrepancy with the 0.79 shown in the same page’s own total row. Cited here as an example of a pooled figure mixing distinct constructs, not as support for a claim.

    About Clay Shumate

    Clay Shumate is a certified secondary Social Studies teacher in the public schools of West Alabama, with seven years of classroom experience, a B.A. in History, and an M.Ed. in Secondary Education. He writes about project-based learning, student responsibility, respect, and practical ways to hold young people to a higher standard while giving them room to learn from mistakes. He is a member of the Society of Professional Journalists and writes to its Code of Ethics; this site’s editorial standards and corrections policy are published in full. More about Clay.

  • Anchor Charts in Grades 6–12: What They’re For, and What the Research Actually Says

    Anchor Charts in Grades 6–12: What They’re For, and What the Research Actually Says

    By Clay Shumate

    An anchor chart is a reference built with students during a lesson, in their own words, and left visible for later use. No study has ever tested whether anchor charts improve learning. What the evidence supports is the building of one, not the hanging of it, and taking charts down once students stop using them.

    Key Takeaways

    • There is no study showing anchor charts raise achievement, at any grade level. The two pieces of research with anchor charts as the subject are a dissertation that interviewed five middle school teachers and measured no student outcome, and a kindergarten capstone with 22 students that never reports its own rubric scores.
    • The International Literacy Association’s own article on anchor charts cites no anchor chart research either. That is not a gotcha. It tells you the practice spread on reasoning rather than evidence, and the reasoning is mostly sound.
    • What separates an anchor chart from a poster is that students helped write it. The ILA defines one as a chart “co-created with students, for students” serving as “a temporary and visible scaffold or cue until a majority of the class reaches independence.”
    • The “decorated classrooms distract students” research is real and it is not about teenagers. Every study in that literature ran on children aged roughly 5 to 13, and the one study of adolescents used unrelated pictures and measured no learning at all.
    • In a secondary classroom the wall is the weakest part of the practice. A sixteen-year-old will not stare at a chart in front of 29 classmates if looking means admitting she forgot. Photograph it and put it where she can check privately.

    What is an anchor chart?

    An anchor chart is a visible classroom reference created with students during instruction, recording their thinking in the language they used. The ILA calls anchor charts “organized mentor texts co-created with students,” handwritten in large print and displayed where the class can see them.

    The word doing the work there is co-created. The chart is a record of a lesson that happened, not a decoration installed before students arrived. And the same article is explicit about how long it should live: the purpose is “to be a temporary and visible scaffold or cue until a majority of the class reaches independence.” Temporary. That half of the definition gets skipped nearly everywhere, and it is the half this article spends the most time on.

    Nobody can tell you who invented the anchor chart. The term comes out of the reading and writing workshop tradition, and the earliest sources in the professional literature are practitioner books rather than studies. A page that credits a specific author is guessing.

    How is an anchor chart different from a poster?

    A poster states a rule you decided in advance. An anchor chart records a decision the class reached together. The difference shows up in four places, and a chart that fails all four is a poster with better handwriting.

    Four labelled rows comparing an anchor chart with a poster on who wrote it, when it was made, what it is for, and how long it stays up.
    A chart that fails all four tests is a poster with better handwriting.
    • Who wrote it. A chart carries student wording. If every phrase is yours, students read it the way they read a fire-exit map.
    • When it was made. A chart appears during the lesson it belongs to. A poster is up before anyone walks in.
    • What it is for. A chart answers a question the class actually got stuck on. A poster announces a value.
    • How long it stays. A chart comes down when the class no longer needs it. A poster stays until it fades.

    That last one is the test most rooms fail, including rooms run by people who are very good at this. A chart that has been up since September is furniture, and students treat furniture accordingly.

    Does research show anchor charts work?

    No. Searching ERIC and the open repositories turns up no experiment, no quasi-experiment and no peer-reviewed effectiveness study of anchor charts at any grade level. That is a strong claim, so here is exactly what does exist.

    Fontanez’s 2017 doctoral dissertation is titled Examining the Impact of Art-Based Anchor Charts on Academic Achievement in Language Arts. It is a qualitative case study that interviewed five middle school teachers in one South Carolina district. No students were sampled and no achievement was measured. The teachers said the charts helped; that is the finding. A title containing “impact on academic achievement” sitting on top of five teacher interviews is how a practice acquires a research reputation it has not earned.

    Simmet’s 2016 master’s capstone studied one kindergarten classroom of 22 students over three weeks. Its rubric scores are never reported as numbers, its methods chapter says six charts were made while the results describe four, and the author notes the result may depend entirely on the individual teacher.

    And the practice’s most authoritative professional treatment, the ILA piece quoted above, cites no study of anchor charts at all. Its references are practitioner books.

    Four stacked panels summarising the evidence on anchor charts: no direct effectiveness study at any grade level, the indirect research that supports the reasoning, the child populations the counter-evidence tested, and the question nobody has studied.
    What the research establishes, and what it leaves open.

    Be careful about what that means. “No evidence” is not “evidence of no effect” — nobody has run the trial. Plenty of defensible teaching has less behind it, and a practice costing one sheet of chart paper does not need a randomized trial to justify itself. What it needs is for people to stop saying research supports it.

    What does the evidence actually support?

    Two research lines support parts of the reasoning behind anchor charts. Neither supports the whole practice, and being precise about which part is which separates a defensible claim from a training slide.

    Pairing words with relevant visuals

    Presenting words alongside a relevant picture beats words alone, and this site covers those figures in its piece on dual coding in grades 6–12. Two cautions carry over. Those studies are computer-based multimedia lessons, not paper on a wall, and the chapters reporting them do not state participants’ ages. And Mayer’s own review found that while verbal signalling worked — six experiments, median d = 0.52 — “visual signaling involving arrows was not found to be effective in promoting transfer posttest performance.” The arrows and colour-coding are decoration until shown otherwise.

    Scaffolding, and taking the scaffold away

    Scaffolding is defined by contingency, fading and transfer of responsibility. A decade-long review by van de Pol, Volman and Beishuizen located 66 articles and found only eight that tested effectiveness, mostly small and mostly one-to-one, with populations from age five to grade ten. On fading they report that few studies operationalised it at all, “probably because they are complex to measure.” So “fade the chart” is simultaneously the best-grounded and thinnest-evidenced advice here. Know both halves.

    What cognitive load theory does not say

    This is the one most often misused. People invoke working memory to argue a wall chart offloads cognitive load. The split-attention research says close to the opposite: separating sources a learner must integrate creates a search cost, and it is that act of search that imposes the extra load. The principle applies only when sources are unintelligible alone. A chart escapes the charge by being readable by itself, which also means it is doing less cognitive work than the claim implies. Our piece on what cognitive load theory claims works through the primary research.

    Don’t classroom decorations distract students?

    Sometimes, in young children, in a laboratory. The research everyone cites is narrower than its reputation, it has a published rebuttal, and no study in it tested a secondary classroom.

    The famous one is Fisher, Godwin and Seltman’s 2014 paper in Psychological Science: 24 kindergarten children, six science lessons, a laboratory classroom decorated for half the lessons and stripped for the rest. The article is paywalled and I could not open it, so I will not pretend otherwise — the figures everyone quotes, 42 percent correct in the decorated room against 55 percent sparse, and off-task time of 38.6 against 28.4 percent, come from Carnegie Mellon’s press release, not the journal article. Anyone attributing them to Psychological Science had not read it either.

    Then Imuta and Scarf reanalysed Fisher’s own data. Eight of the 24 children (33 percent) missed at least one lesson, so the main analysis rests on 16 children. And attention to the decorated room declined across lessons: the Condition × Lesson interaction was F(2, 30) = 12.80, p < 0.001, and within the decorated condition the lesson effect was F(2, 30) = 9.18, p = 0.001. Their reading is habituation to novelty — children stop looking — though they note the condition difference was still present at lesson three, so both mechanisms may be operating.

    That is the wallpaper effect with statistics attached, and it cuts both ways. A chart left up for a month stops distracting anyone. It also stops being seen.

    What happens in real classrooms

    Two larger studies left the lab and both complicate the simple story. Godwin and colleagues observed 58 elementary classrooms — children aged 6 to 9, 34,289 coded observations — and found students on task 72.7 percent of the time. Visual noise predicted lower on-task rates, but the authors call it a preliminary analysis, significant at the conventional .05 threshold and only marginally significant at their stricter .025; the percentage of wall covered was likewise marginal at .05 and not significant at .025. The finding nobody quotes: peer distractions accounted for 46.4 percent of off-task behaviour, by far the largest source. Students are distracted by each other, not by your wall.

    Barrett and colleagues measured 153 classrooms and 3,766 primary pupils in England and found seven design parameters explaining 16 percent of the variation in progress — light, temperature, air quality, ownership, flexibility, visual complexity and colour, with light carrying the largest coefficient. Visual complexity came out curvilinear: heavily decorated and bare classrooms both scored poorly, intermediate levels scored best. The paper recommends no percentage of wall coverage, and neither should anyone citing it. If you have read that a room should be under some specific percentage covered, that number was invented.

    And the population problem

    Every study above ran on children: kindergarten, ages 6 to 9, ages 5 to 13, Years 1 to 6. The only study I found testing visual environment on adolescents is Rodrigues and Pandeirada’s 2019 work with 64 students aged 13 to 17 in Portugal. Under high visual load they did worse on attention — go/no-go hits 93.16 against 96.77 percent, t(63) = 3.279, p = .004, d = .521 — and on visuospatial span, 5.06 against 5.56, t(63) = 3.717, p < .001, d = .486. Real costs, honestly reported. But the pictures were deliberately “not related to the tasks at hand,” the setting was an isolated room rather than a classroom, and there was no learning outcome at all. It is a reason to keep walls from becoming visual noise, not evidence that anchor charts hurt teenagers.

    Nobody has studied whether a fifteen-year-old in chemistry uses a wall chart. I would like that study to exist. It does not.

    What does an anchor chart look like in a grades 6–12 class?

    It looks like the answer to a question the class got stuck on twenty minutes ago. Most published anchor chart material is elementary, and the secondary examples that exist cluster in grades 6 to 8, so here is what the practice converts to with older students and harder content.

    SubjectA chart worth makingA poster pretending to be one
    EnglishThe four moves the class found in a mentor paragraph, in their words, after reading it“The 5 Elements of a Thesis Statement”
    MathThe three errors the class actually made on factoring yesterday, and how each was caughtA printed order-of-operations acronym
    ScienceWhat counts as a controlled variable, built from the class’s own failed designThe scientific method in seven boxes
    Social studiesThe questions students generated for judging whether a source is trustworthyA sourcing acronym from a textbook
    Any subjectThe class’s agreed standard for a complete answer, written the day someone asked“Be Respectful. Be Responsible. Be Ready.”

    The right-hand column is not worthless. Some of it is useful signage. It is just not an anchor chart, and calling it one is how the practice turns into wall decoration.

    How do you build one in a single class period?

    Six steps, about twelve minutes, made at the point of confusion rather than planned in advance.

    1. Wait for the stuck moment. Do not plan the chart. Plan to notice when half the room gets something wrong the same way. That is the chart.
    2. Ask the question out loud and take four answers. Not a vote. Four students saying what they think the rule is.
    3. Write their words, not better words. This is where most charts die. If a student says “you have to say why you picked it,” write that, not “cite textual evidence to support claims.” The second version is yours, and they will read it as yours.
    4. Keep it to five lines. Twelve lines is a handout, not a chart. Barrett’s curvilinear result argues against covering the wall, and five lines are legible from the back row.
    5. Photograph it before anyone leaves and post the photo where students already look — the course page, the LMS. More on why below.
    6. Point at it once the next day, then stop pointing. If you are still pointing at it in two weeks, the chart is not working and the content needs re-teaching, not re-displaying.

    Why is the wall the weakest part of this in secondary?

    Because of what it costs a teenager to look at it. A sixteen-year-old who has forgotten the standard for a complete answer has to turn her head, in front of twenty-nine people, toward a chart that exists to help people who forgot.

    That is a small public admission, and she will often decline to make it. She will guess instead. Nobody has measured this and I will not dress it up as research, but it is the most predictable thing in the world if you have watched adolescents protect their standing in a room — and it explains something the elementary literature never has to explain: why a reference that visibly works with nine-year-olds goes quiet with fifteen-year-olds. The chart did not get worse. The cost of consulting it went up.

    The fix is not a better chart. It is a second copy they can check privately — the photo in the LMS, a half-sheet taped inside a folder, a copy in the slide deck. Make consulting the reference free and they will consult it. This is also the honest answer for families: a reference that exists only on a wall is no help to a student doing homework at nine at night.

    A numbered four-item checklist asking whether a student has referenced the chart unprompted this week, whether the class would still manage without it, whether it is still accurate, and whether it is crowding out the next chart.
    Four questions that decide whether a chart stays on the wall.

    When should you take an anchor chart down?

    When students have stopped using it, which is usually sooner than it feels. The ILA definition calls a chart a scaffold “until a majority of the class reaches independence,” and a chart that never comes down has stopped being a scaffold.

    Four questions settle it:

    • Has a student referenced it, unprompted, in the last week? Not “could they.” Did they. This is the one thing worth tallying, and the only real observable the practice has.
    • Would the class still produce the behaviour if it vanished tonight? If yes, it is finished. Photograph it and take it down.
    • Is it still accurate? A chart from week two that the unit has outgrown is actively teaching the wrong thing.
    • Is it crowding out the chart you need next week? Wall space is finite, and the curvilinear finding says aim for the middle, not the maximum.

    Charts that come down need not be thrown away. Photograph them, keep the photos where students can reach them, and you have a reference library that costs no wall space at all.

    Can anchor charts be digital?

    Yes, and in secondary the digital copy often does more work than the paper one. A photo in the course page solves the privacy problem above, gives families something usable at home, and handles teaching five sections in three rooms.

    What it cannot replace is the making. The part of this practice with the clearest reasoning behind it is the ten minutes where students argue about what the rule is and watch their own words go up. A slide you built on Sunday and projected on Monday is a poster delivered by projector. If you keep one half, keep the making.

    That also answers the floating teacher, which secondary throws at people constantly and anchor chart advice almost never addresses. If the wall is not yours, build the chart on paper or under a document camera, photograph it, and live in the digital copy. A tri-fold on a cart works too. The wall was never the point.

    What should an administrator or coach look for?

    Whether students use the charts. That is the whole observable, and the only one with any logic behind it. A coach can tally one thing: how often a student consults a chart without being told to.

    Zero in a full period is useful information about that chart, not about that teacher. And the thing worth not doing is putting “anchor charts visible” on a walkthrough rubric. The moment a chart on the wall counts as evidence of good teaching, every room fills with charts and nobody takes any down — producing exactly the condition the display research warns about and stripping out the feature that defines the practice. You would be rewarding the by-product and quietly penalising the teacher who photographs her charts and clears her wall.

    At district scale, two things are worth saying plainly. This costs a sheet of chart paper and a marker, so there is no equity case for buying printed sets; the version with reasoning behind it is the one students help write, and it is free. And the evidence is thin enough that it does not belong in a mandate. The Education Endowment Foundation prints an evidence-security rating beside every approach it reviews. Borrow the habit: recommend anchor charts, explain the reasoning, and claim no research base that is not there.

    Clay’s take: the making is the lesson, the wall is the leftover

    Anchor charts are worth doing, and almost everything written about them overstates the case. The honest version is smaller and more useful than the sales version.

    When a class argues its way to a standard and watches you write their sentence on a piece of paper, something real happens: they have authored the expectation instead of receiving it. That is worth twelve minutes in any grade and it is the part I would defend. The paper that comes out of it is a by-product — useful for a while, then furniture. Secondary teachers get sold the by-product, the laminated set and the printable pack and the wall that photographs well for a walkthrough, and the by-product is the part with no evidence behind it and a literature suggesting students habituate to it within a few lessons.

    So build them with students, keep them short, photograph them, and take them down when nobody looks any more. Treat a wall full of September’s charts as a sign something needs re-teaching, not as proof the room is working. And if someone tells you research shows anchor charts raise achievement, ask them for the study. I looked.

    What to do next

    Pick the next thing your classes get wrong in the same way. You probably already know what it is.

    When it happens, stop, take four student answers, write five lines of their language on paper, photograph it, and post the photo where they can see it without turning around. In a week, ask whether anyone has used it; if not, take it down and re-teach the thing. The related pieces here are scaffolding strategies for grades 6–12 on how support gets withdrawn, the Frayer model for when one word needs the four-box treatment, and note taking strategies for high school students for the version that lives in the student’s notebook instead of on your wall.

    Frequently Asked Questions

    Do anchor charts actually work?

    There is no experiment or peer-reviewed effectiveness study of anchor charts at any grade level, so nobody can honestly say research proves they work. The reasoning behind them is sound: pairing words with relevant visuals is well supported, and co-constructing a reference matches what the scaffolding literature describes. Treat anchor charts as defensible practice with thin evidence, not as an evidence-based intervention.

    What is the difference between an anchor chart and a poster?

    Students helped write the anchor chart. A poster states a rule you decided in advance and displayed before anyone arrived. The International Literacy Association defines an anchor chart as co-created with students during instruction and intended as a temporary scaffold until most of the class reaches independence. A chart that has been on the wall since September has become a poster regardless of how it started.

    Are anchor charts only for elementary school?

    No, but almost all the published material is elementary, and the secondary examples that exist cluster in grades 6 to 8. In a high school classroom the co-construction transfers directly while the wall display works less well, because consulting a reference in front of classmates carries a social cost for teenagers that it does not carry for nine-year-olds. A photographed copy students can check privately solves most of that.

    Do classroom decorations distract students?

    In young children, in laboratory conditions, there is evidence they can. Every study in that literature ran on children aged roughly five to thirteen, the most-cited one used 24 kindergarteners in a lab, and a published reanalysis of its data argued part of the effect was children habituating to novelty. The largest real-classroom study found peer distractions, not walls, accounted for 46.4 percent of off-task behaviour.

    How much of my wall should be covered?

    No research supports a specific percentage, and any page quoting one invented it. The largest study of real classrooms found the relationship was curvilinear: both heavily decorated and bare rooms scored poorly on pupil progress while intermediate levels scored best. That study deliberately recommends no number. Aim for legible and purposeful rather than for a target.

    Can anchor charts be digital?

    Yes, and in secondary a digital copy often does more work than the paper one. A photo in the course page lets a student check the reference without turning around in front of the class, gives families something to use at home, and solves teaching several sections in different rooms. What a digital copy cannot replace is the making, which is the part of the practice with the clearest reasoning behind it.

    When should I take an anchor chart down?

    When students have stopped using it, which is usually sooner than it feels. Ask whether anyone has referenced it unprompted in the last week, whether the class would still produce the behaviour without it, whether it is still accurate for the current unit, and whether it is crowding out the chart you need next. Photograph it first so you keep the reference without keeping the wall space.

    What if I float between classrooms?

    Build the chart with the class on paper or under a document camera, photograph it, and live in the digital copy. A tri-fold board on a cart works too. The co-construction is the part that matters and it does not require owning a wall, which is worth knowing because floating and room-sharing are common in secondary and almost never addressed in anchor chart advice.

    Sources

    • Moses, E., & Lee, H. Imitate and Innovate Anchor Charts. ILA E-ssentials No. 8065, International Reading Association (2014). Full text (PDF). Source of the definition and of the “temporary and visible scaffold” purpose statement. A practitioner article, not a study; it cites no research on anchor charts, which is the point made in the body.
    • Fontanez, K. I. Examining the Impact of Art-Based Anchor Charts on Academic Achievement in Language Arts. Ed.D. dissertation, Walden University (2017). ERIC ED581971. ERIC record. Qualitative case study interviewing five middle school teachers in two South Carolina schools; no students sampled and no achievement measured. The ERIC record was read; the full dissertation was not opened.
    • Simmet, C. How Anchor Charts Can Engage Students in Interactive Read-Alouds. M.A. capstone, Hamline University (2016). Full text (PDF). One kindergarten classroom, 22 students, three weeks, teacher-made engagement rubric whose scores are never reported numerically.
    • Mayer, R. E. Multimedia instruction. In Spector et al. (Eds.), Handbook of Research on Educational Communications and Technology, pp. 385–399. Springer (2014). Full text (PDF). Source of the verbal-signalling figure (six experiments, median d = 0.52) and of the finding that visual signalling with arrows was not effective for transfer. The chapter does not state participants’ ages.
    • van de Pol, J., Volman, M., & Beishuizen, J. Scaffolding in teacher–student interaction: A decade of research. Educational Psychology Review 22(3), 271–297 (2010). Full text (PDF). Source of contingency, fading and transfer of responsibility, of the count of eight effectiveness studies out of 66 articles, and of the finding that few studies operationalised fading.
    • Carnegie Mellon University press release, carried by ScienceDaily, 27 May 2014. Press release. The source of the 42 vs 55 percent and 38.6 vs 28.4 percent figures quoted in the body. Cited as a press release because the underlying Psychological Science article (Fisher, Godwin & Seltman, 2014) is paywalled and could not be opened.
    • Imuta, K., & Scarf, D. When too much of a novel thing may be what’s ‘bad’: commentary on Fisher, Godwin, and Seltman (2014). Frontiers in Psychology 5, Article 1444 (2014). Full text. Peer-reviewed reanalysis of the original authors’ own data. Source of the 24-child sample, the 33 percent attrition, the 16 children with complete data, and the habituation argument with its F statistics.
    • Godwin, K. E., Seltman, H., Scupelli, P., & Fisher, A. V. Attentional Competition in Genuine Classrooms: Analysis of the Classroom Visual Environment. Proceedings of the Annual Meeting of the Cognitive Science Society, Vol. 42 (2020). Full text (PDF). 58 elementary classrooms, children aged 6–9, 34,289 coded observations. Source of the 72.7 percent on-task rate, the 46.4 percent peer-distraction figure, and the authors’ own caution that the visual-noise result is preliminary and only marginally significant at their stricter threshold. Correlational; no learning outcome measured.
    • Barrett, P., Davies, F., Zhang, Y., & Barrett, L. The impact of classroom design on pupils’ learning: Final results of a holistic, multi-level analysis. Building and Environment 89, 118–133 (2015). Full text (PDF). 153 classrooms, 27 schools, 3,766 pupils, Years 1–6, England. Source of the seven parameters explaining 16 percent of variance and of the curvilinear complexity result. Recommends no wall-coverage percentage.
    • Rodrigues, P. F. S., & Pandeirada, J. N. S. The Influence of a Visually-Rich Surrounding Environment in Visuospatial Cognitive Performance: A Study with Adolescents. Journal of Cognition and Development 20(3), 399–410 (2019). Full text (PDF). 64 adolescents aged 13–17, Aveiro district, Portugal. The only study located testing visual environment on adolescents. Source of the go/no-go and Corsi figures. The pictures were task-irrelevant and no learning outcome was measured.
    • Education Endowment Foundation. Collaborative learning approaches. Teaching and Learning Toolkit. Toolkit entry. Cited only as the example of publishing an evidence-security rating alongside a recommendation.

    About Clay Shumate

    Clay Shumate is a certified secondary Social Studies teacher in the public schools of West Alabama, with seven years of classroom experience, a B.A. in History, and an M.Ed. in Secondary Education. He writes about project-based learning, student responsibility, respect, and practical ways to hold young people to a higher standard while giving them room to learn from mistakes. He is a member of the Society of Professional Journalists and writes to its Code of Ethics; this site’s editorial standards and corrections policy are published in full. More about Clay.

  • Desirable Difficulty in Grades 6–12: How to Tell One That Pays From One That Just Costs

    Desirable Difficulty in Grades 6–12: How to Tell One That Pays From One That Just Costs

    By Clay Shumate

    A desirable difficulty is a change to how students practice — spacing it out, mixing it up, recalling instead of rereading — that makes performance worse now and retention better later. Robert Bjork’s condition is strict. If the learner cannot respond to the difficulty successfully, it is not desirable. It is just an obstacle.

    Key Takeaways

    What is a desirable difficulty?

    A desirable difficulty is a condition of practice that slows learning down while it is happening and improves what the student can still do weeks later. Spacing, mixing problem types, recalling from memory and varying the format all qualify. Being confused by the textbook does not.

    Robert Bjork coined the phrase in a 1994 chapter, and it is worth knowing that the chapter never defines it. He mentions “the types of desirable difficulties summarized in the preceding section” in passing. The criterion in that chapter is about outcomes, not hardness: manipulations that impede performance during training often improve performance later, and manipulations that speed up training often fail to support it.

    Three panels setting out the condition a difficulty must meet to be desirable, the scaling rule that the optimal level varies with prior learning, and the warning that many difficulties are undesirable forever.
    The condition, in Bjork and Bjork’s own words, from their 2011 chapter and their 2020 follow-up.

    The definition everyone should be quoting is the 2011 one. Difficulties are desirable because “they trigger encoding and retrieval processes that support learning, comprehension, and remembering” — followed immediately by the sentence that does all the work: “If, however, the learner does not have the background knowledge or skills to respond to them successfully, they become undesirable difficulties.”

    By 2020 the Bjorks were sharper about it, because the idea had been simplified into “make it harder” in a thousand training decks. In their stock-taking article they write that “the word desirable is important” and that “many difficulties are undesirable during instruction and forever after.” They also state the scaling rule: “The level of difficulty that is optimal, therefore, will vary with the degree of a learner’s prior learning.”

    That scaling rule is why the same mixed problem set can be a desirable difficulty for one row of your class and a waste of a period for another. It is also why “differentiate the difficulty” is the mechanism here rather than a concession.

    Which difficulties count as desirable?

    Six show up repeatedly in the Bjorks’ own writing: spacing, interleaving, retrieval practice, generating before being shown, varying the conditions of practice, and reducing feedback. Each has its own evidence, and each has a documented way of backfiring.

    DifficultyWhat it looks like in grades 6–12Evidence, with its populationWhen it backfires
    SpacingThe same content revisited across weeks rather than finished in one blockIn 1,354 adults learning trivia facts, the best gap was about 43 percent of a one-week retention interval, falling to 8 percent for a one-year oneA six-lesson spaced revision program in 125 schools returned −0.01 for Year 11 students
    InterleavingMixed problem sets where no two consecutive problems use the same strategy7th-grade math, 787 students, cluster-randomized: 61% against 38%, d = 0.83For learning words, blocking wins (g = −0.39); for expository texts the effect is null
    Retrieval practiceLow-stakes closed-book quizzing with feedback, including on last month’s unit50 classroom experiments, 5,374 students; 46 of 49 effects positive, and largest in middle schoolThree of those effects were negative, and no-feedback studies produced mostly very small ones
    GeneratingStudents attempt the explanation or the formula before the model goes upCalled an effect that “rivals the spacing effect” in generality — with no figures given for itWith novices, worked examples beat generation for geometry problem solving
    Varying practiceThe same skill in different formats, question framings and contexts8- and 12-year-olds throwing at a target did better after varied-distance practice than fixedHigh variability helped alongside worked examples but not alongside ordinary problem solving
    Reducing feedbackSummary feedback after a set of attempts rather than after every oneSimple motor skills only: summary and faded feedback hurt acquisition and helped retentionNo school-subject evidence I could find, and it collides with the feedback finding above

    Read the last row carefully before you act on it. Everything verifiable about reducing feedback is laboratory work on simple motor skills with no sample sizes reported. It is on the canonical list because of where the idea came from, not because anyone has shown it works in a classroom.

    What is the effect size of desirable difficulty?

    There isn’t one. No meta-analysis of desirable difficulty as a construct exists, and the Bjorks’ own 2020 article about the concept reports no effect sizes or sample sizes anywhere in it. Any slide quoting “the effect size of desirable difficulties” has invented the number.

    What exists are numbers for the individual techniques, and they do not aggregate into a single claim. Interleaving has a meta-analysis. Retrieval practice has a systematic review of classroom studies. Spacing has decades of laboratory work and one large school trial that found nothing. Averaging those together would hide exactly the disagreements a teacher needs to see.

    One number does deserve a specific warning, because it is the one that travels. The famous “63 percent versus 20 percent” for mixed practice comes from Rohrer and Taylor’s second experiment in 2007 — 18 university undergraduates, volume-of-solids problems, one-week delay, standard errors of 12 and 9 percentage points. It gets quoted as though it were a school result. If you want a classroom number for mixing problems, the 7th-grade trial below is the real one.

    Does desirable difficulty work in a real classroom?

    Sometimes, by a lot, and sometimes not at all. Three studies run on school students, in schools, at real delays, give the honest range — and the range is wide enough that anyone telling you this is settled has read one of them.

    Table of three school-based studies of desirable difficulties showing the design, the students involved, the delay before testing, and the result, which ranges from a large effect to none at all.
    The three studies run on real school students, with what each one actually produced.

    The strongest result is Rohrer, Dedrick, Hartwig and Cheung’s 2019 trial. One Florida district, 54 classes, 15 teachers, 787 students analyzed, classes randomized within each teacher. Students got eight practice worksheets over about 103 days, either mixed or blocked, then an unannounced test roughly a month after a shared review. Mixed practice scored 61 percent against 38 percent, d = 0.83, and the effect was positive for every one of the fifteen teachers. The teachers were given no training. That is as close to a clean classroom win as this literature gets, and it is why mixing problem types is the one technique here I would act on without hedging. Two costs are in the same paper, though: most teachers said students found the mixed sets slightly harder and more time-consuming, and somebody has to build the worksheets.

    The sobering one is Carpenter, Pashler and Cepeda’s 8th-grade study. Sixty-two students, U.S. history questions, a final unannounced test nine months later. Questions that had been quizzed with feedback scored 3.08 points out of 30. Restudied questions scored 2.18. Never-reviewed questions scored 1.58. The differences are real, d = .32 and .51, and the authors note floor effects. The technique works. It also means that after nine months, the best condition recovered about a tenth of the material.

    Then the null. The Education Endowment Foundation funded SMART Spaces, a manualized spaced-learning revision program for GCSE chemistry: six lessons, each split into three content segments with short activities in between. It was a school-level randomized trial across 125 schools, 14,098 Year 11 students randomized and 11,976 analyzed, at the funder’s highest security rating. The effect size was −0.01, credible interval −0.17 to 0.12, zero additional months’ progress. Implementation was reported as delivered to plan, and 70 percent of teachers said they would happily run it again.

    That last sentence is the important one. You cannot wave that result away as bad implementation. A principle can be true in a laboratory and produce nothing when it is packaged into six lessons and shipped to a hundred schools.

    When does a difficulty become undesirable?

    When the student cannot overcome it. That is the whole test, and it has three recognizable shapes: the student lacks the prior knowledge to respond, the task overloads working memory rather than taxing thinking, or the student already knows the material well enough that the support reverses on them.

    The first shape is Bjork’s own condition, quoted above. A retrieval quiz on material a student never encoded is not a desirable difficulty; it is a measurement of absence. Soderstrom and Bjork say it directly: retrieval practice stops being desirable when the earlier material cannot be retrieved at all.

    The second shape comes from cognitive load research, and the line worth memorizing is from Chen, Castro-Alonso, Paas and Sweller: “Element interactivity refers to working memory load, not difficulty.” When a task already requires holding more pieces at once than a student can hold, they argue, adding difficulty “may be undesirable rather than desirable.” Their evidence is a pattern rather than a number: testing and generation effects show up with simple material and vanish or reverse with material where everything connects to everything else. A reverse testing effect has been documented, and a one-week delay has produced no testing effect at all. This is the seam with cognitive load theory, and it is the honest version of it.

    Fair warning on the vocabulary, though. Ton de Jong’s critique argues that cognitive load theory “is constructed in such a way that it is hard or even impossible to falsify,” that attributing extra load to useful processing is “a post-hoc explanation,” and that the distinction between the kinds of load is “very much a matter of degree, and possibly non-existent.” Use the gate as a heuristic. Do not report it as a measurement.

    The third shape is the expertise reversal effect, named by Kalyuga, Ayres, Chandler and Sweller. The same support that rescues a novice drags on someone who already knows the material. In one of the studies they review, added explanatory text helped low-knowledge high school biology readers while high-knowledge readers did best with the original, minimally helpful version. Worked examples beat problem solving for apprentices with little experience and lost to it once they had more.

    One honest complication, because the prior-knowledge rule is less settled than it sounds. Buchin and Mulligan manipulated prior knowledge directly and reported that testing effects were nearly identical for high and low prior knowledge, concluding prior knowledge is not a critical boundary condition for retrieval practice specifically. I could only read that paper’s abstract. The principle holds firmly for generation and for worked examples; for quizzing, it is contested.

    How do you tell a desirable difficulty from a pointless one?

    Run it through seven gates before you change anything. Each one comes straight out of a study rather than out of a workshop, and a difficulty that fails any of them is costing your students time they do not have.

    1. Can this student respond to it successfully? Not perfectly — successfully, eventually, with effort. If the quiz comes back blank, you have measured an absence rather than created a difficulty.
    2. Is the difficulty in the thinking, or in the number of things being juggled? It should sit in recalling, choosing and connecting. If a student is holding six unfamiliar parts at once just to begin, you have added load, not difficulty.
    3. Has the student had any straightforward practice on this skill first? The 7th-grade trial’s authors say their own result might not hold without some initial blocked practice. The successful version was not pure mixing from day one.
    4. Is there corrective feedback? In the classroom review of retrieval practice, no-feedback studies produced mostly very small effects, and the 7th-grade students were shown solutions and asked to correct their own errors. A difficulty without a correction loop just rehearses a wrong answer.
    5. Is this the kind of material the effect holds for? The interleaving meta-analysis found blocking better for learning words and no effect for expository texts, and its authors say plainly that they are reluctant to recommend mixing for vocabulary, grammar rules or foreign languages.
    6. Is the practice itself ungraded? A student has no way to verify a payoff that arrives in February. Asking them to take that on faith while their grade moves is not a fair trade. Put the difficulty in practice work and keep the grade on the delayed measure.
    7. Are you judging it on a delayed measure? Performance during practice is a poor index of learning, and the gap should match the horizon you care about — roughly a fifth to two-fifths of the interval for a one-week target, falling to a tenth or less for a one-year one. Erring long costs less than erring short.

    Gate six is the one that separates this from deciding how much support to withdraw. Scaffolding is judged on whether the student can do it now. A desirable difficulty is judged on what they can still do in a month, which means you will not know whether you were right during the lesson where it felt wrong.

    Why do students hate the thing that works?

    Because effort feels like failure. Students read mental strain as a signal that learning is not happening, and they are reading it backwards. The mismatch has been measured several times and it is large, consistent, and it catches teachers as reliably as it catches teenagers.

    Four numbered cards showing the gap between how well students learned from spaced and effortful practice and how effective they judged those methods to be.
    The measured gap between what worked and what people believed had worked.

    Kornell and Bjork had 120 undergraduates learn to identify painters’ styles, with some artists’ work spaced out and some blocked together. Spaced study produced 61 percent correct against 35 percent for blocked. Then they asked which had worked better. Sixty-four of the 120 said blocking. Four said spacing. Across two of their experiments, 85 percent of participants did at least as well under spacing while 83 percent rated massing as equally or more effective.

    Kirk-Johnson, Galla and Fraundorf went after the mechanism and found it: “Strategies experienced as more mentally effortful are interpreted as less effective for learning.” In their third study, 80 undergraduates rated retrieval practice as both more effortful and less effective than restudying — and the students who chose retrieval anyway recalled more.

    Bjork named the teacher-side version of this in 1994 and it is uncomfortable reading. Trainers are overexposed to day-to-day performance, are judged on how learning looks while it is happening, rarely see what happens afterward, and almost never collect the measurement that would tell them. Every one of those is true of a teacher with a gradebook. The method that makes your Tuesday look best is not necessarily the one your students will still own in May. Which study techniques students actually believe in, and what the evidence says about each, is the subject of the site’s page on study skills.

    How is desirable difficulty different from productive struggle?

    They answer different questions. Productive struggle is about a student working on a task right now and whether you step in. Desirable difficulty is a claim about how practice is scheduled and formatted, and it can only be judged weeks later.

    The practical consequence is that you can watch productive struggle happen and make a judgment call in the moment. You cannot watch a desirable difficulty work. If you are mixing problem types in November to improve what students retain in February, every signal available to you in November — lower scores, slower work, complaints — points the wrong way. That is not a reason to ignore the signals. It is a reason to decide in advance what you will measure and when.

    Clay’s take: pick one, and measure it late

    If I acted on one line of this research, it would be mixed practice in problem sets. The 7th-grade trial is the only study here run on students this age, in real classes, by teachers given no training — and it worked for all fifteen of them.

    What I would not do is adopt all six at once and call it a philosophy. The Bjorks themselves quote the line that “too often, the classroom is where promising interventions go to die,” and they concede they had assumed, unrealistically, that telling teachers about the research would be enough. A 125-school null result on spacing is what that looks like in practice.

    And I would tell students what you are doing and why, before the scores dip. “This set is mixed on purpose, it will feel worse than last week’s, and the first score is not the measure” costs thirty seconds and answers the only fair objection a teenager has here — that their grade moved while you ran an experiment on them. Better still, do not let it move: keep the harder practice ungraded and put the grade on the delayed test. The research says students will not believe you anyway. Say it, and then show them the February result.

    Frequently Asked Questions

    What is a desirable difficulty in simple terms?

    It is a change to how students practice that makes their performance worse while they are practicing and better weeks later. Spacing content out, mixing problem types, recalling from memory instead of rereading, and varying the format are the usual examples. The difficulty has to be one the student can actually overcome.

    Who came up with desirable difficulties?

    Robert Bjork coined the phrase in a 1994 book chapter, though that chapter never defines it. The definition people quote comes from Elizabeth and Robert Bjork’s 2011 chapter, and they restated it in a 2020 article where they stressed that the word desirable is important and that many difficulties are undesirable permanently.

    What is the effect size of desirable difficulty?

    There is no such number. No meta-analysis of desirable difficulty as a construct exists, and the Bjorks’ own article about the concept reports no effect sizes at all. Individual techniques have their own figures, and those figures disagree with each other, which is exactly why averaging them would be misleading.

    Does desirable difficulty work with middle and high school students?

    The best evidence says sometimes. A cluster-randomized trial of mixed math practice with 787 seventh graders found 61 percent against 38 percent on a delayed test. A spaced revision program delivered to about 12,000 Year 11 students in 125 schools found nothing at all. Both studies are good ones.

    When is a difficulty undesirable?

    When the student cannot overcome it. That happens when they lack the prior knowledge to respond at all, when the task overloads working memory rather than taxing their thinking, or when they already know the material well enough that the extra support or demand reverses on them. A quiz on material never learned measures absence.

    Is desirable difficulty the same as productive struggle?

    No. Productive struggle describes a student working on a task in front of you and whether you intervene. Desirable difficulty is a claim about how practice is scheduled and formatted, and it can only be judged on a delayed test. You can watch productive struggle. You cannot watch a desirable difficulty work.

    Why does studying that feels easy not work?

    Because fluency is a bad signal. Rereading and massed study feel smooth, so students read that smoothness as learning. Research on the mismatch found that most participants learned more from spaced practice while most of them judged massed practice to be as good or better. Effort gets interpreted as failure.

    Does making work harder improve learning?

    Not on its own, and the researchers behind the idea say so. Difficulty is only desirable when the learner has the background knowledge or skills to respond successfully, and the optimal level varies with how much a student already knows. Plenty of difficulties are undesirable during instruction and afterwards too.

    Sources

    • Bjork, E. L., & Bjork, R. A. Making Things Hard on Yourself, But in a Good Way: Creating Desirable Difficulties to Enhance Learning. In Gernsbacher, Pew, Hough & Pomerantz (Eds.), Psychology and the Real World, Worth Publishers, 2011. Chapter (PDF). Source of the definition and of the condition that a difficulty becomes undesirable when the learner lacks the background knowledge or skills to respond successfully, the canonical list, the storage-and-retrieval-strength distinction, and the quotation of the 63 against 20 percent figure.
    • Bjork, R. A. Memory and Metamemory Considerations in the Training of Human Beings. In Metcalfe & Shimamura (Eds.), Metacognition: Knowing About Knowing, MIT Press, 1994. Chapter (PDF). Source of the phrase itself and of the fact that the chapter never defines it, the outcome-based criterion, the reduced and summary feedback findings for simple motor skills, and the account of why trainers misread their own learners.
    • Bjork, R. A., & Bjork, E. L. Desirable difficulties in theory and practice. Journal of Applied Research in Memory and Cognition, Vol. 9, No. 4, pp. 475–479 (2020). Full text (PDF). Source of “the word desirable is important,” “many difficulties are undesirable during instruction and forever after,” the rule that the optimal level of difficulty varies with prior learning, the requirement that a difficulty be potentially solvable, and the classroom-is-where-interventions-go-to-die quotation. This article reports no effect sizes anywhere.
    • Soderstrom, N. C., & Bjork, R. A. Learning versus Performance: An Integrative Review. Perspectives on Psychological Science, Vol. 10, No. 2, pp. 176–199 (2015). Full text (PDF). Source of the learning and performance definitions, the statement that performance during acquisition is a highly imperfect index of long-term learning, the point that retrieval practice stops being desirable when nothing can be retrieved, and the varied-practice studies described second-hand here.
    • Rohrer, D., Dedrick, R. F., Hartwig, M. K., & Cheung, C.-N. A randomized controlled trial of interleaved mathematics practice. Journal of Educational Psychology (2019). Full text (PDF). Source of the 7th-grade cluster-randomized design, 54 classes and 15 teachers in five schools, 787 students analyzed, the 61 against 38 percent result and d = 0.83, the positive effect for all fifteen teachers, and the authors’ own cautions about initial blocked practice, corrective feedback and time cost.
    • Hodgen, J., Bretscher, N., Hardman, M., Anders, J., & Lawson, H. SMART Spaces: Spaced Learning Revision Programme — Evaluation Report. UCL Institute of Education for the Education Endowment Foundation, 2023. Evaluation report (PDF). Source of the school-level randomized design, 125 schools and 14,098 Year 11 pupils randomized with 11,976 analyzed, the effect size of −0.01 with a credible interval of −0.17 to 0.12, zero additional months’ progress at a high security rating, and the finding that the program was delivered as intended with 70 percent of teachers willing to run it again.
    • Carpenter, S. K., Pashler, H., & Cepeda, N. J. Using tests to enhance 8th grade students’ retention of U.S. history facts. Applied Cognitive Psychology, Vol. 23, pp. 760–771 (2009). Full text (PDF). Source of the 8th-grade classroom design with 62 students analyzed, the nine-month delayed test, the scores of 3.08, 2.18 and 1.58 out of 30, the effect sizes of .32 and .51, and the authors’ own note that floor effects limit the size of those differences.
    • Cepeda, N. J., Vul, E., Rohrer, D., Wixted, J. T., & Pashler, H. Spacing effects in learning: A temporal ridgeline of optimal retention. Psychological Science, Vol. 19, No. 11, pp. 1095–1102 (2008). Full text (PDF). Source of the optimal gap ratios of roughly 43, 23, 17 and 8 percent of a 7-, 35-, 70- and 350-day retention interval, and of the finding that an overly long gap costs less than an overly short one. The participants were 1,354 adults with a mean age of 34, not school students.
    • Brunmair, M., & Richter, T. Similarity matters: A meta-analysis of interleaved learning and its moderators. Psychological Bulletin (2019). Full text (PDF). Source of the overall effect of g = 0.42 across 158 samples and 8,466 participants, the reversal for words at g = −0.39, the null result for expository texts, the figure of g = 0.34 for mathematical tasks, and the authors’ stated reluctance to recommend interleaving for vocabulary, grammar rules and foreign languages. Most samples were university students.
    • Agarwal, P. K., Nunes, L. D., & Blunt, J. R. Retrieval practice consistently benefits student learning: A systematic review of applied research in schools and classrooms. Educational Psychology Review (2021). Full text (PDF). Source of the 50 classroom experiments with 5,374 students, the 46 of 49 positive effects and the three negative ones, the finding that effects were largest in middle school, and the finding that studies without feedback produced mostly small or very small effects.
    • Kornell, N., & Bjork, R. A. Learning concepts and categories: Is spacing the “enemy of induction”? Psychological Science, Vol. 19, No. 6, pp. 585–592 (2008). Full text (PDF). Source of the 61 against 35 percent spacing result with 120 undergraduates, the 64-against-4 judgment split, and the combined finding that 85 percent of participants did at least as well under spacing while 83 percent rated massing as equally or more effective.
    • Kirk-Johnson, A., Galla, B. M., & Fraundorf, S. H. Perceiving effort as poor learning: The misinterpreted-effort hypothesis. Cognitive Psychology, Vol. 115 (2019). Full text (PDF). Source of the finding that strategies experienced as more effortful are interpreted as less effective, and of the third study with 80 undergraduates in which retrieval practice was rated more effortful and less effective while the students who chose it recalled more. The participants were online adults and undergraduates, not school students.
    • Chen, O., Castro-Alonso, J. C., Paas, F., & Sweller, J. Undesirable Difficulty Effects in the Learning of High-Element Interactivity Materials. Frontiers in Psychology, Vol. 9, Article 1483 (2018). Full text (PDF). Source of the statement that element interactivity refers to working memory load rather than difficulty, the argument that added difficulty may be undesirable when working memory is already exceeded, and the documented reverse testing and generation effects. This paper reports no sample sizes or effect sizes, so it is cited here for the pattern only.
    • Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. The expertise reversal effect. Educational Psychologist, Vol. 38, No. 1, pp. 23–31 (2003). Full text (PDF). Source of the definition of the effect and of the reviewed cases, including the high school biology readers for whom added coherence helped the low-knowledge group and hurt the high-knowledge one, and the worked-example reversal with more experienced apprentices. The paper reports no sample sizes or effect sizes.
    • de Jong, T. Cognitive load theory, educational research, and instructional design: some food for thought. Instructional Science, Vol. 38, pp. 105–134 (2010). Full text (PDF). Source of the criticism that cognitive load theory is hard or impossible to falsify, that attributing load to useful processing is a post-hoc explanation, and that the distinction between types of load is a matter of degree and possibly non-existent. The paper does not discuss desirable difficulties and is cited here as a critique of the vocabulary, not of Bjork.
    • Rohrer, D., & Taylor, K. The shuffling of mathematics problems improves learning. Instructional Science, Vol. 35, pp. 481–498 (2007). Full text (PDF). Source of the 63 against 20 percent figure and of its true population: Experiment 2, 18 university undergraduates, a one-week delay, with standard errors of 12 and 9 percentage points.
    • Buchin, Z. L., & Mulligan, N. W. Retrieval-based learning and prior knowledge. Journal of Educational Psychology, Vol. 115, No. 1, pp. 22–35 (2023). Abstract. Source of the finding that testing effects were nearly identical for high and low prior knowledge and that prior knowledge is not a critical boundary condition for retrieval-based learning. Only the abstract was read for this article, so the sample size, country and statistics are not reported here.

    About Clay Shumate

    Clay Shumate is a certified secondary Social Studies teacher in the public schools of West Alabama, with seven years of classroom experience, a B.A. in History, and an M.Ed. in Secondary Education. He writes about project-based learning, student responsibility, respect, and practical ways to hold young people to a higher standard while giving them room to learn from mistakes. He is a member of the Society of Professional Journalists and writes to its Code of Ethics; this site’s editorial standards and corrections policy are published in full. More about Clay.

  • How to Keep Students Motivated Before Winter Break (Free Download: 100 Activities)

    How to Keep Students Motivated Before Winter Break (Free Download: 100 Activities)

    By Clay Shumate

    To keep students motivated before winter break, shorten the tasks without lowering the standard, give every task a clear finish line, and keep your routine exactly the same. Plan for absences and broken schedules instead of fighting them. The free download on this page gives you 100 short activities for grades 6-12 that fit that plan.

    Key Takeaways

    • The slump is real and predictable. Attendance data from several districts shows absences climbing in the days around Thanksgiving and winter break.
    • Shorter tasks beat easier tasks. Students will still work hard for ten minutes when they can see the end of it.
    • Routine matters more now, not less. When the schedule is unpredictable, your class should not be.
    • Plan for the empty seats. Stand-alone lessons mean an absent student misses one task, not the thread of a whole unit.
    • The free download does the prep. It holds 100 activities across reading, math, social studies and science, each built to take 8 to 15 minutes.

    Why does student motivation drop between Thanksgiving and winter break?

    Motivation drops because four things hit at once: more absences, broken schedules, a finish line everyone can see, and plain tiredness. None of them is a character flaw in your students. They are conditions, and conditions can be planned for.

    Four reasons student motivation drops before winter break: attendance, schedules, attention and energy
    Four conditions that arrive together in late fall.

    Attendance. Education Week reported on Wayne State University researchers who studied one year of Detroit attendance records and found the most absences on the days just before the Thanksgiving and Christmas breaks, along with the last week of school. An analysis of multi-year attendance data described by EveryDay Labs points the same way: a fall attendance dip around both breaks that was there before the pandemic too.

    Schedules. Assemblies, testing windows, concerts and half days cut class time into odd pieces. A lesson that needs three connected days rarely gets them.

    Attention. When a long break is two weeks away, a three-week project feels pointless to a fourteen-year-old. That is a reasonable reaction, not laziness.

    Energy. Everyone in the building has been going since August, the adults included. One small University of Sheffield study followed 90 teachers across a Christmas break and found that exhaustion had usually not fully cleared by the time school started again. It was a small British sample, so treat it as a signal, not a law. It does fit what most teachers already feel in December.

    How do you keep students motivated before winter break?

    Use six moves: shorten the task, show the finish line, hold the routine, offer a choice, plan for absences, and save one thing worth showing up for. Each one answers one of the four conditions above.

    Six ways to keep students motivated before break: shorten the task, give a visible finish line, keep the routine, offer a choice of two tasks, plan for absences, and save one thing worth showing up for
    Six moves for the weeks before break.

    1. Shorten the task, not the standard

    Ask for the same quality of thinking in a smaller container. One strong paragraph with evidence is still real writing. Five well-chosen math problems still show who understands. What changes is the length, so a student can start and finish in one sitting.

    2. Give every task a visible finish line

    Tell students exactly what done looks like before they begin: three questions, ten minutes, one sentence to share. Young adults work harder when they can see the end, the same way the rest of us do. A quick check for understanding at the end closes the loop.

    3. Keep the routine exactly the same

    Start class the way you always start it. If the bell ringer is on the board in September, it is on the board the day before break. Predictable openings calm a room that has had its schedule rearranged all week. If your routines were never written down, a classroom management plan is the place to fix that before January.

    4. Let students choose between two tasks

    Put two activities on the board and let each student pick one. Both hit the same skill. The choice costs you nothing and gives students a small piece of control at a time of year when most decisions are made for them. More ideas like this are in our list of student motivation activities.

    5. Plan for the students who are absent

    Build these weeks from lessons that stand alone. A student who misses Tuesday should be able to walk in Wednesday and take part without a packet of make-up work. That is fair to the student whose family set the travel plans, and it saves you hours of re-teaching.

    6. Save one thing worth showing up for

    Hold back something students want to be in the room for: a debate, a build challenge, a review game, a presentation day. Tell them when it is. Districts working on attendance use the same idea at a larger scale, planning events that make the final days before a break feel like something a student would not want to miss.

    What is in the free download?

    The Thanksgiving-to-Winter-Break Survival Kit is a free 39-page PDF with 100 no-prep activities for grades 6-12: 25 reading and writing, 25 math, 25 social studies and history, and 25 science. Each takes about 8 to 15 minutes, and a numbered answer key is at the back.

    Cover and two sample pages from the free Thanksgiving-to-Winter-Break Survival Kit, a 39-page PDF of 100 activities for grades 6-12
    The cover and two sample pages from the free download.
    • Built for the six moves above. Every activity is short, has a clear end, and stands alone, so an absent student misses one task and nothing else.
    • Works across grades 6-12. Reading, social studies and science activities end with a Level Up prompt for older students. Math sets are labeled by grade band or course.
    • Almost no supplies. One activity needs paper, tape and scissors. The rest need a pencil.
    • Seasonal without being fluff. Topics include the 1621 harvest feast and its sources, the Montgomery bus boycott, Black Friday percents, why leaves change color and why ice floats.

    Use the activities as bell ringers, early-finisher work, sub plans, or filler for the short blocks an assembly leaves behind. The kit is free for one teacher to use in their own classroom.

    More free printables are in the ElevateTheNorm resource library, and a new warm-up for every school day goes out through BelltoBell.org.

    Should you lower expectations before winter break?

    No. Change the size of the work, not what you expect from students. Movie days and free time tell students the learning is over and that showing up is optional, which makes the attendance problem worse.

    Students notice when adults stop expecting anything from them, and most of them take it as a judgment. Holding the standard while shrinking the task says something different: the work still matters, and so does the fact that everyone is tired. That is how you treat a young adult. It is also the idea behind teaching responsibility the rest of the year.

    There is room for fun. A review game or a class celebration on the last day is a fine thing. The difference is whether it is one planned event students earned, or three weeks of coasting.

    How do you handle behavior in the last weeks before break?

    Stay consistent. Use the same expectations and the same consequences you used in October, delivered calmly. Late fall is when small exceptions pile up into a different classroom than the one you built.

    Keep in mind that a long break is not good news for every student. For some, school is the steadiest place in their week, and the days before a break can bring worry instead of excitement. A student who is short-tempered in mid-December may not be counting down the way the rest of the room is. Private, quiet correction and consequences that fit the behavior serve that student better than a public showdown.

    If you want to keep students motivated before winter break, the plan is simple to say and takes discipline to hold: short work, clear endings, the same routine, and one thing worth showing up for.

    Frequently Asked Questions

    How do you keep students motivated before winter break?

    Shorten tasks without lowering the standard, tell students exactly what finished looks like, keep your opening routine the same, offer a choice between two tasks, build lessons that stand alone so absences do less damage, and save one activity students want to be present for.

    Why are students less motivated between Thanksgiving and winter break?

    Several things happen together. Absences rise around both breaks, schedules are interrupted by assemblies and testing, the break itself makes long assignments feel pointless, and students and teachers are tired after months of school.

    What is included in the free download?

    The Thanksgiving-to-Winter-Break Survival Kit is a free 39-page PDF with 100 no-prep activities for grades 6-12. It has 25 activities each for reading and writing, math, social studies and history, and science, plus a numbered answer key.

    Is the download really free, and do I need to sign up?

    Yes, it is free, and the button on this page opens the PDF directly with no sign-up. It is licensed for one teacher to use in their own classroom. Please share the link to this page instead of the file.

    Should I start a new unit before winter break?

    It is usually better not to start a long unit that depends on students being present every day. Short stand-alone lessons, review, and small projects that finish before the break hold up better when attendance and schedules are unpredictable.

    Is it okay to show a movie the day before break?

    One planned event is fine, especially if students know it is coming and it connects to what they have learned. The problem is several days of free time, which signals that attendance is optional and can make absences worse.

    Can a substitute teacher use these activities?

    Yes. Each activity has its directions on the page and the answer key is at the back, so a substitute can hand out three or four activities from your subject and check the work without extra instructions.

    Sources

    • Education Week. Why Students Take Off the Day After Halloween. edweek.org. Source for the Wayne State University finding on Detroit absences before the Thanksgiving and Christmas breaks. The news report, not the underlying study, was read.
    • EveryDay Labs. What the Research Says About Fall Attendance and High Impact Steps to Take Now. everydaylabs.com. Source for the description of a fall attendance dip around Thanksgiving and winter break. EveryDay Labs sells attendance services, and its summary of the American Enterprise Institute study was read, not the study itself.
    • University of Sheffield. Teachers’ wellbeing doesn’t fully recover over the Christmas break, study finds. sheffield.ac.uk. Source for the finding on teacher exhaustion. The study followed 90 UK primary and secondary teachers over one Christmas break; the university news release was read, not the journal article.

    About Clay Shumate

    Clay Shumate is a certified secondary Social Studies teacher in the public schools of West Alabama, with seven years of classroom experience, a B.A. in History, and an M.Ed. in Secondary Education. He writes about project-based learning, student responsibility, respect, and practical ways to hold young people to a higher standard while giving them room to learn from mistakes. He is a member of the Society of Professional Journalists and writes to its Code of Ethics; this site’s editorial standards and corrections policy are published in full. More about Clay.

Teacher Emergency Toolkit — practical resources, real classroom support. Shop on TPT.Teacher Emergency Toolkit — practical resources, real classroom support. Shop on TPT.