Social Media and the “Double-Edged” Sword of Damocles

Survival Rests on Humility, Self-Control, and the Principles of Public Relations

[CLICK HERE to read this Blog on the Project ACHIEVE Webpage]

Dear Colleagues,

Introduction

   Social Media is a fickle bitch.

   Right there, I may have lost you. . . but made my point.

   You see. . . if I offended you by swearing in print. . . or by assuming that social media is “female,” and my comment resurrected all sorts of angst regarding either your mother (and the first time you uttered a swearword), or gender biases and stereotypes. . .

    And you have now (a) stopped reading this Blog, and (b) scrolled to the bottom. . . ready to “rip off” a punishing comment or two. . .

   Then, I have made my point.

   My broader, and real point is that Social Media has both benefits, and the potential for significant, life-long losses. . . losses that might involve the Supreme Court, jeopardize a career, or permanently scar an adolescent’s life (or worse).

   We all need Social Media training.

   And to expand my points in a recent Blog,

What Super Bowl Commercials Teach Education About Media and Product Literacy

[CLICK HERE to READ]. . .

    This training needs to start with Media Psychology and Media Literacy, and include Public Relations.

_ _ _ _ _ _ _ _ _ _

Social Media and the Double-Edged Sword of Damocles

   Social Media, as in the title above, is the new “Double-Edged” Sword of Damocles for many people.

   History.com recounts the story in this way:

The famed “sword of Damocles” dates back to an ancient moral parable popularized by the Roman philosopher Cicero in his 45 B.C. book “Tusculan Disputations.” Cicero’s version of the tale centers on Dionysius II, a tyrannical king who once ruled over the Sicilian city of Syracuse during the fourth and fifth centuries B.C.

 

Though rich and powerful, Dionysius was supremely unhappy. His iron-fisted rule had made him many enemies, and he was tormented by fears of assassination—so much so that he slept in a bedchamber surrounded by a moat and only trusted his daughters to shave his beard with a razor.

 

As Cicero tells it, the king’s dissatisfaction came to a head one day after a court flatterer named Damocles showered him with compliments and remarked how blissful his life must be. “Since this life delights you,” an annoyed Dionysius replied, “do you wish to taste it yourself and make a trial of my good fortune?” When Damocles agreed, Dionysius seated him on a golden couch and ordered a host of servants to wait on him. He was treated to succulent cuts of meat and lavished with scented perfumes and ointments.

 

Damocles couldn’t believe his luck, but just as he was starting to enjoy the life of a king, he noticed that Dionysius had also hung a razor-sharp sword from the ceiling. It was positioned over Damocles’ head, suspended only by a single strand of horsehair. From then on, the courtier’s fear for his life made it impossible for him to savor the opulence of the feast or enjoy the servants. After casting several nervous glances at the blade dangling above him, he asked to be excused, saying he no longer wished to be so fortunate.

 

For Cicero, the tale of Dionysius and Damocles represented the idea that those in power always labor under the specter of anxiety and death, and that “there can be no happiness for one who is under constant apprehensions.”

 

The parable later became a common motif in medieval literature, and the phrase “sword of Damocles” is now commonly used as a catchall term to describe a looming danger. Likewise, the saying “hanging by a thread” has become shorthand for a fraught or precarious situation.

 

One of its more famous uses came in 1961 during the Cold War, when President John F. Kennedy gave a speech before the United Nations in which he said that “Every man, woman and child lives under a nuclear sword of Damocles, hanging by the slenderest of threads, capable of being cut at any moment by accident or miscalculation or by madness.”

   While we could discuss how Kennedy’s fear is even more present today, the point of today’s Blog—once again—is that Social Media’s power to enhance or destroy hangs above each of us who use it.

   The power is “double-edged,” and. . . to a large extent. . . we hold the “keys” to the power.

_ _ _ _ _ _ _ _ _ _

Social Media I: Think Before You Act, and then, Think Again

   Over the past month, a colleague of mine has experienced a self-inflicted international (yes, I said “international”) public relations catastrophe.

   It began when she complained to the leadership of a large national service-provider about a few employees who were “breaking” minor, innocuous rules that had no personal effect on her or any other customers... all to receive compensation for either her “attentiveness” or her “inconvenience.”

   The problem is that she then went onto Social Media to publicize her actions and to gloat about receiving “compensation” that turned out to be “pennies on the dollar.”

   And how did I find out about this situation?

   I never saw her original Social Media post. Instead, I saw a post of hers on another Social Media channel where she (a) said she was going through a “hard time,” (b) asked for people’s prayers, and (c) said it did not matter what the “hard time” was about.

   So what did I do?. . . as, naturally, inquiring minds “want to know”. . .

   I googled her name, and up popped multiple stories—with professional pictures of her—describing the “social media offense” she had reported. . . as noted above.

   Since then, my colleague has become an international villain on the trade websites and in the related blogs, Facebook, and other social media platforms of the industry-employees that she “turned in”. . .

. . . and she has been vilified for the pettiness of her complaint to “corporate,” and ripped apart for gloating about the “personal phone call” that she received from “corporate” when awarded “her compensation.”

   “But, there’s more” (as Marisa Tomei exclaimed from the witness stand in My Cousin Vinny). . .

   Employees from the company that my colleague complained to. . . from across the country. . . and those who were just appalled at what she did. . . from across the world. . . decided to take action.

  (It seems the professional she complained about may have lost his job.)

   They went into my colleague’s Amazon store and trashed her reputation, products, and customer service ratings. . . resulting in Amazon closing the store for a period of time.

   They went onto my colleague’s Facebook, LinkedIn, and other social media platforms. . . and did the same thing. . . resulting in her closing those accounts, and changing her name so that she could “safely’ reopen them.

   And one person even created a real website using my colleague’s name in the URL to catalog the “original sin,” and the international media blitz that continues to this day.

   And my colleague. . . responded to the posts by “doubling down” and defending her original complaint to “Corporate,” and then threatening those negatively posting about her with FBI surveillance and possible legal action.

_ _ _ _ _

   I could not make this up if I tried.

   Here are the first social media take-aways. . . take aways that we all need to learn from, that we need to teach our children, and that we—who are educators—need to make sure are part of the media literacy training in our schools:

   Relative to Social Media posts:

·       Take-Away #1. Think before you post, and then Think again. 

·       Take-Away #2. Once you have posted virtually, you virtually have no control over your post’s interpretation or how others’ respond. 

·       Take-Away #3. You can’t win a virtual argument; you can only force it underground. . . and it surely will resurface—but not the way you want. 

·       Take-Away #4. Nothing is private any more. You can ask for privacy, but if someone wants to know “Why?”, there are 5 million Google hits that will inform them. 

·       Take-Away #5. One social media mistake could affect you for the rest of your life.

_ _ _ _ _ _ _ _ _ _

Social Media II: Let Your Ego do the Walking, and Your Humility do the Talking

   Unfortunately, my colleague broke any number of “rules” of public relations (and common sense) in handling this catastrophe (never mind the original social media mis-step).

   Instead of being humble, and publicly admitting her mistake in a gracious and heart-felt way, she took the “Trumpian” approach of doubling down and meeting “fire with fire.”

   Critically, she had nothing to lose by letting her ego “stand down,” and everything to lose (which, in essence, she has) by seeing herself as “the victim,” and letting her blind stubbornness “stand firm.”

_ _ _ _ _

   Beyond my colleague, school districts and their leaders are constantly in “the public eye.”

   Whether it is at a School Board meeting, posting on a school or district Facebook page, responding to a single parent’s e-mail (that is then shared with parents across the school or community), educators are public agents, and they must recognize their unwitting “public relations” position—for good or for bad.

   According to the Salient Public Relations firm, when facing a public relations catastrophe, the following key steps (edited) should be considered before a public response:

·        Understand Your PR Failures: To prevent damage to your reputation and/or your organization’s public standing or perception, it is crucial to understand the causes and consequences of your public relations failure.

Some common causes include (a) inadequate or inappropriate communications; (b) making policy or procedure decisions or actions without having all of the facts or conferring with your constituencies; (c) mismanaging political, social, or cultural language or contexts; and (d) demonstrating high levels of inconsistency, favoritism, inequity, or bias.

_ _ _ _ _

 

·        Crisis Management Plan: Convene a trusted and expert team (including outside consultants and/or legal counsel, if needed) as soon as possible, and create a crisis management plan.

This plan should outline how to respond swiftly and effectively when a crisis occurs. It includes assessing the situation, preparing stakeholders, creating a response team, and drafting a press release.

_ _ _ _ _

 

·        Clear Communication: Prioritize clear communication with stakeholders, your different publics, and/or the individual(s) who were harmed. Transparency is essential during a crisis.

Keep customers/constituents, employees/staff, investors/Board of Directors, and the public informed about the situation and any corrective actions being taken.

_ _ _ _ _

 

·        Sincere Apologies: If necessary, issue prompt and genuine apologies. Acknowledge mistakes, take responsibility, and express remorse. A sincere apology can go a long way in rebuilding trust.

_ _ _ _ _

 

·        Corrective Actions: Implement corrective actions to address the root cause of the crisis. Learn from the situation and use it as a learning opportunity. Show determination to right the wrongs.

_ _ _ _ _ 

   Remember, prevention is key. Avoid over-promising and always strive to over-deliver. Be authentic, and given people opportunities to respect you and the organization that you represent.  

   Additionally, never ignore a crisis, as that communicates indifference or disrespect. Instead, focus on correcting the situation and demonstrating empathy. Give the process time, and don’t over-communicate or get in your own way. 

   Forgiveness, and the process of recuperating from a public relation catastrophe takes time, patience, and trust—in yourself and others. Time is a healing necessity. If you go too fast, the healing will not last.

_ _ _ _ _ _ _ _ _ _

Social Media III:  Intent Can be Misinterpreted, and Needs to be Carefully Clarified

   Personal (and professional) Story. . .

   I always share my Blogs across a variety of social media channels.

   Invariably. . . because “a picture is worth a thousand words”. . . I handpick a picture that (a) provocatively reflects the essence of the Blog, (b) immediately (I hope) attracts people to the post, and (c) helps give a lasting impression and memory to what people have read.

   A number of Blogs ago, I discussed how “Too many schools are teaching students to control their emotions the wrong way.”

   For that post, I chose a picture of an angry fifth-grade African-American sitting at her classroom desk girl with her fists clenched. . . glaring at the camera.

   I chose the picture consciously. . . after a great deal of thought and internal debate. . . weighing the potential stereotype of depicting an angry Black schoolgirl against using a “more neutral and safer picture.”

   Obviously, the picture I used won out.

   The response to the Blog. . . the words on the “paper”. . . were overwhelmingly positive. . . and the Blog was a “best seller.”

   But, I receive one scathing comment. . . that accused me of proliferating racial biases and made a number of unflattering statements. The comment ended with the individual posting a picture that s/he thought was more appropriate and “less offensive.”

   The comment could have gone viral. . . the Blog’s message could have been “lost in space”. . . and I knew I needed to respond. . . carefully and respectfully.

   I considered and took many of the actions outlined in the section immediately above. . . to avoid a public relations catastrophe.

   And, I posted the following response:

Dear Colleague,

 

I appreciate your comment. Know that my intent is never to offend, and I apologize if that was your reaction.

 
While your photo is great, those of us who post frequently usually take great care before posting their story-related pictures.

 

Indeed, if you follow my work, you know that I use many group shots of diverse students, and rotate the race and gender of my single-student photos.

In this case, I consciously chose this picture.... very carefully weighing the positives and negatives. I went ahead with this selection, actually, because of the reality that some DO stereotype Black schoolgirls. . . in many negative ways.

I wanted these people, especially those with implicit biases, to read the article to help them understand that lack of emotional control is not about gender or race, but the contexts of the emotionality, the lack of scientific emotional control instruction, and the reality that many educators (and others) don't necessarily understand the complexities of children's emotions and behaviors.

 
I hope you understand this explanation, even though you may disagree.

Best,

Howie

_ _ _ _ _ _ _ _ _ _

Summary

   Sometimes it just seems that social media is just a “new toy” that we all need to “figure out.”

   But I keep trying to identify a similar innovation from the past that has the both the enormous upsides and devastating downsides of social media. . . all as fueled by the internet.

   I can’t come up with one.

   On the upside. . . social media is a way of connecting, communicating, learning, marketing, and teaching.

   On the downside. . . social media is responsible for some child and adolescent depression and other mental health issues, it has become (for some) an obsessive waste of time and an agent of distraction and procrastination, and it has created a generation of wanna-be “influencers” who live in a fantasy world of “likes” and “hits.”

   For those who believe that they are “in control” of their social media interactions, you only need to recognize that algorithms control what you see on social media, and that companies control the algorithms.

   To finish this Blog, I asked Microsoft Copilot, my computer’s AI-powered search assistant, “Who controls the algorithms on social media?” [I hope you get the irony here.]

   The response was the following: 

Social media algorithms are primarily controlled by the platforms themselves, but let’s dive deeper into this:

 

Platform Companies (like) Google and Facebook wield significant power over the information ecosystem. Their algorithms shape what content users see and interact with on their platforms.

 

These companies design and maintain the algorithms that determine the order of posts, recommendations, and personalized content.

_ _ _ _ _

 

Algorithm Development:

 

Coders and Engineers: Algorithms are created by teams of coders and engineers within these platform companies. They use machine learning techniques to develop and fine-tune the algorithms. This allows them to learn from user interactions and adapt over time.

 

Ranking Signals: Algorithms consider various ranking signals to prioritize content:

 

·       User Engagement: Likes, comments, shares, and clicks influence content visibility.

 

·      Relevance: Algorithms analyze the content’s relevance to individual users based on their past interactions.

 

·        Timeliness: Fresh content often gets priority.

 

·       Personalization: Algorithms tailor content to each user’s preferences.

_ _ _ _ _

Content Moderation Policies: Algorithms also enforce content moderation policies set by the platform companies. These policies dictate what content is allowed, flagged, or removed. Content moderation decisions can significantly impact users’ experiences.

 

In summary, social media algorithms are a blend of technology, data, and policy decisions. While the platforms control the algorithms, their impact extends to every user, shaping what appears in our feeds and influencing our online interactions.

_ _ _ _ _

   So let’s go full-circle.

   In order to control the algorithms that control social media that control users, users need to use self-control.

   And that means, to put this in Freudian terms, that our Super-Egos need to control our Ids in order to preserve our Egos.

   My colleague. . . with the public relations catastrophe. . . let her Id get in the way.

   She wanted to “show off” her “power” in being able to complain about a few service company employees who were “breaking” minor, innocuous rules that had no personal effect on her or any other customers.

   She triggered her “problem” by publicizing her actions and her receipt of a piddling amount of compensation for these actions.

   Her social media post resulted in a tumultuous negative international deluge of other people’s Ids. . . which has impacted my colleague both professionally and emotionally (the recent posts in her new-named social media accounts suggest she is traumatized).

   And yet, her Id doubled-down. . . as it continues to “win” over her Super-Ego and common sense.

   Once again:

   In order to control the algorithms that control social media that control users, users need to use self-control.

   For my educator-colleagues:

   We need to (continue to) teach these lessons to our children and adolescents as often as possible in effective, developmentally-sensitive ways.

_ _ _ _ _

   This Blog has discussed Social Media as the new “Sword of Damocles”  that hangs above us with the power to enhance or destroy each of us who uses it. We assert that the power of Social Media is “double-edged,” and. . . to a large extent. . . that our self-control, humility, common sense, and ability to honestly self-reflective are the “keys” to the power.

   The Blog tells the tale of a colleague who recently mis-used social media to complain to “Corporate” about a few service company employees who were “breaking” minor, innocuous rules that had no personal effect on her or any other customers.

   She triggered a social media catastrophe by publicizing her actions, including the piddling amount of compensation she received for her complaints. This triggered an international backlash debilitating her professional sales and reputation, and her personal and “social media” life.

   The Blog uses this cautionary tale to discuss how to self-control Social Media, and five social media take-aways that we all need to learn and to teach our children. We share what Public Relations firms suggest to moderate a public relations catastrophe. And, we give a personal example of how to respond when negative comments are posted on a social media post.

   The social media Sword of Damocles has fallen on far too many users.

_ _ _ _

   We hope that this Blog has been both relevant and helpful to you. . . personally and professionally.

   As we enter the “last phase” of the school year, we remind you that:

“The Beginning of the Next School Year begins in April” (that is, NOW).

   Right now is the best time to analyze and summarize the student, staff, and school “lessons” you have learned during this past year, and apply them to a successful beginning of the next school year.

   We have a systematic process that has helped thousands of schools to organize themselves for the most successful “first day of school” that they ever have experienced.

   If you would like to learn more, e-mail or call me to set up a free one-hour team discussion of what this might look like in your school or district.

   Meanwhile. . . thanks for reading my Blog.

Best,

Howie

[CLICK HERE to read this Blog on the Project ACHIEVE Webpage]

What Super Bowl Commercials Teach Education About Media and Product Literacy

The Language and Process that Helps Schools Vet New Products and Interventions (Part I)

[CLICK HERE to read this Blog on the Project ACHIEVE Webpage]

 

Dear Colleagues,

Introduction: The Big Game

   Let’s be honest.

   Taylor Swift aside, it seems that Super Bowl viewers are divided by those watching the game versus the commercials.

   And the commercials in this month’s (2024) Super Bowl seemed to bring out more “Stars” than usual: Ben Affleck, Matt Damon, Tom Brady, JLo, Jennifer Aniston, David Schwimmer, Jenna Ortega, Chris Pratt, Addison Rae, Jelly Roll, Judge Judy, Ice Spice, Lionel Messi, Kate McKinnon, Vince Vaughn, Quinta Brunson, Wayne Gretzky, Christopher Walken, and more.

   Stars make commercials memorable. . . using their presence to implicitly or explicitly endorse products. And this gives these products traction, and traction sells products.

   No one really cares if the Star has used or validated the quality of the product. In fact, in the final analysis, some “great” Stars endorse “lousy” products.

_ _ _ _ _

   Super Bowl commercials use language strategically.

   The most strategic language in a commercial is the slogan. Great slogans remain in the brain forever, and they are immediately (re)associated with their product. . . even when the slogan hasn’t been used for a decade or more.

   For example, for the Baby Boomers out there. . . what products are associated with the following slogans? (Sorry, Gen Z’s, you’ll have to Google these on your own):

·       “I can’t believe I ate the whole thing.”

·       “I bet you can’t eat just one.”

·       “Where’s the beef?”

·       “You deserve a break today.”

·       “Put a tiger in your tank.”

·       “Cleans like a white tornado.”

·       “What happens in Vegas, stays in Vegas.”

·       “America runs on Dunkin’.”

_ _ _ _ _

   When a slogan “catches on” in the popular vernacular, it pays unexpected (pun intended) product dividends. . . literally.

   Just like the “Stars” above, a popular Slogan sells products. But the slogan truly has nothing to do with the quality of the product.

   Regardless of Stars and Slogans, the quality of a product is based on whether it “does the job” effectively, efficiently, and in a cost-effective way. While the Star and Slogan may be responsible for the first purchase, the commitment to re-purchase the product and become a “lifetime user” is based on data, efficacy, and customer experience.

   And this is true whether the product costs $5.00 or $50,000.

_ _ _ _ _ _ _ _ _ _

Media Psychology, Media Literacy, Product Literacy, and Buying New Educational Stuff

   Media Psychology is a “newer” branch of psychology that examines the ways people are impacted by media and technology. Consumer psychology, meanwhile, studies how people’s thoughts, beliefs, emotions, and perceptions influence what they buy and use.

   In today’s digital, on-line world, these two areas are virtually (sorry. . .) interdependent.

   So what does all of this have to do with education?

   Educators. . . on their own behalf, and on behalf of their students, schools, districts, and/or other educational settings. . . are consumers who are influenced by media.

   We purchase curricula, on-line instructional or intervention products, assessment or evaluation tools, professional development programs, and direct and indirect consultation services.

   We, sometimes, are influenced by famous and notable authors, speakers, researchers, and product developers (the “Stars”) and their status or testimonials. . . and sometimes by Slogans, marketing campaigns, and “research” that would never be accepted by the Editorial Board of any refereed professional publication in our field.

   Just like Middle School students (see below), educators need to be trained in Media Literacy so they can be Product Literate.

_ _ _ _ _

Media Literacy From Middle School Students to “Middle School” Educators

   A November 14, 2023 article in U.S. News & World Report, stated:

The rise of the internet and social media makes it easier than ever to access information – and that includes information that’s false or misleading.

 

Add to that increasing political polarization, eroding trust in mainstream media and institutions, the rise of artificial intelligence products and a tendency to dismiss any information one doesn’t agree with, and many agree that the ability to critically evaluate information is a vital subject for schools.

 

When you get to AI-generated content, it makes fact-checking even more necessary because AI-generated images, texts and narratives can be inaccurate, biased, plagiarized or entirely fabricated. It can even be created to intentionally spread disinformation. We’re talking about media literacy, and within media literacy is news literacy.

The need for better media literacy education in schools is nearing a breaking point, some experts say, and health professionals have made public pleas saying as much. In May 2023, U.S. Surgeon General Admiral Vivek H. Murthy called on lawmakers to support media literacy in schools, while the American Psychological Association issued a health advisory recommending teenagers be trained in social media literacy before using the platforms.

 

Media literacy education teaches students to think critically about media messages and to create their own media “thoughtfully and conscientiously,” according to Media Literacy Now. According to (its annual) report: Ohio, New Jersey, Delaware and Florida require K-12 media literacy standards. New Jersey, Delaware and Texas require K-12 media literacy instruction. Illinois, Colorado, Massachusetts Nebraska and Connecticut require some limited form of media literacy instruction. Nebraska and Minnesota require standards in some grades and subject.

 

What Does a Good Media Literacy Program Look Like?

 

A good media literacy program starts by teaching students how to ask good questions and become interrogators of information, experts say. By the end of middle school, students should be able to read laterally, meaning they can use the internet to check the veracity of news they see online.

_ _ _ _ _

   Common Sense Media, in a June 4, 2020 article, expanded on the goals of a sound media literacy program and the resulting questions that Middle School students should be able to answer.

   Upon completion, the program should help students:

• Learn to think critically. As kids evaluate media, they decide whether the messages make sense, why certain information was included, what wasn't included, and what the key ideas are. They learn to use examples to support their opinions. Then they can make up their own minds about the information based on knowledge they already have.

• Become a smart consumer of products and information. Media literacy helps kids learn how to determine whether something is credible. It also helps them determine the "persuasive intent" of advertising and resist the techniques marketers use to sell products.

• Recognize point of view. Every creator has a perspective. Identifying an author's point of view helps kids appreciate different perspectives. It also helps put information in the context of what they already know -- or think they know.

• Identify the role of media in our culture. From celebrity gossip to magazine covers to memes, media is telling us something, shaping our understanding of the world, and even compelling us to act or think in certain ways.

• Understand the author's goal. What does the author want you to take away from a piece of media? Is it purely informative, is it trying to change your mind, or is it introducing you to new ideas you've never heard of?

_ _ _ _ _

   The key questions that students should learn to ask are:

Who created this? Was it a company? Was it an individual? (If so, who?) Was it a comedian? Was it an artist? Was it an anonymous source? Why do you think that?

 

Why did they make it? Was it to inform you of something that happened in the world (for example, a news story)? Was it to change your mind or behavior (an opinion essay or a how-to)? Was it to make you laugh (a funny meme)? Was it to get you to buy something (an ad)? Why do you think that?

 

Who is the message for? Is it for kids? Grown-ups? Girls? Boys? People who share a particular interest? Why do you think that?

 

What techniques are being used to make this message credible or believable? Does it have statistics from a reputable source? Does it contain quotes from a subject expert? Does it have an authoritative-sounding voice-over? Is there direct evidence of the assertions its making? Why do you think that?

 

What details were left out, and why? Is the information balanced with different views -- or does it present only one side? Do you need more information to fully understand the message? Why do you think that?

 

How did the message make you feel? Do you think others might feel the same way? Would everyone feel the same, or would certain people disagree with you? Why do you think that?

_ _ _ _ _

   Shifting this back to the need for educators to be Media and Product Literate, I would like you re-read the above Common Sense Media quotes, substituting the word “Educators” for “students” and “kids.” As you do this, think about a time when you are reviewing and evaluating, for purchase, the marketing materials or an on-line review of a curriculum, on-line instructional or intervention product, assessment or evaluation tool, professional development program, or direct and indirect consultation service.

   Hopefully, enough said.

   Like a media illiterate Middle School student (with no disrespect intended), how many times do we fall prey to product hyperbole, misinformation, and barely perceptible deception. . . and how often should we ask colleagues with more sophisticated psychometric, technical, or evaluative skills for an independent product appraisal?

_ _ _ _ _ _ _ _ _ _

Analyzing Some Product Literacy Language

   One of the “slogans” in educational research-to-practice involves the terms used to suggest that a curriculum, on-line instructional or intervention product, assessment or evaluation tool, professional development program, or direct and indirect consultation services has been validated.

   The most common terms are: “Scientifically-based,” “Evidence-based,” and “Research-based.”

   Because these terms are often thrown into the marketing descriptions of certain products, it is important for educators to understand (a) their definitions, histories, and how they differ; and (b) the questions and objective criteria needed to determine that a product validly provides the student, staff, or school outcomes that it asserts (and that one or more of the terms above can be used accurately).

   Relative to history and definitions, we need to consider the Elementary and Secondary Education Act of 2001 (No Child Left Behind—ESEA/NCLB) and 2015 (Every Student Succeeds Act—ESEA/ESSA); and ESEA’s current “brother”—the Individuals with Disabilities Education Act (IDEA 2004).

   Let’s go term by term.

_ _ _ _ _

Scientifically Based

   This term appeared in ESEA/NCLB 2001 twenty-eight times, and it was (at that time) the “go-to” definition in federal education law when discussing how to evaluate the efficacy, for example, of research or programs that states, districts, and schools needed to implement as part of their school and schooling processes.

   Significantly, this term was defined in the law.  According to ESEA/NCLB:

The term scientifically based research—

 

(A) means research that involves the application of rigorous, systematic, and objective procedures to obtain reliable and valid knowledge relevant to education activities and programs; and

 

(B) includes research that—

 

(i) employs systematic, empirical methods that draw on observation or experiment;

 

(ii) involves rigorous data analyses that are adequate to test the stated hypotheses and justify the general conclusions drawn;

 

(iii) relies on measurements or observational methods that provide reliable and valid data across evaluators and observers, across multiple measurements and observations, and across studies by the same or different investigators;

 

(iv) is evaluated using experimental or quasi-experimental designs in which individuals, entities, programs, or activities are assigned to different conditions and with appropriate controls to evaluate the effects of the condition of interest, with a preference for random-assignment experiments, or other designs to the extent that those designs contain within-condition or across-condition controls;

 

(v) ensures that experimental studies are presented in sufficient detail and clarity to allow for replication or, at a minimum, offer the opportunity to build systematically on their findings; and

 

(vi) has been accepted by a peer-reviewed journal or approved by a panel of independent experts through a comparably rigorous, objective, and scientific review.

_ _ _ _ _

   The term “scientifically based” is found in IDEA 2004 twenty-five times—mostly when describing “scientifically based research, technical assistance, instruction, or intervention.”

   The term “scientifically based” is found in ESEA/ESSA 2015 ONLY four times—mostly as “scientifically based research.”  This term appears to have been replaced by the term “evidence-based” (see below) as the “standard” that ESEA/ESSA wants used when programs or interventions are evaluated for their effectiveness.

_ _ _ _ _

Evidence-Based

   This term DID NOT APPEAR in either ESEA/NCLB 2001 or IDEA 2004.

   However, it does appear in ESEA/ESSA 2015—sixty-three times (!!!). . . most often when describing “evidence-based research, technical assistance, professional development, programs, methods, instruction, or intervention.”

   Moreover, as the new (and current) “go-to” standard when determining whether programs or interventions have been empirically demonstrated as effective, ESEA/ESSA 2105 defines this term.

   As such, according to ESEA/ESSA 2015:

(A) IN GENERAL.—Except as provided in subparagraph (B), the term ‘evidence-based’, when used with respect to a State, local educational agency, or school activity, means an activity, strategy, or intervention that

 

   ‘(i) demonstrates a statistically significant effect on improving student outcomes or other relevant outcomes based on—

 

      ‘(I) strong evidence from at least 1 well-designed and well-implemented experimental study;

 

   ‘(II) moderate evidence from at least 1 well-designed and well-implemented quasi-experimental study; or

 

      ‘(III) promising evidence from at least 1 well-designed and well-implemented correlational study with statistical controls for selection bias; or

 

   ‘(ii)(I) demonstrates a rationale based on high-quality research findings or positive evaluation that such activity, strategy, or intervention is likely to improve student outcomes or other relevant outcomes; and

 

     ‘(II) includes ongoing efforts to examine the effects of such activity, strategy, or intervention.”

 

(B) DEFINITION FOR SPECIFIC ACTIVITIES FUNDED UNDER THIS ACT.—When used with respect to interventions or improvement activities or strategies funded under Section 1003 [School Improvement], the term ‘evidence-based’ means a State, local educational agency, or school activity, strategy, or intervention that meets the requirements of subclause (I), (II), or (III) of subparagraph (A)(i).

_ _ _ _ _

Research-Based

   This term appeared in five times in ESEA/NCLB 2001; it appears four times in IDEA 2004; and it appears once in ESEA/ESSA 2015.  When it appears, the term is largely used to describe programs that need to be implemented by schools to support student learning.

   Significantly, the term researched-based is NOT defined in either ESEA law (2001, 2015), or by IDEA 2004.

_ _ _ _ _ _ _ _ _ _

What You Should Know and Ask When Evaluating Programs Using these Terms?

Scientifically Based

   At this point in 2024, if a product developer uses the term “scientifically based,” s/he probably doesn’t know that this term has functionally been eliminated as the “go-to” term in federal education law. At the same time, as an informed consumer, you can still ask the developer what s/he means by “scientifically based.” 

   Then. . . if the developer continues to say that his/her product is scientifically based, you request and review the validating research studies—that are preferably published in refereed journals—with descriptions of their:

·       Demographic backgrounds and other characteristics of the students participating in the studies (so you can compare and contrast these students to your students);

·       Research methods used in the studies (so you can validate that the methods were sound, objective, and that they involved control or comparison groups not receiving the program or intervention);

·       Outcomes measured and reported in the studies (so you can validate that the research was focused on student outcomes, and especially the student outcomes that you are most interested in for your students);

·       Data collection tools, instruments, or processes used in the studies (so that you are assured that they were psychometrically reliable, valid, and objective—such that the data collected and reported are demonstrated to be accurate;

·       Treatment or implementation integrity methods and data reported in the studies (so you can objectively determine that the program or intervention was implemented as it was designed, and in ways that make sense);

·       Data analysis procedures used in the studies (so you can validate that the data-based outcomes reported were based on the “right” statistical and analytic approaches);

·       Interpretations and conclusions reported by the studies [so you can objectively validate that these summarizations are supported by the data reported, and have not been inaccurately- or over-interpreted by the author(s)]; and the

·       Limitations reported in the studies (so you understand the inherent weaknesses in the studies, and can assess whether these weaknesses affected the integrity of and conclusions—relative to the efficacy of the programs or interventions—drawn by the studies).

_ _ _ _ _

Evidence-Based

   If a product developer describes a program or intervention as “evidence-based,” you need to ask them whether they are using the term as defined in ESEA/ESSA 2015 (see above) and, if so, which criteria in the law their product has met.

   Critically, very few educational products or psychological interventions meet the (“Gold Standard”) experimental or quasi-experimental criteria in the Law. In fact, if at all, most will only meet the following ESEA/ESSA 2015 criteria:

   ‘(ii)(I) demonstrates a rationale based on high-quality research findings or positive evaluation that such activity, strategy, or intervention is likely to improve student outcomes or other relevant outcomes; and

 

     ‘(II) includes ongoing efforts to examine the effects of such activity, strategy, or intervention.”

   As such, as an informed consumer, we suggest that you ask the product developer all of the same questions outlined in the “scientifically based” section immediately above. The answers will help you determine the objective efficacy of the product, the demographics of the students it has worked with, and the resource, time, and training needs for success.

_ _ _ _

Research-Based

   If a product developer uses the term “research-based,” they probably don’t know that the “go-to” term, definition, and standard is now “evidence-based” in federal education law. 

   Moreover, as an informed consumer, a developer’s use of the “research-based” term should raise some “red flags” as it might suggest that the quality of the product’s research and its efficacy may be suspect.

   As such, you will need to ask the developer the same questions in the “scientifically based” section above, independently evaluating the quality of the responses.

   After (a) analyzing the information from the product’s research and implementation studies, and (b) answering the evaluative questions, you can ask yourself:

·       Is there enough objective information to conclude that the “recommended” product is independently responsible for the student outcomes that are purported and reported?

_ _ _ _ _

·       Is there enough objective data to demonstrate that the “recommended” product is appropriate for my student population, and will potentially result in the same positive and expected outcomes (if present)?

[The point here is that the program or intervention may be effective—but only with certain students. . . and not your students.]

_ _ _ _ _

·       Will the resources needed to implement the program be time- and cost-effective relative to the “Return-on-Investment”? 

[These resources include, for example, the initial and long-term cost for materials, professional development time, specialized personnel, coaching and supervision, evaluation, parent and community outreach, etc.]

_ _ _ _ _ 

·       Will the “recommended” product be acceptable to those involved (e.g., students, staff, administrators, parents) such that they are motivated to implement it with integrity and over an extended period of time? 

[There is extensive research on the “acceptability” of interventions, and the characteristics or variables that make program or intervention implementation likely or not likely.]

_ _ _ _ _ _ _ _ _ _

Some Final Product Literacy Questions

   Clearly, some products and interventions have sound research that validate their practices. As an inherent part of this validation, these products have been implemented and evaluated with intensity and integrity, and they have produced meaningful and measurable student, staff, and/or school outcomes.

   But even here, recognize that—in analyzing the responses to the evaluative questions suggested throughout this Blog:

·       Some products or interventions will not have demonstrable efficacy; 

·       Some will have some positive outcomes, but they may be over-generalized by the developer so that the product appears more successful than it really is;

·       Some will have positive correlational results, but not the causal results that demonstrate that the product was solely responsible for the positive outcomes; 

·       Some will have demonstrated efficacy—but not be applicable to your students or circumstances; and 

·       Some product developers will still claim—even in the face of your objective analysis regarding the (suspect or poor) quality of the research and the compromised efficacy of the product—that it is effective.

   In this last situation, research is typically compromised when it is conducted (a) by convenience; (b) with small, non-representative, and non-random samples; (c) without comparisons or matched control groups; and (d) using methodologically unsound scientific approaches. 

   Other “published” research needs to be reviewed when it appears on a website or in a journal that does not conduct “blind” reviews by three or more members of an established Editorial Board.

   PLEASE NOTE: Anyone can do their own research, pay $50.00 to set up a website, and begin to market their products. To determine if the research is sound, the product generates the results it purports, and the same results will meaningfully occur in your school, agency, or setting, you need to do your own investigations, analyses, and due diligence.

_ _ _ _ _ _ _ _ _ _

Summary

   Metaphorically using the commercials at the Super Bowl as a guide, this Blog emphasized and outlined (applying the goals and questions within a sound middle school Media Literacy program) why educators need to be both Media and Product Literate when reviewing and evaluating the marketing materials or on-line reviews of curricula, instructional or intervention products, assessment or evaluation tools, professional development programs, or direct and indirect consultation services that may be purchased. 

   We then described in detail three common terms used to “validate” these products: “Scientifically-based,” “Evidence-based,” and “Research-based.” 

   Here, we asserted the importance that educators understand these terms’ respective (a) definitions, histories, and differences; and (b) the questions and objective criteria needed to determine that a product can validly provide the student, staff, or school outcomes that it asserts.

   We understand that Social Media and Product Literacy—and their accompanying reviews—take time.

   But especially for purchases that will be used or implemented for five or more years (e.g., a new reading, math, or science curriculum or on-line program; a new district Student Information or Data Management System), the review time is both responsible and essential to long-term student, staff, and school success.

   A January 19, 2024 Education Week article (late last month) discussed the “Five Mistakes for Educators to Avoid When Picking ‘Evidence-Based’ Programs.”

   I highly recommend that you read and discuss this article in your educational setting. Indeed, if you understand the thrust and nuances in this piece, you will realize that you already have the Product Literacy foundation that you need to competently evaluate new products or interventions.

_ _ _ _ _

Answers to the “Slogan Pop Quiz”

   Oh. . . by the way. . . here are the answers to our earlier “Slogan Pop Quiz”:

·       “I can’t believe I ate the whole thing.” [Alka Seltzer]

·       “I bet you can’t eat just one.” [Lay’s Potato Chips]

·       “Where’s the beef?” [Wendy’s]

·       “You deserve a break today.” [McDonald’s]

·       “Put a tiger in your tank.” [Exxon]

·       “Cleans like a white tornado.” [Ajax]

·       “What happens in Vegas, stays in Vegas.” [Las Vegas]

·       “America runs on Dunkin’.” [Dunkin’ Donuts]

   You’re welcome!

_ _ _ _ _

A Funding Opportunity

   My Friends: A lot of my school and district consultation work is funded by (often, five-year) federal grants from the U.S. Department of Education that I write for and with the districts who are interested in implementing my work.

   A new $4 million grant program is coming up in a few months that needs a single moderate to large school district with at least 25 elementary schools.

   As we can submit multiple grants from different districts, if you are interested in discussing this grant and a partnership with me, call (813-495-3318) or drop me an e-mail as soon as possible (howieknoff1@projectachieve.info).

   Another five-year $4 million grant program will likely be announced a year from now. This program will be open to districts of all sizes. If you are interested, once again, it is not too early to talk.

   BOTH grant programs focus on (a) school safety, climate, and discipline; (b) classroom relationships, behavior management, and engagement; and (c) teaching students interpersonal, conflict prevention and resolution, social problem-solving, and emotional awareness, control, communication, and coping skills and interactions.

   Beyond these grants, if you are interested in my work for your educational setting, I am happy to provide a free consultation for you and your team to discuss needs, current status, goals, and possible approaches.

   Again, call me or drop me an e-mail, and let’s get started.

Best,

Howie

 

[CLICK HERE to read this Blog on the Project ACHIEVE Webpage]