As Schools Comb Social ÌÇĐĶŻÂțvlog for Potential Threats, Has Mass Shooting Anxiety Turned Administrators Into the âInternet Policeâ?
It began with the 1999 mass shooting at Columbine High School in suburban Denver, when two students opened fire and killed 15 people, including themselves.
The aftermath of the tragedy saw the debut of Safe2Tell, a tool that lets parents and students anonymously report information about potential school shootings and other violent threats. Safe2Tell is still in use today. But it began with : In most school shootings, at least one person had information about the plans prior to the attack.
âPeople will call and report, âMy friend said that they were going to kill themselves,â and then law enforcement will go out and investigate, and in many of these situations, lives have been saved,â said Beverly Kingston, director of the Center for the Study and Prevention of Violence at the University of Colorado Boulder and a former Safe2Tell board member. âSo itâs one of these things [that poses the question], âWhy donât we have this system throughout the nation to do this?â It just helps protect everyoneâs safety.â
Nearly two decades after Columbine, such tools have become an industry unto themselves and extend far beyond anonymous reporting. Particularly in the aftermath of this yearâs shootings in Parkland, Florida, and Sante Fe, Texas, school and law enforcement officials are turning to social media as a way to head off potential violence before a single shot is fired. The reason: As a key platform for student self-expression, social media has also become an outlet for youth to broadcast school shooting threats and suicide warnings.
New tools use artificial intelligence to search for potential threats on studentsâ social media profiles and scan school-issued laptops in search of keywords that could spell trouble. After the Parkland shooting, lawmakers in Florida took it a step further and that combines law enforcement and social services records with social media activity to help officials investigate students who post suspicious or threatening information online.
While the tools promise to protect kids, they also pose questions about how far schools can encroach on student privacy in the name of keeping them safe.
Every bit of information could be helpful during emergency situations, said Kenneth Trump, president of National School Safety and Security Services. But he questioned the extent to which schools should be asked to monitor studentsâ off-campus behavior.
âThe question becomes, âWhere do you draw the line?ââ he said. âHow much can we reasonably expect of a building principal or a system principal or maybe a dean to be the internet police?â
âOutcries for helpâ
To Gary Margolis, helping school officials identify online threats is crucial. Formerly the police chief at the University of Vermont, he observed the growth of social media from a law enforcement perspective. In the internet age, he said, âoutcries for helpâ moved beyond students passing notes or exchanging whispers in the locker room.
Now, those outcries occur online.
In response, Margolis founded Social Sentinel to help schools pick up on troubling social media posts. Social Sentinel collects social media data and uses artificial intelligence to run posts against a âlibrary of harmâ containing some 450,000 phrases, keywords, hashtags â even emojis â that he said could indicate a suspicious post. School districts are then notified, via email or text message.
âIn the absence of a service like Social Sentinel, itâs impossible to be part of the conversation,â he said. Once the program flags content for school officials, itâs up to them to act on the information. He declined to provide specific examples of how the platform has been used to thwart violence.
Among the districts using the tool is Ohioâs Lebanon City Public Schools. Each morning, Superintendent Todd Yohey, school police and the district human resources director get posts the platform flags as potentially problematic. The tool doesnât offer identifiable information beyond the social media accounts the post came from, but Yohey said anonymity isnât a big hurdle.
âKids arenât very good at hiding their identity,â he said. âThere are times weâve asked other kids, âHey, do you know who this poster is?ââ since students generally know their peersâ social media accounts.
Social Sentinel generally flags about one social media post a day for school officials in Lebanon City, Yohey said, and more often than not, the posts are benign. During the NBA playoffs last year, for example, the tool flagged multiple posts.
âThere were a lot of posts about, âThat three-pointer was the bomb,â and so the word âbombâ would trigger a notice to us,â he said. âYou read that and you figure out, âOh, theyâre talking about the basketball game, and so itâs not concerning.ââ
Still, stumbling onto just one threatening post would make the effort worthwhile, Yohey said, if it helped the school avert a tragedy. The tool would allow the district to react to a situation more quickly. âIf we get a post that said, âIâm planning to take a bomb to school tomorrow,â or âI planted a bomb at the elementary school,â those of course would require immediate attention.â
In fact, a day after the Parkland shooting, a district student that he was going to shoot up a school. In response, Yohey issued a warning to students: âThere is no such thing anymore as an empty threat; no jokes, no kidding around, no âI didnât mean it.ââ

Although mass shootings this year caused a spike in anxiety and prompted heated policy debates, they are statistically rare and campuses have actually become safer in recent years, according to recent National Center for Education Statistics data.
Chad Marlow, senior advocacy and policy counsel at the American Civil Liberties Union, said heâs concerned about âsubtle harmsâ schools could inflict by surveilling students. Monitoring could signal to students that they canât use social media freely to share information with their friends. As schools crack down on student speech, students of color â who already face â could be most affected.
âThe rules governing these things involve standards that are uncomfortably subjective,â he said. âMonitoring places many groups of students, who are already vulnerable by virtue of the communities that they are members of, in even greater places of vulnerability.â
In one instance, in 2013, an Alabama school district to monitor the social media accounts of hundreds of students â an effort that the superintendent claimed, somewhat dubiously, was launched after the National Security Agency alerted school leaders to a studentâs social media threat. The district surveillance effort resulted in the expulsion of 14 students, 12 of whom were black. While some students were expelled for posting pictures with guns, for âholding too much moneyâ and for making the âOKâ sign, which police said was a gang symbol.
In interviews, several social media monitoring companies have deflected concerns about government surveillance by noting that the services flag only content posted publicly on sites like Twitter and Facebook. Students concerned about privacy, company executives said, can update their privacy settings so their posts are only accessible to specific people.
Bowing to concerns from civil rights groups, an executive at one social media monitoring company said he changed his platform. The executive, Soter Technologies founder and CEO Derek Peterson, said the company disabled a feature in social media tool Digital Fly that allowed school districts to create a list of students with a history of posting troubling information online.
But the ACLUâs Marlow argues that social media monitoring programs meet the âtextbook definitionâ of mass surveillance because they watch a large number of people at the same time.
âThey can call it rose pedals in a field of daisies if they want, but it is absolutely surveillance,â Marlow said. âAnd surveillance has chilling effects on free speech.â
Monitoring students online doesnât stop with social media. As more schools adopt âone-to-one computingâ programs that place laptops in the hands of each student, some districts have equipped them with that scan online activity like emails and search histories for signs of threats or illicit activity such as drug use. These tools have from digital privacy groups like the Electronic Frontier Foundation, which noted in a 2017 report that students are âbacked into a cornerâ because they have no choice but to use the school-issued devices.
In one instance, in 2010, a Pennsylvania school district paid more than $600,000 to settle an after a high school student accused it of using the webcams on district laptops to take covert photos of students â including a picture of the teenager sleeping in his bed. The district it had taken more than 50,000 such pictures in an attempt to recover lost or stolen devices.
Karen Gullo, the foundationâs spokeswoman, said in a statement that monitoring tools that flag specific words âcan cause false alarms and target innocent students.â
âPervasive surveillance normalizes electronic snooping,â Gullo said, âand can keep kids from testing out new ideas and identities as they grow.â
âSee something, say somethingâ
Ironically, after a decade of online innovations, some observers say the most effective, and least invasive, method of neutralizing threats remains the low-tech idea that surfaced nearly 20 years ago: tips from actual people.
Schools across the country have adopted the âSee something, say somethingâ mantra popularized after the Sept. 11, 2001, terrorist attacks. A half-dozen states already have anonymous tip lines replicating the Colorado model, and officials from more than 20 states have contacted Safe2Tell to inquire about the program since the Parkland shooting, a spokeswoman for Coloradoâs attorney general said.
In October, the Justice Department in grants to develop anonymous reporting systems and threat assessment teams for schools. Congress appropriated the funds last spring through the STOP School Violence Act. Sandy Hook Promise, a nonprofit that operates the Say Something anonymous reporting system, lobbied for the federal law. School districts in nearly half the states in the country are implementing the Say Something system.
Last school year, Coloradoâs reporting tool collected , a 74 percent surge from just one year earlier. Post-Parkland, anonymous tips surged even more, Colorado attorney general Cynthia Coffman said in an interview.
âKids were reacting to everything they saw and heard, particularly on social media,â Coffman said. âWeâd have multiple reports from kids about the same social media post that said something about Parkland.â
Despite the increase in anonymous tips, it remains unclear what percentage of them represented true threats and resulted in intervention. Safe2Tell is collecting that data now, Coffman said. Still, that school and law enforcement officials have intervened in multiple suicide and school shooting threats based on the tips.
But even this low-tech, relatively noninvasive approach has drawbacks. On several occasions, people have used Safe2Tell to bully other students by filing false reports. In one case, a 15-year-old girl someone filed three false tips that she was suicidal and used drugs. On two occasions, she said police pulled her out of class to question her.
In order to discourage false reports, Coffman said people can be charged with a misdemeanor if they use the system to harass others.
While the bevy of tools on the market for educators to see studentsâ online activity are helpful, officials need to put the information into context and consider the studentâs broader behavior, said Marisa Randazzo, managing partner at SIGMA Threat Management Associates. When confronting students about online posts, they should avoid a zero-tolerance response like automatic suspensions, she said.
âThatâs a policy that sounds good but actually has an inadvertent chilling effect on studentsâ willingness to come forward and share information and share whatâs worrying them,â she said.
Kingston, of the University of Colorado Boulder, offered similar advice, noting that school and police officials should respond to perceived student threats with caution.
âAdults who are entrusted with these jobs have to walk this delicate rope of also making sure theyâre protecting the safety of everyone,â she said. âWe want to make sure that our interventions donât do more harm to students.â
Did you use this article in your work?
Weâd love to hear how The 74âs reporting is helping educators, researchers, and policymakers.