Skip to main content
University of Wisconsin–Madison

Category: Fact Checking

NPR’s experiment with live fact-checking

NPRIt took a team of about 30 NPR reporters and editors to annotate live transcripts of the 2016 presidential debates, according to Amita Kelly, a reporter on NPR’s politics team

The roster included journalists from politics, business and international security, with editors simultaneously working to clean up the transcript itself as well as the fact checks and analysis.

“We use the term fact check a little bit broadly,” Kelly explained. “Some were straight: is this true or false? But a lot of it is just the analysis that our reporters can provide, saying: ‘Actually, there’s more to the story.'”

NPR’s fact check featured an unfolding live transcript of the debate, with various claims underlined and linked to fact checks from NPR staff. The annotated transcript of the first debate drew more than 2 million views within 48 hours.

An example of a fact check from NPR during the first debate.

An example of a fact check from NPR during the first debate.

Because many of the claims the candidates made during the debate had already surfaced at some point in the campaign, the NPR team was able to rely on previous reporting to quickly verify information, according to NPR digital team member David Eads.

“The reporters are adding context and checking whether or not the statements are true, but there are also linking to stuff all around the media,” Eads said. “These became really great ways of catching up quickly on a lot of different issues. If we hadn’t had that kind of foundation of that reporting before, then I don’t think it would be quite as successful.”

But there are limits to this style of instant fact-checking, said Lucas Graves, a professor of journalism at the University of Wisconsin and author of “Deciding What’s True: The Rise of Political Fact-Checking in American Journalism.”

“Usually these claims are much more complicated to investigate than it seems at first,” Graves said. “If you were to try to decide from scratch whether some budget claim was true or false, and get that up in five minutes, you’re probably going to make a mistake.”

checking facts: a conversation

While the speed of the instant fact check may not always be possible, Graves said NPR’s fact-checking endeavor illustrates a conversational style that is trending in today’s journalism.

FiveThirtyEight

FiveThirtyEight live-blogged the first presidential debate.

Pointing to FiveThirtyEight’s election team, which takes a Slack conversation between reporters or experts on a designated topic, edits it for clarity and then posts it directly to the web, Eads said news consumers are looking for more of a dialogue than traditional journalism has offered.

“It seems that people want to hear a lot of voices, sort of in dialogue, and not this omniscient detached narrator that can provide journalism from the the 50s,” Eads said.

Kelly described the experience NPR created with the debate fact checks with contributions from reporters across beats as like watching the debate “with all of your smart NPR friends sitting next to you.”

“When Clinton, something comes up about her emails or a tax plan or a tax credit, I want someone to poke me and say ‘Hey! Actually, she’s been saying this all along, or this is different than what she said, or that’s actually not what those experts agree with,” Kelly said.

Eads noted that this particular style of journalism has the potential to fill in gaps left by social media.

“One thing that you have to be able to be successful these days, is provide a better experience than things like Twitter and Facebook,” Eads said. “And this managed to do that, in a way.”

the future of fact checking

Graves said he hopes the way this election cycle has shaped fact-checking continues.

Even in regular news pieces unrelated to the election, Graves said he’s starting to notice reporters make fact checks more freely. In the past, he said, journalists would refrain from challenging a source within a straight news report out of a fear of being accused of bias.

“There’s no good journalistic argument for repeating a claim in a news story that you know to be false without noting that it’s false,” Graves said. “I think journalistically, that’s indefensible, and we’re seeing a sort of cultural shift to accept that.”

As for NPR’s live fact check, he applauded the effort but hopes to see more fact-checking integrated into the debates themselves, either through moderators or video clips.

“If it’s built into the debate format itself,” Graves said. “The candidates themselves are actually confronted with the fact checks.”

Cadence Bambenek is a fellow for the Center for Journalism Ethics. She is a student in the School of Journalism and Mass Communication at the University of Wisconsin-Madison. 

Should moderators fact-check the presidential debates? Yes, in moderation

Photo by <a href="https://www.flickr.com/photos/hofstrauniversity/29339043893/in/album-72157673269732560/" target=blank>Hofstra University and used here with permission.

Hillary Clinton and Donald Trump square off in the first 2016 presidential debate. Photo by Hofstra University and used here with permission.

If there is one thing we’ve learned from years of judging at intercollegiate debate tournaments across the country, it is that the best decisions are made when both sides are held to the highest standards when constructing arguments.

Rather than intervening, we allow debaters to make mistakes, capitalize on strategic misfires, and argue their way to victory. We are acting as adjudicators, not moderators, and are often the sole voice in declaring a winner. In presidential debates, however, the voters are the adjudicators, and moderators must act as communicative conduits to ensure an informed electorate capable of making the best possible decision.

Caught between two seemingly irreconcilable perspectives on their role as either minimalist facilitator or relentless truth-seeker, moderators seem unable to escape scrutiny. Faced with inevitable conflict over nuanced topics distilled into value-laden sound bites, how should moderators ethically define their role within this vast political spectacle? Under what circumstances should a moderator interrupt the flow of the debate to fact-check a candidate? Answering these questions first requires some understanding of how presidential debates have evolved throughout history.

Rather than serving as mere facilitators, moderators have a primary responsibility to act on behalf of voters.

The first televised debates occurred in 1960 between John F. Kennedy and Richard M. Nixon and, according to presidential debate historian Alan Schroeder, included attempts by producers to craft a more interactive dialogue between the candidates though that format was vetoed by campaign advisors. Since then, presidential debates have matured from events that were, at times, glorified press conferences, to structured discussions with ample room for direct interaction between the candidates. More recent debates have seen increased participation from both moderators and audiences; it was not until 1988 that moderators began asking opening questions, and the town hall format was not introduced until 1992.

The use of YouTube and Twitter during the 2008 presidential debates demonstrates voters’ desire for candidates to respond directly to their voices. This election season, the Trump and Clinton campaigns agreed to historically weak restrictions on direct exchanges between the candidates, renewing conversations about the degree of moderator involvement.

the moderator

While it may be most objective for moderators to stay out of the debate, simply asking questions and enforcing the agreed-upon rules, this has become difficult in practice. The increasing amount of direct contact between candidates has created an occasional volley wherein a candidate will directly ask the moderator to intervene and influence their opponent’s behavior. For example, in the 2012 election cycle, Candy Crowley was pulled into several procedural disputes between Barack Obama and Mitt Romney, in addition to engaging in a heated fact-check over the Benghazi attacks. During the 2016 vice presidential debate, Elaine Quijano repeatedly intervened to enforce time constraints and refocus the candidates’ attention. Increased interaction, then, often necessitates a more active moderator to keep the debate from becoming unruly.

Moderators should first provide candidates with a chance to fact-check their opponent for themselves.

Going beyond drawing the moderators in to resolve a disagreement, candidates occasionally criticize their questions, behavior and ethics altogether. Ted Cruz’s tirade against the presidential primary moderators serves as an excellent example of how moderators are often forced into a more participatory role.

Open criticism by a candidate during the debate brings even the most passive moderators into the spotlight and grants them considerable influence over the direction of the discussion. Cruz was raising an important point about what ethical standards moderators ought to uphold when crafting their questions and what the function of debates ultimately should be.

the candidates

Presidential debates should inform voters of each candidate’s values and the policies they plan on implementing, but ultimately, candidates are interested in winning voters through whatever means necessary. That emphasis on swaying voters, often at the expense of accurately conveying political agendas, is a deeply flawed model for educating those who decide the fate of American leadership for the next four years.

Ideally, voters would be motivated to investigate claims made by each candidate. For many, however, the presidential debates and subsequent polarizing articles will determine the direction of their ballots. The stakes are far too high for candidates to present incomplete or inaccurate visions of their presidencies.

 If candidates continue to peddle such thoroughly discredited information without acknowledging their context, they should expect immediate and impartial pushback.

If the goal of debates is to create an informed electorate, candidates should conduct the vast majority of fact-checking onstage. The reality, of course, is that candidates are incentivized to rebut only with the information that most benefits them, regardless of its proximity to the truth. Moderators, on the other hand, are agreed upon by both campaigns for their ability to act as neutral arbiters in a highly politicized environment. If candidates are to merely use the debate stage to reiterate their respective talking points, then there is no purpose in having a moderator at all.

Rather than serving as mere facilitators, moderators have a primary responsibility to act on behalf of voters. This is a difficult line to walk, as moderators must intervene in a way that benefits voters in every ideological corner. This requires particular attention in deciding where to fact-check so as to not become a focus of the discussion themselves. Each campaign has a core set of mistruths that it has relied on, from Trump’s support of the initial invasion of Iraq to Clinton’s claim that she never received classified emails on her private server while secretary of state. If candidates continue to peddle such thoroughly discredited information without acknowledging their context, they should expect immediate and impartial pushback.

Moderators should first provide candidates with a chance to fact-check their opponent for themselves, but then be ready to supplement the rebuttal with factual statements about previous political positions and figures from relevant primary sources. Additionally, introducing a topic or question with contextualizing information for those unfamiliar with the issues can raise the level of discourse and make it clear when a candidate is having an “Aleppo moment.”

the audience

How candidates respond to argumentative pushback in a debate is valuable information for voters, even if candidates dodge the follow-up question. A moderator doesn’t have to act as the “truth squad,” to use Chris Wallace’s words, to point out that a candidate is ignoring the original question or violating the agreed upon rules for speaking time limits. The audience can and will decide for themselves – but the moderator can still provide a useful context for potential voters to navigate issues. If our democratic problem is that we have an electorate that is overwhelmingly cynical, polarized and politically apathetic, we need debate moderators who will bridge candidates where they agree, highlight their differences and help voters translate abstract policies into their tangible impact on everyday life.

The audience can and will decide for themselves – but the moderator can still provide a useful context for potential voters to navigate issues.

Massive media spectacles like the debate draw an atypical audience that otherwise steers clear of politics, and that’s a wonderful thing. In this unique moment, moderators should not offload their journalistic responsibility to inform citizens onto dedicated fact-checking venues that publish hundreds of pages of post-debate fact-checks that many voters will never read. That being said, whoever ends up the 45th President of the United States will not do so solely because of the fact-checking decisions made by moderators. Broader dynamics are at play, but moderators can help set standards for how well-prepared we expect candidates to be when it comes to informing the public.

Ultimately, the onus is on voters to seek out resources and cast informed ballots, just as we have spent countless hours educating ourselves to fairly adjudicate debates. Moderators should have some obligation to be active facilitators in that process. They should not become the center of the story, but to write them off as passive, neutral facilitators of candidate conversation is to abdicate their responsibility to vocalize the needs of voters.

CV Vitolo

CV Vitolo is the Director of Debate at the University of Wisconsin-Madison and a doctoral student in the Communication Arts department. Their research concerns public deliberation and discourse surrounding science and medicine.

 

 

JJordan Foleyordan Foley is the Assistant Director of Debate at the University of Wisconsin-Madison and a doctoral student in the School of Journalism and Mass Communication. His research focuses on political communication, media psychology and public opinion.

 

 

 

 

Retracted Rolling Stone sexual assault story fallout is about more than just poor fact checking

The journalistic failures of Rolling Stone, both ethically and practically, in their reporting of a horrific sexual assault on the campus of the University of Virginia offers a stark example of how wrong things can go when an artfully worded and compelling narrative appears to have bypassed the fact-checking desk entirely on its way to publication.

While there story’s intent may have been to call attention to the issue of sexual assaults on college campuses, the retraction of “A Rape on Campus: A Brutal Assault and Struggle for Justice at UVA” also inadvertently served to lessen the overall credibility of all rape victims.

One thing the editors of Rolling Stone and reporter Sabrina Rubin Erdely found out was that other reporters, bloggers and students were wiling to do some fact-checking of their own, but not before the story brought an uproar on the U-Va campus and around the country.  Within a matter of days, U-Va opened an investigation and suspended the entire Greek system.  At the same time, the story began to unravel.  (The Washington Post offers a timeline of events here.)

Writing for the Voices section of USA Today, copy desk chief and U-Va graduate Susan Miller explains that she found the story disturbing for reasons beyond the account of the alleged crime.

When I could finally swallow my anger and angst, I re-read the Rolling Stone piece a few days later. This time, however, I was able to detach from the scintillating prose — and I found the story unsettling for other reasons:

• Embedded throughout the narrative were verses from a 70-year-old school song the reporter deemed “naughty,” implying a culture of abusing women for decades. How could one make that leap?

• The word “alleged” never appeared in the 9,000-word article.

• There were changed names and quotes from unidentified people. On a guided tour of fraternity row, the reporter quotes a nameless student: “I know a girl who got assaulted there.” Chimes in a second nameless student: “I do, too! That makes two! Yay!”

• There was missing or unclear attribution. The story says “studies have shown that fraternity men are three times as likely to commit rape.” Which studies?

• And the most gaping hole of all: There was no mention of any attempt to contact the alleged perpetrators or to verify the events.

Miller concludes her piece by pointing out the larger problem with the Rolling Stone story, noting, “The resulting firestorm is drowning out the voices that still deserve to be heard: the Jackies who may have suffered sexual assaults at Virginia and college campuses across the land.”

This unfortunate aspect of the fallout as well as the ethical failings of Rolling Stone’s reporter and editors was also noted by Katy Culver, associate director for the University of Wisconsin Center for Journalism Ethics, when she spoke with Tanya Rivero of the Wall Street Journal’s video program, Lunch Box.

[Image by Ryan M. Kelly, via USA Today]