What makes ‘good science journalism’?

From ‘Your Doppelgänger Is Out There and You Probably Share DNA With Them’, The New York Times, August 23, 2022:

Dr. Esteller also suggested that there could be links between facial features and behavioral patterns, and that the study’s findings might one day aid forensic science by providing a glimpse of the faces of criminal suspects known only from DNA samples. However, Daphne Martschenko, a postdoctoral researcher at the Stanford Center for Biomedical Ethics who was not involved with the study, urged caution in applying its findings to forensics.

There are two big problems here: 1) Esteller’s comment is at the doorstep of eugenics, and 2) the reporter creates a false balance by reporting both Esteller’s comment and Martschenko’s rebuttal to that comment, when in fact the right course of action would’ve been to drop this portion entirely, as well as take a closer look at why Esteller et al. conducted the study in the first place and whether the study paper and other work at the Esteller lab is suspect.

This said, it’s a bit gratifying (in a bad way) when a high-stature foreign news publication like The New York Times makes a dangerous mistake in a science-related story. Millions of people are misinformed, which sucks, but when independent scientists and other readers publicly address these mistakes, their call-outs create an opportunity for people (though not as many as are misinformed) to understand exactly what is wrong and, more importantly from the PoV of readers in India, that The New York Times also makes mistakes, that it isn’t a standard-bearer of good science journalism and that being good is a constant and diverse process.

1) “NYT also makes mistakes” is important to know if only to dispel the popular and frustrating perception that “all American news outlets are individually better than all Indian news outlets”. I had to wade through a considerable amount of this when I started at The Hindu a decade ago – at the hands of most readers as well as some colleagues. I still face this in a persistent way in the form of people who believe some article in The Atlantic is much better than an article on the same topic in, say, The Wire Science, for few, if any, reasons beyond the quality of the language. But of course this will always set The Atlantic and The Wire Science and its peers in India apart: English isn’t the first language for many of us – yet it seldom gets in the way of good storytelling. In fact, I’ve often noticed American publications in particular to be prone to oversimplification more often than their counterparts in Europe or, for that matter, in India. In my considered (but also limited) view, the appreciation of science stories is also a skill, and the population that aspires to harbour it in my country is often prone to the Dunning-Kruger effect.

2) “NYT isn’t a standard-bearer of good science journalism” is useful to know because of the less-than-straightforward manner in which publications acquire a reputation for “good science journalism”. Specifically, publications aren’t equally good at covering all branches of scientific study; some are better in some fields and others are at some others. Getting your facts right, speaking to all the relevant stakeholders and using sensitive language will get you 90% of the way, but you can tell the differences between publications by how well they cover the remaining 10%, which comes from beat knowledge, expertise and having the right editors.

3) “Being good is a constant and diverse process” – ‘diverse’ because of the previous point and ‘constant’ because, well, that’s how it is. It’s not that our previous work doesn’t keep us in good standing but that we shouldn’t overestimate how much that standing counts for. This is especially so in this age of short attention spans, short-lived memories and the subtle but pervasive encouragement to be hurtful towards others on the internet. “Good science journalism” is a tag we need to get by getting every single story right – and in this sense, you, the reader, are better off not doling out lifetime awards to outlets. Instead, understand that no outlet is going to be uniformly excellent at all times and evaluate each story on its own merits. This way, you’ll also create an opportunity for Indian news outlets to be free of the tyranny of unrealistic expectations and even surprise you now and then with excellence of our own.

Finally, none of this is to say that these mistakes happen. They shouldn’t and they’re entirely preventable. Instead, it’s a reminder to keep your eyes peeled at all times and not just when you’re reading an article produced by an Indian outlet.

The overlay bias

I’m not very fond of some highly popular pieces of writing (I won’t name them because I’m nervous about backlash from authors and/or their supporters) because a part of their popularity is undeniably rooted in technological ‘solutions’ that asymmetrically promote work published in the solution’s country of origin.

My favourite example is Pocket, the app that allows users to save copies of articles to read later, offline if required. Not long ago, Pocket introduced an extension for the Google Chrome browser (which counts hundreds of millions of users) such that every time you opened a new tab, it would show you three articles lots of other Pocket users have read and liked. It’s fairly brainless, ergo presumably non-malicious, and you’d expect the results to be distributed equally from among magazines, journals, etc. published around the world.

However, nine times out of ten – but often more – I’d find articles by NYT, The Atlantic, The Baffler, etc. there. I was reluctant to blame Pocket at first, considering their algorithm seemed too simple, but then I realised Pocket was just the last in a long line of other apps and algorithms that simply amplified existing biases.

Before Pocket, for example, there might have been Twitter, Facebook or some other platform that allowed stories from some domains (nytimes.com, thebaffler.com, etc.) to persist for longer on users’ feeds because they were more easily perceived to be legitimate than articles from other sources, say, a Venezuelan newspaper, a Kenyan blog, a Pakistani magazine or a Vietnamese journal. Or there might have been Nuzzle, which auto-compiles a digest of articles that others your friends on the social media have shared most – likely unmindful of the fact that people quite often share headlines, or domains they’d like to be known to be reading, instead of the articles themselves.

This is a social magnification like the biological magnification in nature, whereby toxic substances pile up in greater quantities in the gizzards of animals higher up in the food chain. Here, perceptions of legitimacy and quality accumulate in greater quantities in the feeds and timelines of people who consume, or even glance through, the most information. And this way, a general consciousness of what’s considered desirable erects itself without anything drastic, with just the more fleeting and mindless actions of millions of people, into a giant wheel of information distribution that constantly feeds itself its own momentum.

As the wheel turns, and The Atlantic publishes an article, it doesn’t just publish a good article that draws hundreds of thousands of readers. It also rides a wheel set in motion by American readers, American companies, American developers, American interests and American dollars, with a dollop of historical imperialism, that quietly but surely brings the world a good article plus a good-natured reminder that The Atlantic is good and that readers needn’t go looking for anything else because The Atlantic has them covered.

As I wondered in 2017, and still do: “Will my peers in India have been farther along in their careers had there been an equally influential Indian for-publishers tech stack?” Then again, how much is one more amplifier, Pocket or anything else, going to change?

I went into this tirade because of this Twitter thread, which describes a similar issue with arXiv – the popular preprint repo for physical sciences, computer science and applied mathematics papers (don’t @ me to quibble over arXiv’s actual remit). As the tweeter Jia-Bin Huang writes, the manuscripts that were uploaded last – i.e. most recently – to arXiv are displayed on top of the output stack, and what’s displayed on top of the stack gets more citations and readership.

This is a very simple algorithm, quite like Pocket’s algorithm, but in both cases they’re algorithms overlaid on existing bias-amplifying architectures. In a sense, they’re akin to the people who might stand by and watch a lynching, neither egging the perpetrators on nor stopping them. If the metaphor is brutal, remember that the effects on any publication or scientist that can’t infiltrate or ‘hack’ social biases are brutal as well. While their contents and their ideas might deserve international readership, these publications and scientists will need to spend more – energy, resources, effort – to grab international attention again and again.

The example Jia-Bin Huang cites is of scientists in Asia, who – unlike their American counterparts – can’t upload a paper on arXiv just before the deadline so that their papers sit on top of the stack because 2 pm in New York is 3 am in Taipei.

As some replies to the thread indicated, the people maintaining arXiv can easily solve the problem by waiting for the deadline to pass, then randomising the order of papers displayed in its email blast – but as Jia-Bin Huang notes, doing that would mean negating the just-in-time advantage that arXiv’s American users enjoy. So here we are.

It isn’t hard to see how we can extend the same suggestion to the world’s Pockets and Nuzzles. Pick your millions of users’ thousand most-read articles, mix up their order – even weigh down popular American publishers if necessary – and finally advertise the first ten items from this list. But ultimately, until technological solutions actively negate the biases they overlie, Pocket will lie on the same spectrum as the tools that produce the biases. I admit fact-checking in this paradigm could be labour-intensive, as could relevance-checking vis-à-vis arXiv, but I also think the latter would be better problems to solve.

The climate change of bad news

This post flows a bit like the 1987 film Full Metal Jacket. As one friend put it, “It starts somewhere and then goes in a different direction.”

This year hasn’t been beset by the same old steady drizzle of bad news we have every year – but has borne the brunt of cyclonic storms, each one distinctively episodic and devastating. The latest of these storms is l’affair Rukmini Callimachi. To the uninitiated: Callimachi is a reporter with the NYT who shot to fame from 2015 or so onwards for her inside reports of the Islamic Caliphate; she later dramatised her efforts to produce these stories in a podcast called Caliphate. And in this time, she raked up four Pulitzer Prize nominations (although I don’t set much store by prizes in general).

I haven’t read or listened to her work, so when a friend shared a link to the NYT’s own report, by its media columnist Ben Smith, discussing the charges against Callimachi and their newfound, but evidently delayed, efforts to reevaluate her work, I wasn’t guilty of not having criticised her myself. (If you think this is a tall order: the headline of Jacob Silverman’s review of this storm for The New Republic describes, in a few words, how quickly her house of cards seems to fall down.)

However, these days, a successful journalist is two things: she is the producer of stories that have changed the world, and which continue to live lives of their own, and she is a role-model of sorts. Her output and her resolve represent what is possible if only one tried. An even greater example of such work is that of the journalists at the Miami Herald – especially Julie Brown – who exposed Jeffrey Epstein and brought on, among other changes, a reckoning at various universities around the US that had knowingly accepted his money and overtures.

But now, with Callimachi’s articles seemingly teetering on the brink of legitimacy, both the things she stood for are on the edge as well. First, the good thing: her stories, which – if Smith’s account is to be believed – Callimachi seems to have composed in her head before moving in to report them, often, if not always, with the spiritual and material support of many of NYT’s senior editors. Second, the bad: her legacy, such as it is – erected as a façade at which we could all marvel, at least those of us who unquestioningly placed our faith and hope in the greatness of another. This is the guilt I feel, a fractured reflection of what Callimachi’s coverage of the Islamic Caliphate at the NYT is itself going through right now.

However, I will also be quick to shed this guilt because I insist that as much as I’m tasked – by my employer, but the zeitgeist, so to speak – to be wary, cautious, skeptical, to fact-check, fact-check, fact-check, to maintain cupfuls of salt at hand so I’m never taken for a ride, just as much as I’m behooved to stand on guard, I’m also fortifying an increasingly small, and increasingly precious, garden in a corner of my mind, a place away from the bad news that I can visit in my daydreams, where I can recoup some hope and optimism. Today, the winds of l’affair Callimachi blew away her articles and podcasts from this place.

Make no mistake, I will still call out everything that deserves to be called out: from the multiple red-flags Silverman spotlighted to the anti-oriental undertones of Callimachi’s methods, of her claims and even of the self-recrimination bubbling up around her, to a lot of which Rafia Zakaria has (repeatedly) called attention. I’m only saddened, for now, by the unstoppable eradication of all that is good, such as it is, and by the guilt for my part in it. As a political being, in this moment I deem this march upon ignorance to be necessary, but as a human one, it is deeply, and to my mind unforeseeably, exacting. A cognitive dissonance for the times, I suppose, although I’m sure I will cope soon enough.

Fortunately, perhaps in a counterintuitive sense, the Callimachi episode is personally not very hard to recover from. While it is true that what Callimachi and her collaborators have (still largely allegedly) done is quite different from, say, what Jonah Lehrer did, they were both motivated by a common sin: to print what could be instead of what is (and even these words might be too strong). More specifically, reporting on war brings with it its own seductions, many of them quite powerful, to the extent that some – as Zakaria implied in her piece for The Baffler – may choose to believe Callimachi et al’s failings are still the failings of an institution vis-à-vis conflict journalism. But no, the problem is pervasive.

However, looking on this shitshow from not-so-distant India, two bells have been quick to go off. First, this is very old wine in a new bottle, in which, to borrow Zakaria’s words, “the greed for catching terrorists” is pressed into the service of making “white journalists’ careers”; you could replace ‘terrorists’ with anything else that has been touched, at any point in its history, by a colonist or invader. Also read Priyanka Borpujari’s 2019 essay in the Columbia Journalism Review, in which she writes:

The title ‘foreign correspondent’ has long been synonymous with whiteness, maleness, and imperialism—journalists fly in from North America, Europe, and Australia to cover the poverty and wars of the non-Western world. In recent years, a push for diversity has meant that more women are pursuing stories in what was once the domain of men—conflict zones and fractured democracies—or in traditionally private female spaces. But the opportunities for journalists in non-Western nations to tell their own stories in international outlets have not been as great. Overwhelmingly, foreign reportage still relies on a model of Western, and largely white, reporters hiring local journalists in subservient roles.”

And thanks to biases in the way technology is constructed, used as well as located around the world, the problem extends to the consumption of journalism as well. To quote from an older post:

Where an app [that amplifies content] was made matters because nobody is going to build an app in location A and hope that it becomes popular in faraway location B. Pocket itself is San Franciscan and the bias shows: most recommendations I’ve received, or even the non-personalised trending topics I’ve spotted, are American. In fact, among all the tools I use and curation services I follow, I’ve come across only two exceptions: the heartwarming human-curated 3QuarksDaily and Quora. I’m not familiar with Quora’s story but I’m sure it’s interesting – about how a Q&A platform out of Mountain View came to be dominated by Indian users.

I notice a not insignificant number of articles and essays, in English, to this day emerging from blogs and publications in Central, South and Southeast Asia, South America and of course Africa that will never go viral on Twitter, make it to the list of ‘most read’ articles on Pocket or be cited by even the most quirky columnist – even as the same ideas and arguments will virtually ‘break the internet’ the moment they emerge from The Atlantic or New Yorker a few months later.

None of the writers of The Atlantic or New Yorker can be blamed, at least not most of the time, for something quite hard to discover in the first place, but that doesn’t mean Big Tech isn’t distorting our view of who is doing good work and who isn’t. And many Indian journalists and writers are often at the wrong end of this discovery problem.

In this light, what Callimachi and the NYT did is not new at all but in fact further widens, or accentuates, the divide between being non-white, non-Western and being white and Western. This is a divide that I and many others, perhaps especially the others, have been habituated to ignore – especially when the crime at hand appears to be victimless but in fact quietly sidelines those who have already been historically, and today structurally, displaced from the ‘mainstream’.

On the other hand, what the NYT has perpetrated here is akin to what many in India (myself included) have done and, to different degrees, continue to have a part in. Specifically, the second bell that goes off has to do with my privileges, one product of which is that I will always be a parachute-journalist in my own country – a member of the top 1% who claims to understand the problems of the 99%.

Journalism professor Justin Martin gently defended parachute journalism in a 2011 essay, deeming fluency in “one of the main local languages” to be a prerequisite of parachuting well. I am not likely to speak any other languages than the four I already know, and less literally, I can never know, in any meaningful sense, what it means to be poor, transgender, tribal, of a lower caste; that lived experience will stay out of reach, and my assessment of what is right will always be inferior to those of, say, a desperate job-seeker, a transgender activist, a member of a tribe, a Dalit scholar when, for example, the topic at hand is poverty, gender, Indigenous people’s rights and caste.

As Martin also admits, “Hiring correspondents who live in the countries and regions they cover … is ideal”, and my higher social status in India does place me in a country other than the one I’m writing about. Although I may not be guilty of allowing information sources I haven’t vetted enough to feed exaggerated stories that I can’t prove in any other way to be true – that is, although we may not all be Rukmini Callimachis ourselves – the composition of our newsrooms means we are only one illegitimate source away, only one moment of weakness for what could be in place of what is away, from creating the next storm.

The technically correct strapline

(Re)Stumbled upon this article, by Ed Yong in The Atlantic, July 2016, this morning. As usual, it is rivetingly packaged. The strapline in particular caught my eye:

Biology textbooks tell us that lichens are alliances between two organisms—a fungus and an alga. They are wrong.

Makes you go “Wow”, doesn’t it? But then you read the article and realise the strap is not entirely right. Lichens are still symbiotic unions of fungi and algae; the new finding is that there are two types of fungi involved, not one. You realise it’s the sort of blurb that only a pedantic biologist might be able to defend, or the sort of blurb most readers could be expected to gloss over because the article’s author is Ed Yong.

I would never have used this strapline to describe the story. Instead, here’s the one we did use for Nandita Jayaraj’s story on the same topic:

Lichens are the most famous and successful examples of symbiosis on Earth, but an unexpected discovery of a third player in this composite organism has given their study a much needed jolt.

As R. Prasad, the science editor of The Hindu, says,

… the strapline (or deck) together with the headline makes the sales pitch to the reader for her time. The headline is often the sole bit of metadata that will be most visible on platforms like Facebook and Twitter, and is the one that’ll be most commonly shared (my guess). This way, the headline makes the all-important elevator pitch to bring the reader off of her platform and onto our site. Once she’s here, the strapline makes a more extended pitch to get her to start reading the body.

For curiosity gap headlines, the strapline often heightens the curiosity instead of fulfilling it. This is also true in the Ed Yong article: the headline makes you wonder what bit of biology was overturned; the strapline takes over from there, focuses your imagination into the niche, and still keeps you wondering (not necessarily about the same thing). The question here to me is whether it’s okay to be only technically right in the strapline because it’s still part of the inverted pyramid, where you can get away with making generalisations at the top as you funnel the reader’s curiosity into more specific niches below.

As a prolific consumer of science writing both fab and crap, The Atlantic‘s strap is not good enough for me; it’s a letdown. While Yong does a typically good job of dramatising the reveal, it pales in comparison to what the strap seemed to suggest. Such a description would be par for the course on, say, the Times of India, but I would expect much better from The Atlantic. It often feels like the smaller publishers are held to higher standards than the bigger ones, and in this sense The Atlantic certainly towers over The Wire.

Featured image credit: Free-Photos/pixabay.