Showing posts with label peer review. Show all posts
Showing posts with label peer review. Show all posts

Monday, November 28, 2016

Who Knows Anything? - Journalism, Caesarean Section, and the Production of Knowledge

The New York Times ran a story about an amazing c-section survival in 1337. But historians of medieval medicine don't think it happened. 

By Monica H. Green

On Wednesday, 23 November 2016—the day before the Thanksgiving holiday in the U.S.—the New York Times ran what it likely assumed to be a “fun fact” story, a minor historical discovery on a slow news day. Under the category, “What in the World” and headlined “A Breakthrough in C-Section History: Beatrice of Bourbon’s Survival in 1337,” the Times piece recounted how Czech researchers had found “an apparent case” of a Caesarean section performed on the recently married, 19-year-old medieval queen of Bohemia.
Pullquote:  In our heightened debates about “Fake News,” we should give more thought to how “knowledge” (“unfake news”) is produced and disseminated.

The piece would likely have quickly become ephemera had it not been picked up by Twitter. There, the case of Beatrice reached the attention of historians specializing in medieval women’s history and medieval medical history. It immediately provoked skepticism.

In our heightened debates about “Fake News,” we should give more thought to how “knowledge” (“unfake news”) is produced and disseminated. In this case, the curtain that needs to be pulled back is the process of peer review.

To the historian of medicine, the study bears all the pitfalls of amateurish oversight. It takes no account of the past thirty years of scholarly literature in either the history of medieval obstetrics (or women’s history more broadly), nor the history of medieval surgery or anesthesia. Peer review by historians of medieval medicine would have quickly identified these problems. It seems, however, that the piece was only refereed by physicians.

What is peer review?


Peer review involves works being sent out, before publication, to other scholars who work on similar questions to the item under review. They assess the piece in terms of its coverage of the existing literature in a field, the originality of its question, and the rigor of its methods. Based on those criteria, publication (or not) is recommended.

But who are “peers”? In the case of medical history, that is a major issue. Are peers physicians who have been trained in modern medicine, who have treated living patients, excised real tumors, autopsied fresh cadavers? Or are they historians who have been trained in the languages, cultures, archives, and traditions of the past? Researchers who have both MDs and PhDs exist, but are rare. The authors of the Czech C-section study self-identify as a physician, a member of the philosophy faculty, and a historian, all at the Charles University in Prague: an impressive interdisciplinary team. The reviewing process should have involved scholars with a similar range of competence.

Pullquote: just as “local knowledge” is needed to interpret the nuances of language and culturally coded behaviors, so local academic knowledge is needed to explain how published work is generated in different professional fields.
The argument of the study hangs on the slimmest thread of evidence, the meaning of the Latin word incolumitate in two versions of a letter sent out under the queen’s name after the birth. Incolumis, according to the Latin dictionary commonly known by its authors’ names, Lewis and Short, means simply “unimpaired, uninjured, in good condition, still alive, safe, sound, entire, whole.” Its medieval usage is comparable. Yet from that single word, and from other accounts written a century or more after the said birth (leaving plenty of time for a private event to have mushroomed into legend), the authors deduce that the queen must have undergone a C-section. Since she clearly survived, the “operation” must have been successful.

There are legitimate grounds to debate the linguistic weight of the word incolumitate, and legitimate grounds to debate the political context in which this still uncrowned queen had to assert her right to the consort’s throne. There are also medical grounds to question the interpretation. Could not incolumitas here mean, for example, that Beatrice, still a teenager, had survived the birth without the crippling damage that obstetric fistula is known to visit upon girls being forced to bear children too young? Unfortunately, neither this scenario, nor many other possible obstetrical outcomes, all of which are well-known from medieval records, are assessed here.

National pride and international spin

The study appeared earlier this year in the national Czech journal of gynecology, meant, apparently, to provide an interesting reflection on national history to the country’s obstetrical specialists.[1] For its original audience, its speculations about the nation’s medieval history were no doubt fascinating. Once its message was amplified internationally by the New York Times, however, it suddenly became “a breakthrough,” a major scientific discovery. Antonin Parizek (“a noted obstetrician and expert on medical history,” according to the Times, and the study’s lead author), seems to be the only person interviewed for the news story. The unsubstantiated interpretation of incolumitate now becomes a fact of history: “Beatrice most likely passed out during delivery,” Parizek is quoted as saying, “and was believed dead … The surgeons opened her only to save and baptize the child. The pain from the operation then likely led to her awakening.”

In short, this is fiction. But, presented as “fact” by the New York Times, it becomes accepted as truth by a world-wide audience. The word “apparent” is the only qualifier given, and other statements—such as the reference to “other archival sources” without clarification that they postdate the birth by anywhere from one to five centuries—mislead the reader.

As noted above, the New York Times piece appears in a section of the newspaper called “What in the World.” This section is meant to circulate news stories coming from other national news outlets, and this one may have been picked up from Czech media. That is certainly a worthy, and indeed, necessary goal in our globalized world. But just as “local knowledge” is needed to interpret the nuances of language and culturally coded behaviors, so local academic knowledge is needed to explain how published work is generated in different professional fields.

The New York Times has given us a prime example of how fake news is generated. In this case, the news is not “fake.” The Czech study really was published. But the implication that it reflected any kind of consensus on what historians believe about women’s medical history was absolutely false.

“What in the world,” indeed.

---
Monica H. Green is a historian of medicine and global health. A professor of History at Arizona State University, she has published extensively on the history of medieval women’s healthcare, including her award-winning book, Making Women’s Medicine Masculine: The Rise of Male Authority in Pre-Modern Gynaecology (Oxford University Press, 2008). Many of her works, including her comprehensive bibliography on women and medicine in the Middle Ages, can be found on her Academia.edu page.

[1] Thanks to Roberto Labanti for this reference. Thanks as well to Maaike van der Lugt, Katharine Park, and Fernando Dias de Avila Pires for helpful comments.

Wednesday, January 20, 2016

Grab Your Balls and The Problem with Blind Peer Review

Men's Rights Activists are a particular strain of misogynist who couch their hatred of women in appropriating a language of victimhood. As an avowed feminist, I have encountered them many times, including when I put a defense of feminism on a website haunted by MRAs, and hung around in the comments for a few days learning about their discourse.

My general summary is this - to the extent MRAs have identified real problems with the treatment of men in western society, the answer is always (as Amanda Marcotte says), more feminism. Patriarchy does oppress men, if not in the same way as it does women, and the only way out of that is through taking apart the patriarchy, feminism's avowed goal. I'm glad that's settled.

Last week, a medievalist went to Allen Frantzen's website to check some references and discovered a section called "New! Writing on Men and Masculinity!" Frantzen is now retired from a long career at Loyola University - Chicago, but remains an extremely important scholar of Anglo-Saxon literature. He is a pioneer of queer and gender studies of Beowulf and has strongly influenced how scholars engage this most critical text in the history of the English language.

His writing on Men and Masculinity is full-blown MRA misogynistic hate, combining the absurd and the vile. This is a donotlink to a page on "how to fight your way out of the Feminist Fog. Step one - Grab Your Balls! (GYB)" No, that's really the quote. Hashtags have included #GYB and #FemFog

Everything on the site is standard MRA material, quoting the red pill/blue pill of  MRA discourse, which is almost disappointing. I'd actually be interested, in a horror-show sort of way, to see what a brilliant theorist could do with MRA ideology. But since there's no meat to the ideology, even this great mind is reduced to nonsense.

Here are four several pieces that have covered it well. After that, I'll argue that blind peer review has to go. It's a vehicle for bias-replication, and always has been.

[Update: I have been criticized, appropriately, for not quoting any Anglo-Saxonist female scholars. I am adding content. PLEASE let me know what else I'm missing. I so appreciate criticism.]

Peter Buchanan sums up the stakes for Anglo-Saxon scholars:
It is distressing for young, theory-savvy Anglo-Saxonists to see Allen Frantzen behaving like a reactionary crank because we are conscious of the fact that our field has room for us because Frantzen was one of the people who fought for our place in the field in the 90s. We’ve read his Desire for Origins and Before the Closet, and assigned chapters from them to our students. For that matter, my theory class this semester is reading a chapter from Desire for Origins. It is doubly distressing because while Frantzen has a big name in Anglo-Saxon studies, he is not necessarily well-known outside of it (unless you study same-sex desire), and so we see our late-medieval colleagues dismissing his toxicity without any awareness of how important he was/is to the field. Frantzen has also been one of the most influential trainers of Anglo-Saxonists, people who are doing/have done exciting work on gender (Mary Dockray-Miller), digital humanities (Martin Foys), and ethnicity (Stephen Harris).
Of course, this trajectory didn’t come out of nowhere, and if it has become especially toxic in recent years, there were hints of it much earlier.
[Updated material. 11 AM 1/20)] On Facebook, and quoted with permission, Eileen Joy has offered many important comments on her experience with Frantzen in particular and with misogyny and sexism in her field in particular. She writes:
I have written so many op-eds, so many manifestos, and so many essays envisioning these different universities, and I now realize that they were all drafted in the furnace of my rage and despair over how the field of Anglo-Saxon studies has been content to construct itself: scornful of other medievalists who aren't "them," scornful and dismissive of junior scholars who are not yet established or did not go to the right schools or study with the right persons, misogynist and homophobic (while also worshipping masculinity), elitist, conservative, and just plan mean.
From there she talks about persistent sexual predation and abuse within the field.[/update]

Over at The Syllabub, we get much needed laughter, where the author is just "dipping into the #femfog tweets and laughing." She then explains why mockery matters to her as much as cogent debate:
Academia is part of society, and society is structurally sexist. Which means most of us are going to come up against the misogyny in our careers in lots of horrible and awful ways. I don't have enough resources (emotional or mental) to engage with every incident of misogyny with the same vehement refusal, argument and debate.
So, alongside debate, we have mockery. And each person who contributes to the #femfog (whether with a joke, a meme, or with condemnation) is signalling that Frantzen's rhetoric is not part of the future of the academy.
Lavinia Collins writes about the underlying issue in both the FemFog post and much MRA rhetoric:
The crux of my objection to this post is that, despite claiming to be about equality, politics and freedom, it’s actually about sex. How do you get women to have sex with you without having to go to the trouble of pretending you view them as equals? Franzten suggests it is by grabbing your balls and using data.
Jeffrey J. Cohen talks about shaming:
We should be cautious about public shaming and bandwagonning, of course, but if you as a senior and respected member of my field of study are going to fill a website with hatred against women and inveigh against feminism -- the very movement that has made the field as I know and love it possible -- and if you are going to directly link your website full of verbal violence against women to a list of your scholarship that makes it clear that these are not two separate things, but that you are relying on the cachet of the latter to make the former seem learned or compelling, well then you deserve to be shamed publicly, because you are an embarrassment to the field.
There are three posts at In the Middle. Cohen on calling out misogyny. Karl Steel on medieval "whiteness." Dorothy Kim on "Antifeminism, Whiteness, and Medieval Studies." Jonathan Hsy wrote a pragmatic, and much needed, post about "lessons learned" from the #femfog episode.

Please add additional links in the comments.

[update 11:00 AM 1/20]
A number of people have linked to this statement by a group of senior Anglo-Saxonists. I'd like more information on its origins and whether any names have been made public.
Old English Literature and Anglo-Saxon Studies: By far the majority of contemporary scholars in the field of Anglo-Saxon Studies and especially Old English strive to be professional, respectful, generous, equitable and welcoming to all others, irrespective of identity, including but not limited to, gender, sexuality, race, or age. The field does not belong to any one scholar, or to any one approach, or to any single authority. It is the duty of every generation of scholars in Old English to promote our subject and make the field a better, kinder and more desirable place in which to work for all succeeding generations. [/update]

To me, revelations like this need not be surprising. We know that bigots of all sorts permeate academia, because bigots permeate society. Academia runs into trouble when it constructs itself as better than society. If the #femfog helps medievalists believe their colleagues when they discuss misogyny, homophobia, classism, ableism, and so much more, instead of dismissing such concerns as overblown, I'll be pleased.

Here's one question among many:

How many times has Frantzten, a giant in his field, been asked to review feminist readings of Anglo-Saxon literature, and been given power over the career of someone whose views he deeply hates? What do we do about it? When think about Frantzen as an outlier only because he made his bigotry public, doesn't that push us to rethink systems of peer review that conceal the reviewer's identity?

We need to re-invent our prestige systems from so many directions. Re-imagining peer review in order to protect against bias needs to be part of that process. Personally, I like removing the anonymity. Yes, sometimes that will mean people will be too nice, but I'd rather err in that direction.

Your thoughts?