Tuesday, October 25, 2011
Cognitive illusions and law school grades
He doesn't argue that all expertise is equally self-deluding. Instead, he writes that "[t]rue intuitive expertise is learned from prolonged experience with good feedback on mistakes." In addition, "the environment" needs to be one "in which the judgment is made sufficiently regular to enable predictions from the available evidence." Some settings -- apparently the stock market is one -- are just too irregular for predictions to be made. Presumably the best course in such contexts is to make no predictions at all, for example by investing in index funds which will assure that you do exactly as well as the market as a whole.
Is it possible to predict who will be a good, or a successful, lawyer? (I realize those two adjectives have meanings that overlap but aren't the same.) Sometimes the answer is surely yes. A student from a very highly-regarded law school who does very well at that school has a strong chance of getting a job in a law office with high standards of practice and vigorous training, and he or she probably will go on to a successful career. But that example is a misleading one, because what makes the prediction possible may not be any direct function of the student's ability (reflected here only in his or her high grades and the fact that the student is at a highly regarded law school) so much as it is the result of a set of social factors that mark out a relatively smooth path to success. And even here, if we asked which of our full-of-promise students would turn out to be the best, or the most successful, I think we would have a lot more difficulty answering.
I implied just now that grades reflect ability. But do law school exams measure future legal success? I know of no study that finds evidence of this, perhaps in part because it's so difficult even to formulate an objective and usable measure of success. (Nevertheless, as a colleague has pointed out to me, many legal employers have historically placed a great deal of weight on grades.)
Rather than contending that law school exams actually measure the chance of future success, it seems more plausible to maintain that law school exams measure legal reasoning ability, which is, in turn, a component of success. But it isn't certain that exams measure legal reasoning ability very well, since (as has often been pointed out) it's not self-evident that the ability to rapidly deploy knowledge hastily crammed before an exam is a very good measure of ability to perform all or most of the various reasoning tasks that practicing lawyers actually undertake. Being able to do well on law school exams is a pretty good predictor of ability to do well on the bar exam -- which is essentially a really big and long law school test -- but the bar exam's ability to measure reasoning ability in general, or in other contexts, is also questionable.
All of this does raise the possibility that law school grades, collectively, are like the officer candidate screening test Kahneman performed. Until we can measure success, we will have to accept that it may turn out that the grades we law professors give really don't correlate much with anything except each other. (Even that correlation isn't perfect, but I think it is probably true that over 3 years of law school a pattern of grades usually emerges.)
But I would not suggest giving up altogether, and instead resorting solely to the law school equivalent of an index fund (would that be universal pass-fail grading?). That's partly because I think grades do roughly measure some aspect of reasoning ability, and I'm inclined to think that ability shown on exams does to some extent reflect ability in other reasoning contexts as well. (This may be my illusion of validity.) But I also think that grades probably measure -- imperfectly -- more than legal reasoning ability. To be specific, they measure success in law school, and not success on a one-hour, artificial exercise (as in Kahneman's military screening) but in the principal occupation of a student's life over a three-year period. Good grades are a measure of "successful-ness," which in turn is a reflection of a host of factors, including ability, determination, self-discipline and adaptability, all of which are probably relevant to the course of one's future life. It's often said that law school is a process of socialization, and "successful-ness" might be rephrased as the accomplishment of socialization.
So in the end law school grades may be a predictor of future success (and not just because so many advantages, such as Law Review membership, accrue to those who get these good grades -- and in turn promote their chances of success elsewhere). Anyone hiring a young employee would like a measure of his or her successful-ness, and we have reason to think that law school grades may be a genuine measure of that. We also have ample reason to think that they're far from a perfect measure of this complex set of qualities, let alone of how the current student will grow and develop on these scores over time. That, I think, does counsel in favor of modesty of prediction: we may know something, but we don't know too much. It is tempting to say that we should still rely on whatever we do know, because that's better than nothing (and also may be a cheap way to carry out an otherwise very difficult task). But to borrow again the language of finance, perhaps the legal profession really should diversify its portfolios, and put a healthy chunk of its resources -- that is, its hiring predictions -- into considering criteria other than grades. Perhaps employers should even make some use of "index funds" or, in other words, should acknowledge that seeming differences in credentials may actually not have predictive value. Many employers may already do this. For those that don't, the next problem for law schools is how to persuade employers to consider, but not be seduced by, the grades we give.
Friday, October 21, 2011
The Killing of Muammar Qaddafi
His murder should not surprise us. He ruled by brutality, and died the same way. But it is worth noting that this is not simply poetic justice. Rather, it reflects a fundamental truth: that the rules of war, and other rules that somewhat restrain the utter ferocity of conflict, depend on mutual adherence for their continued effectiveness.
It might be a good thing if human beings who were regularly subjected to outrageous and unlawful violence characteristically continued to live by the very rules whose violation was wreaking havoc upon them. Whether it would or wouldn't be a good thing depends on your assessments both of strategic calculations of deterrence and your views of the reasons for the binding force of moral rules. But whether or not such conduct would be a good thing, it isn't likely. People don't act that way. We're too quick to anger, too skeptical of each other's intentions, too impatient with enduring suffering. Not everyone, but probably most of us.
If you live by the sword, you will die by the sword -- if your enemy can get his hands on a sword. Qaddafi's did.
Tuesday, August 30, 2011
Opposing the proposed appointment of a new Chief Justice of South Africa
I've joined several other US-based law teachers in submitting a letter criticizing this proposed appointment. Here it is:
The Secretariat
The Judicial Services Commission
Private Bag XI
Constitution Hill
Braamfontein 2017
SOUTH AFRICA
August 26, 2011
Fax No. 011-27-86-649-0944
By e:mail and Fax:
This Memo is in response to the Judicial Services Commission’s call for public comments on the nomination of Justice Mogoeng Mogoeng as the next Chief Justice of South Africa. We are a group of USA-based law professors who have written extensively on South African constitutional issues, and who have followed the proceedings of the Constitutional Court since its establishment in 1995. We are all admirers of the jurisprudence of the Constitutional Court, particularly the court’s path breaking and innovative human rights jurisprudence.
We write to express our concern at President Zuma’s decision to nominate Justice Mogoeng Mogoeng as the next Chief Justice. We do so not to impugn the integrity of Justice Mogoeng, but to suggest that his appointment will betray the transformative vision embodied in the constitutional text and in the jurisprudence if the Constitutional Court thus far. Those of us who write and teach in the area of the constitutional law and human rights law have been inspired by that vision.
The Constitution of South Africa has been much heralded and constantly referenced by constitutional and human rights scholars and advocates. In addition, judgments of the Constitutional Court have been admired, particularly in the court’s human rights jurisprudence. Although some problems since 1994 have tested the capacity of the legal system, especially in the area of criminal justice, the South African legal system is for the most part highly regarded and widely admired. Several reasons account for this, but one is the caliber of judges appointed to the nation’s highest courts, including the Supreme Court of Appeal, but particularly the Constitutional Court. Indeed, the Constitutional Court’s first appointed judges constituted an impressive range of the country’s most admirable legal talent, including legal giants of the anti-apartheid legal establishment. The judgments of the court, and particularly its human rights jurisprudence, are widely cited and analyzed. It may not be an overstatement to suggest that the South African Constitutional Court is currently viewed as one of the pre-eminent constitutional courts for interpreting international legal principles, particularly as those principles pertain to human rights. Since its establishment in 1995, the Constitutional Court has achieved a solid reputation and an impressive degree of credibility among the international legal community. Its judgments have been seen as central to the transformative project of nation-building in South Africa, and a model to countries of the global north and global south.
The Constitutional Court is in fact one of the pre-eminent contemporary institutions articulating the transformative possibilities embodied in the international human rights texts. The Court has interpreted these texts in its judgments, and in doing so has provided a vehicle for lawyers, activists and law teachers internationally to pursue rights in their respective locations. The Constitutional Court may be a South African institution, but its reach and its audience are international. We are members of that international audience.
We believe the JSC has a responsibility to do more than decide whether the President's nominee is "qualified" to serve as Chief Justice. Rather, the JSC's special task is to reach a judgment about whether the nominee will sustain the momentum of the rights revolution in South Africa. As law scholars in the United States, we are well aware that the individuals serving on the highest court of the country can profoundly change the direction of its jurisprudence, for good or for ill, without any change in the words of the Constitution. We fear that as Chief Justice, Justice Mogoeng will fail to build on the enormous efforts that have been made in South Africa to transform the lives of those subordinated and marginalized under apartheid. In particular, recent reports about Justice Mogoeng’s judgments in cases involving violence against women and the rights of sexual minorities raise concerns about his commitment to the values the Constitutional Court till now has protected under South Africa’s Constitution.
Is it a response to these concerns to say that this appointment is part of the transformation of the South African judiciary? We agree that South Africa's judiciary is, like South Africa itself, engaged in a complex and vital process of transformation. Moreover, the JSC has a special responsibility to further that transformative process. But this is not the issue here. We are especially concerned that President Zuma has made this decision while overlooking other jurists who not only have more substantial judicial experience than Justice Mogoeng, but have also themselves played important roles in South Africa's transition to democracy, and who fully embrace the transformative vision of the Constitution, including the current Deputy-Chief Justice Moseneke, who has served two Chief Justices.
We urge the members of the Judicial Services Commission to consider our perspectives even though we are located in the USA and do not live in South Africa. We may be far away physically but we feel a deep connection to constitutional developments in South Africa.
We respectfully submit these perspectives and thank you for your consideration.
Sincerely
Associate Dean Penelope Andrews, City University of New York School of Law
Professor Taunya Banks, Jacob A. France Professor of Equality Jurisprudence, University of Maryland Francis King Carey School of Law
Associate Dean Stephen Ellmann, New York Law School
Associate Dean James Gathii, Governor George E. Pataki Professor of International and Commercial Law, Albany Law School
Professor Erika George, S.J. Quinney College of Law, University of Utah
Professor Mark S. Kende, James Madison Chair in Constitutional Law, Drake Law School
Professor Karl Klare, George J. and Kathleen Waters Matthews Distinguished University Professor, Northeastern University School of Law
Dean Makau Mutua, SUNY Distinguished Professor and Floyd H. & Hilda L. Hurst Faculty Scholar, Buffalo Law School
Distinguished Professor Ruthann Robson, City University of New York School of Law
Professor Kendall Thomas, Nash Professor of Law, Columbia Law School
Professor Lucy Williams, Northeastern University School of Law
[Institutions listed for identity purposes only]
Monday, August 22, 2011
A very important question about Harry Potter
So after I saw the final Harry Potter film (Harry Potter and the Deathly Hallows Part 2), I went back to the text -- that is, the book. There are a bunch of differences. For instance:
In the book, Harry is looking for the diadem of Rowena Ravenclaw, which no person living has seen, and he has the idea of speaking to someone not living -- namely, a ghost. That idea belongs to Luna in the movie.
In the book, when Harry, Ron & Hermione need to escape from Gringott's, it's Harry who has the idea of grabbing on to a dragon to get them out of there. In the movie, Hermione has this bright idea.So what are we to make of these changes?
In the book, Ron & Hermione tell Harry about their getting into the Chamber of Secrets to acquire basilisk fangs (for destroying the horcruxes in which Voldemort has secreted parts of his soul); Ron says he remembered, more or less, the words in Parceltongue -- snake language -- that Harry ad uttered when he got into the chamber some volumes back. In the movie, we actually see Ron & Hermione accomplish this, and the action comes complete with some sexually-charged banter that's part of the build-up of their becoming, beyond any doubt, an item.
All of these changes make Harry not quite so much the focus, and bring our attention to other characters in the story. On the other hand, in the movie the final fight between Harry and Voldemort seems to feature just the two of them, while in the book their duel takes place at the climax of, and in the same place as, the climactic battle in which everyone is involved. So in this respect the staging is more Harry-centric.
One answer is that there is a law of conservation of Harry: if his role declines in three smallish places, it must increase to an equal extent in one prolonged, crucial scene.
A second is that there are at least two ways to tell the story that are equally correct. And if two, why not three or more? The varying details of individual tellings still converge into a single fundamental narrative, the true essence of Harry Potter.
A third is that there is no single Harry Potter story. I said that I went back to the text, meaning the book, but who is to say that the book is the text? The movie is a text too. Of course Hollywood routinely distorts the texts of the books it turns into films, but here, as it happens, J.K. Rowling is both the author of the books and a co-producer of the movie. So she is, in some sense, a creator of both. If the true Harry Potter story is the story she created, she has created it twice, and in somewhat different forms. As poets sometimes rewrite their own poems years after their initial publication, so J.K. Rowling has revisited her own story. There are, therefore, at least two authoritative versions of the Harry Potter canon.
A fourth is that there is, after all, one and only true Harry Potter story: the book. When J.K. Rowling authorized variations from the book in the movie, she wasn't creating another authoritative version. Rather, she was just like all the rest of us as we encounter her books: she was interpreting them. J.K. Rowling had no more, and no less, license to retell the Harry Potter story than we do (except under copyright law), and her film reading of her own book is only an interpretation of the true text.
All of these arguments probably have analogies in biblical studies or constitutional law -- but I won't pursue them! The movie's fun, just as the book was -- and I hope this post doesn't spoil any of it for you.
Wednesday, August 17, 2011
Once more with feeling: who exactly are we?
There's now experimental evidence that we actually make certain decisions slightly before we become aware of having done so -- the circuits for taking action begin to fire before we report deciding. One question such evidence raises is about the actual function of the conscious mind; is it just the brake on ill-considered choices by other parts of our brains, or is it instead the rationalizer of them ( to persuade ourselves or others of the rightness of what we've already done), or does it come into play, perhaps, for some more complex set of decisions whose nature isn't captured by the experimental reports? But for now I'm not concerned with the question of what the point of consciousness is.
Rather, what's interesting about this evidence, in the context of the question of who exactly we are, is that it indicates that some part of us besides our conscious minds makes some of our decisions. Presumably that part of us also thinks about those decisions, in some way or other evaluating the pluses and minuses of possible courses of action. Perhaps this part of us thinks in very primitive ways, but it thinks. (Reflexes may not be examples of "thought," but my impression is that the decisions I'm focusing on are not so instantaneous as to be reflexive.) And "we" don't have direct access to those thoughts, until they emerge in the form of an already-made decision.
Perhaps these masked thoughts are available to us through dreams or psychoanalysis or both. But at the least it seems to be the case that anyone who has not achieved such access is operating partly in the dark about his or her own self. And it may be that even when we achieve greater (perhaps never complete?) access to our own thoughts and feelings, what we find is not that we are in fact a single coherent person after all -- just now visible at last -- but something more like a core personality and a periphery, made up of routines (emotions, thoughts, reaction paths) that actually aren't integrally connected to the rest of ourselves.
It's often said that we aspire to wholeness, and that age helps us to achieve this. But the corollary of these propositions is that for many of us, or for all of us in some respects, we are not in fact whole. "We" -- that is, single fully organized "I's" -- don't quite exist.
Tuesday, August 16, 2011
Who are we again?
From this we learn two things. First, it is possible, in fact typical, for human beings to have within them DNA from another species. Does that make these human beings not human? Obviously not; these DNA-borrowing humans are most of the humans there are. (Whether the Neanderthals should be described as "non-human," by the way, is itself part of what's at issue -- what's the line between humans and non-humans? But as I understand it, even if Neanderthals are humans they're not our particular species of humans, homo sapiens.)
On the other hand, does the lack of this admixture of another species' DNA make someone not actually a human in the sense we should today understand the term? Again, clearly not. Hundreds of millions of members of our species don't have any Neanderthal DNA.
Matters seem likely to grow more complex -- that is, it seems likely that we will find more of these borrowings from other species. Kolbert reports the recent discovery of another non-homo sapiens species, the Denisovans (named for the cave in which a finger bone from the species was found) -- and it turns out that one group of modern humans, the New Guineans, share "up to six per cent Denisovan DNA" (page 74). Presumably this six per cent is in addition to their 1 - 4 % of Neanderthal DNA. And who knows who else we interbred with? As Kolbert emphasizes, it appears that we routinely interbred with those we were exterminating. (Did we exterminate the Neanderthals deliberately, or just as a byproduct of taking the fruit of the land away from them? We don't know. But it's hard not to think that the circumstances of our "borrowing" of DNA were very unpleasant.)
So it is quite possible for members of our own species to carry within them DNA from one, two, perhaps more other, closely related species. And different members of our species carry different mixes of DNA from these other species. Kolbert's article focuses on the search for whatever it may be that makes us distinctively human -- the genes that we have to have, and that those other species lacked. That's a useful search, but the fact remains that even if "we" are the beings who share this as yet unidentified characteristic, there are many things that we don't share with each other, and do share, apparently, with the members of other species, long extinct.
One more point: Suppose there is some genetic essence of humanity that distinguishes us from our close relatives -- the Neanderthals and Denisovans of the past, or the clearly not-human, but very smart, chimpanzees of the present. But once we've identified this essential spark of humanity, what about all the inessential details? Would genetically green hair take someone out of the human race, if he or she held the human spark? That seems implausible. What about webbed feet? Again, that change by itself doesn't seem to make a human being inhuman. But what's the boundary? It's clearly not genetic identity; after all, as Kolbert notes (at 72), there's a lot of genetic variation between members of our species (presumably even leaving aside the heritage of borrowings from other species by some but not all of our ancestors).
In short, it seems as though the definition of human is going to turn out to be an act of will rather than a fact of biology.
Monday, August 15, 2011
Who are we anyway?
It seems to me that this report raises some question about just who "we" are. I admit I'm not at all expert on any of this, so what I'm saying here is frank speculation. In particular, I'm not sure what portion of human body cells are not protein-encoding, but one possibility is that all human body cells do this, so that what these researchers have found is that most of the cells inside our body are not human cells. If some human cells aren't protein-encoding, that would change the percentage of all cells inside us that are human -- but that would alter the point I'm making only in terms of percentages.As they look beyond the genome, cancer researchers are also awakening to the fact that some 90 percent of the protein-encoding cells in our body are microbes. We evolved with them in a symbiotic relationship, which raises the question of just who is occupying whom.
“We are massively outnumbered,” said Jeremy K. Nicholson, chairman of biological chemistry and head of the department of surgery and cancer at Imperial College London. Altogether, he said, 99 percent of the functional genes in the body are microbial.
If, again, most cells inside us aren't human, and yet they are integral to us, and part of our daily operations, are they part of us? Suppose, as the article also suggests, that the human cells and the microbial ones may be in chemical communication, and this communication is integral (in some way we don't yet understand well at all) to our daily functioning. Should we say these nonhuman cells are no more "us" than inanimate oxygen or water molecules? But we are made up of inanimate molecules, rendered part of animate beings; the molecules are us. Are we equally made up of other animate beings? I've often thought that it is odd that we are made up of animate cells -- our own, human cells -- that somehow don't count as beings in their own right even though they live and die. But now we're talking about being made up of other beings, independent (though tiny and obscure) beings.
This feels rather weird, but it's not inconceivable. If tremendously powerful computing machines can be created by linking multiple separate machines together, it is conceivable that powerful beings can be created by somehow corralling multiple separate beings. We're accustomed to think of "us" as unities, but perhaps that's a mistake, and we're more like "products" of combining parts.
I'm not certain whether it matters what we're made up of -- whether we as composite creatures behave differently than we would if we were single unities, or whether we have different moral obligations. But the intuitive feeling I have (or "I" have) is that the fuzzier we are as beings, the more we should resist any simple prescriptions about what we must be or do. Even if that's not true, it's hard not to wonder who we are -- and I expect I'll be saying (speculating) more about this little matter in future posts.