"The Gender Readings Gap in Political Science Graduate Training" by Heidi Hardt, Amy Erica Smith, Hannah June Kim, and Philippe Meister was recently published in the Journal of Politics and featured in a Monkey Cage blog post. The Kim Yi Dionne header for the Monkey Cage post indicated that:

Throughout academia, including in political science, women haven't achieved parity with men. As this series explores, implicit bias holds women back at every stage, from the readings professors assign to the student evaluations that influence promotions and pay, from journal publications to book awards.

The abstract to the JOP article indicates that "Introducing a unique data set of 88,673 citations from 905 PhD syllabi and reading lists, we find that only 19% of assigned readings have female first authors". This 19% for assigned readings is lower than the 21.5% of publications in the top three political science journals between 2000 and 2015 (bottom of page 2 of the JOP article). However, the 19% is based on assigned readings published at any time in history, including authors such as Plato and Sun Tzu. My analysis of the data for the article indicated that 22% of assigned readings have female first authors when the assigned readings are limited to assigned readings published between 2000 and 2015 inclusive. The top three publications benchmark therefore produces an estimate of the gender readings gap in political science graduate training for 2000 to 2015 publications that is less than one percent and trivially advantages women.

Figure 1 in the Hardt et al. JOP article reports percentages by subfield, with benchmarks for published top works, which I think are articles in top 10 journals; the first and third numeric columns in the table below are data reported in Figure 1. Using the benchmark for published top works, my analysis limiting the assigned readings to assigned readings published between 2000 to 2015 inclusive (the middle numeric column) produced a difference greater than 1% that disadvantaged female first authors for only one of the five subfields with benchmark data (comparative politics):

Topic% Female
1st Author
Readings
(All Time)
% Female
1st Author
Readings
(2000-2015)
% Female
1st Author
Top Pubs
(2000-2015)
Methodology 11.5713.6411.36
Political Economy 16.7518.03 NA
American 15.6618.46 19.07
Comparative 20.5523.26 28.76
IR 19.9623.41 22.42
Theory 25.0531.58 29.39

For an example topic most relevant to my work, the Hardt et al. Figure 1 gender gap for American politics is 3.41 percentage points (15.66 compared to 19.07), but falls to 0.61 percentage points (18.46 compared to 19.07) when the time frame of the assigned readings is set to the 2000-2015 time frame of the top publications benchmark. Invocation of an implicit bias that holds back women might be premature if the data indicate a gap of less than 1 percentage point in an analysis that does not include relevant control variables such as any gender gap in how "syllabus-worthy" publications are within the set of top publications. The 5.50 percentage point gender gap for comparative politics might be large enough to consider implicit bias in that subfield, but that's a localized concern.

---

NOTES

1. [*] The post title alludes to this tweet.

2. The only first authors coded female before 1776 are Titus Livy and Sun Tzu (tab surname1 if female1==1 & year<1776).

3. Code below:

* Insert this command into the Hardt et al. do file after Line 11 ("use 'Hardt et al. JOP_Replication data.dta', clear"):
keep if year>=2000 & year<=2015

* Insert these commands into the Hardt et al. do file after new Line 124 ("tab1 gender1 if gender1 < 3 [aweight=wt] // THE TOPLINE RESULTS WE REPORT EXCLUDE THOSE 304 OBSERVATIONS"):
tab1 gender1 if gender1 < 3 [aweight=wt] // This should report 21.86%
tab1 gender1 if gender1 < 3 // This should report 22.20%

* Insert this command into the Hardt et al. do file before new Line 184 ("restore"):
tab topic mn

* Run the Hardt+et+al.+JOP_Replication+code-1.do file until and including new Line 126 ("tab1 gender1 if gender1 < 3 // This should report 22.20%"). These data indicate that, of first authors coded male or female, about 22% were female.

* Run new Line 127 to new Line 184 ("tab topic mn"). Line 184 should output data for the middle column in the table in this post. See the "benchmark_teelethelen" lines for data for the right column in the table.

Tagged with: ,

The Enders 2019 Political Behavior article "A Matter of Principle? On the Relationship Between Racial Resentment and Ideology" interprets its results as "providing disconfirmatory evidence for the principled conservatism thesis" (p. 3 of the pdf). This principled conservatism thesis "asserts that adherence to conservative ideological principles causes what are interpret[ed] as more resentful responses to the individual racial resentment items, especially those that deal with subjects like hard work and struggle" (p. 5 of the pdf).

So how could we test whether adherence to conservative principles causes what are interpreted as resentful responses to racial resentment items? I think that a conservative principle informing a "strongly agree" response to the racial resentment item that "Irish, Italians, Jewish, and many other minorities overcame prejudice and worked their way up. Blacks should do the same without any special favors" might be an individualism that opposes special favors to reduce inequalities of outcome, so that, if a White participant strongly agreed that Blacks should work their way up without special favors, then—to be principled—that White participant should also strongly agree that poor Whites should work their way up without special favors.

Thus, testing the principled conservatism thesis could involve asking participants the same racial resentment items with a variation in targets or a variation to a domain in which Blacks tend to outperform Whites. If there is a concern about social desirability affecting responses when participants are asked the same item with a variation in target or domain, the items could be experimentally manipulated and responses compared at an aggregate level. This type of analysis involved manipulating the target of racial resentment items to be Blacks or another group has recently been conducted and reported on in a paper by Carney and Enos, but this paper is not cited in Enders 2019, and I would have hoped that the peer reviewers would have requested or required a discussion of information in that paper that relates to the principled nature of conservatives' responses to racial resentment items.

---

Instead of manipulating the target of racial resentment items, Enders 2019 tested the principled conservatism thesis with an analysis that assessed how responses to racial resentment items associated with attitudes about limited government and with preferences about federal spending on, among other things, public schools, child care, and the environment. From what I can tell, Enders 2019 assessed the extent to which participants are principled in a test in which principled conservative responses are only those responses in which responses expected from a conservative to racial resentment items match responses expected from a conservative to items measuring preferences about federal spending or match responses expected from a conservative to items measuring attitudes about limited government. As I think Enders 2019 suggests, this is a consistency across domains at the level of "conservatism" and is not a consistency across targets within the domain of the racial resentment items: "If I find that principled conservatism does not account for a majority of the variance in the racial resentment scale under these conditions, then I will have reasonably robust evidence against the principled conservatism thesis" (p. 7 of the pdf).

But I don't think that the level of "conservatism" is the correct level for assessing whether perceived racially prejudiced responses to racial resentment items reflect "adherence to (conservative) ideological principles" (p. 2 of the pdf). Enders 2019 indicates that "Critics argue that racially prejudiced responses to the items that compose the racial resentment scale are observationally equivalent to the responses that conservatives would provide" (abstract). However, at least for me, my criticism of the racial resentment items as producing unjustified inferences of racial bias is not limited to inferences about responses from self-identified conservatives: "This statement [about whether, if blacks would only try harder, they could be just as well off as whites] cannot be used to identify racial bias because a person who agreed with the statement might also agree that poor whites who try harder could be just as well off as middle-class whites" (p. 522 of this article). I don't perceive any reason why a person who supports increased federal spending on the public schools, child care, and the environment cannot also have a principled objection to special favors to reduce inequalities of outcome.

And even if "conservatism" were the correct level of analysis, I don't think that the Enders 2019 operationalizations of principled conservatism—as a preference for limited government and as a preference for decreased federal spending—are valid because, as far as I can tell, these operationalizations of principled conservatism are identical to principled libertarianism.

---

Enders 2019 asks "Why else would attitudes about racial issues be distinct from attitudes about other policy areas, if not for the looming presence and substantive impact of racial prejudice?" (p. 21 of the pdf). I think the correct response is that the principles that inform attitudes about these other policy areas are distinct from the principles that inform attitudes about issues in the racial resentment items, to the extent that these attitudes even involve principles.

I don't think that the principle that "the less government, the better" produces conservative policy preferences about federal spending on national defense or domestic law enforcement, and I don't see a reason to assign to racial prejudice an inconsistency between support for increased federal spending in these domains and agreement that "the less government, the better". And I don't perceive a reason for racial prejudice to be assigned responsibility for a supposed inconsistency between responses to the claim that "the less government, the better" and responses to the racial resentment statements that "Generations of slavery and discrimination have created conditions that make it difficult for blacks to work their way out of the lower class" or that "...if blacks would only try harder they could be just as well off as whites", because, as far as I can tell, there is no inconsistency in which a preference for limited government compels particular responses to these racial resentment items.

---

NOTES

1. Enders 2019 noted that: "More recently, DeSante (2013), utilizing an experimental research design, found that the most racially resentful whites, as opposed to less racially resentful whites, were more likely to allocate funds to offset the state budget deficit than allocated such funds to a black welfare applicant. This demonstrates a racial component of racial resentment, even accounting for principled conservatism" (p. 6). But I don't think that this indicates a demonstration of a racial component of racial resentment, because there is no indication whether the preference for allocating funds to offset the state budget deficit instead of allocating funds to welfare recipients occurred regardless of the race of the welfare recipients. My re-analysis of data for DeSante 2013 indicated that "...when comparing conditions with two White applicants and conditions with two Black applicants, there is insufficient evidence to support the inference of a difference in the effect of racial resentment on allocations to offset the state budget deficit" (pp. 5-6).

2. I sent the above comments to Adam Enders in case he wanted to comment.

3. After I sent the above comments, I saw this Robert VerBruggen article on the racial resentment measure. I don't remember seeing that article before, but it has a lot of good points and ideas.

Tagged with: