{ women in stem }

  • What's different between female STEM workers and those in other professions?

    Many studies of women in STEM use men as a referent group to women: how do women compare to men in CS with regard to retention, attitudes, discrimination, etc? While there’s certainly benefit to using men as a referent group (and it’s far, far better than no referent group at all), there’s a threat to validity that we tend to overlook when studying women in CS: how much of what we see is an artifact of CS culture versus that of our wider society? **
    **
    Triangulation using different referent groups is a good way to get around this issue. I’ve talked before about differences between women in CS vs. other STEM fields, differences between women in CS between different cultures, and differences over time/generations. But in every one of these posts, I’ve really only looked at scientists.

    Glass et al’s “What’s So Special about STEM? A Comparison of Women’s Retention in STEM and Professional Occupations“ addresses another angle: what’s different for women in STEM vs. women in other professional occupations? After all, women are more likely than men to leave other professional occupations such as business, medicine and law [1]. And in all these fields, substantial problems remain at the top: women may make up a substantial proportion of workers, but a tiny minority of those running the show.

    The Glass et al Paper

    To make the comparison of STEM women and non-STEM women, the Glass et al paper uses longitudinal data from the National Longitudinal Survey of Youth 1979. The longitudinal approach is a strength of the paper. A weakness, however, is that the women participating are a single generational cohort who entered the workforce in the late 80s/90s: “second generation” per my previous post.

    Overall, Glass et al found that women in STEM jobs had more in common with women in non-STEM professional jobs – and that “few differences in job characteristics emerge” overall. This is a rather important finding – it means that if we work carefully, we can often generalize findings about women in the general workforce to women in the STEM workforce.

    I say “carefully” since there were a few differences that they found. Here’s what’s unique to STEM women:

    1. Women who are married to fellow STEM workers are nearly 100% more likely to stay in their STEM jobs than women married to non-STEM workers.2. A higher education does not increase a STEM woman’s likelihood of staying in a STEM career. In other occupations, such as medicine or law, the more advanced degrees a woman has, the more likely she’ll stay in the field. Glass et al attribute to this to the type of work done by those with MSc/PhDs: the more education you need to do the job, the more likely it’ll be isolating and in a “noxious” work environment for women.
    2. Unlike non-STEM women who leave their jobs to stay at home, when STEM women leave their jobs, they overwhelmingly do so to fill non-STEM jobs, rather than to stay at home permanently. Switching to management explains almost a quarter of these job departures.Those three differences aside, everything they looked at turned out to be the same for both STEM women and non-STEM women.

    Similarities between female STEM and non-STEM workers

    For both women in STEM jobs and women in professional non-STEM jobs, the following things are positively correlated with the retention of women in the workplace: Higher pay, job commitment, higher reported job satisfaction, longer time working in that career, and the presence of parental leave.

    Sociologists have documented the “Work-Family Narrative“ – the cultural narrative that women leave (or struggle with) their jobs because they can’t balance work and family. They’ve similarly documented that the majority of workplace interventions to improve the status of women focus on this narrative.

    Yet, what Glass et al found is that primary propellant of women out of the workforce – both STEM and non-STEM – is not childcare. Nor is it lack of confidence or lack of training – or lack of “leaning in”.

    The primary propellants are dissatisfaction with pay and promotion prospects. There’s a ton of sociology papers out there finding similar results. Childcare might be the catalyst for acting on that dissatisfaction, but it’s not the underlying cause.

    This dissatisfaction is linked to a number of sources of inequality, such as being left out of the “boys networks”, subconscious biases against women, open prejudice about the competence of women, and sexual harassment. Correspondence studies of women in STEM and other professional domains have consistently found that women are less likely to be thought worth of a promotion as an equally qualified man, less worthy of a higher salary, and less likable overall. And there’s evidence that men in our society are promoted based on potential – while women are promoted based on past accomplishments. This sort of unintentional, de facto discrimination is not unique to STEM.

    The Work-Family Narrative as a Social Defense

    The paper I linked to about the “Work-Family Narrative” – by Padravic and Ely – presents a rather compelling argument that the reason that people focus on this narrative is because it is an unconscious social defense. The Work-Family Narrative gives a way of thinking about the problems facing women in the professional workplace that doesn’t involve coming to terms with discrimination and systematic problems in the workforce.

    Padravic and Ely also argue that this narrative similarly allows people to keep their cultural stereotypes in tact: women are the caregivers, men are the workers – and so women have a hard time in the workforce because they must balance their position as caregiver. I’ve noted before that our brains are wired to keep cultural stereotypes in tact.

    Discrimination is an ugly thing to talk about. I don’t blame people for shying away from it. But it needs to be tackled to change the numbers of women in the workforce – whether it be STEM or other fields. And it’s important to compare STEM to the rest of society – we need to know what’s a STEM problem and what’s even more systematic.

  • Computer Science as a Lake

    |

    Imagine your CS department is a lake.
    The fauna of your lake are primarily fish and frogs. Normal lakes in your biome tend to have a food chain where about half of the predators are frogs and the other half are fish.

    Back in the 80s, the predators in your lake’s ecosystem used to be 40% frogs. But then the frogs started dying, or leaving, or not hatching, or whatever else caused their population to plummet. Now you’re at 25% frogs. And even though it looks like the fish are doing fantastically, there’s less of them than there should be.

    Somebody noticed that the nearly all the fish you see these days are either the white-coloured fish species, or the yellow-coloured fish species – the black fish and the red fish, for instance, are doing about as well as the frogs.

    But since the lake is now 75% fish, you’re really more concerned about the frogs. So, you put your efforts into releasing more frogs into the wild. You construct some frog-friendly spaces. You stop by and give them some canned flies to eat.

    The problem, though, is that the frogs are still gonna keep dying if the lake is polluted. The frogs are an indicator species – amphibians are more sensitive to environmental toxins. And that pollution is having the same effect on the red and black fish species, if you were paying more attention to them. The two fish species that are less affected happen to have some adaptation that is protecting them.

    If you start to remove the pollution from the lake it helps both the fish and the frogs. Sure, it has a larger impact on the frogs, but it also helps the fish. Some species and subspecies of fish were also getting disproportionately hurt by the environmental toxins too, and it’s good for them.

    If you want to fix the ecosystem, you have to fix the ecosystem for all the species involved. A culture polluted with the stereotype of computer scientists being asocial nerds in basements hurts the whole environment. It pushes women and other minorities away from going into the field, thinking it’s not where they can belong.

    For real change to happen in CS, we need to move past band-aids like Women in CS clubs and mentorship programmes for African-Americans. These initiatives have a role to play in the solution, but they can’t do it alone: We need to get rid of the pollution. Let’s work on cleaning up the lake for our whole ecosystem: it’s not about the frogs, it’s about the lake.

    ### How Do We Clean Up The Lake?

    I’m doing my PhD on diversity in CS. So far in my research, I have come to a hypothesis about diversity initiatives.

    Here’s my assertion: _A women in CS initiative is more likely to be successful in the long-term if that _particular_ initiative also helps other minorities (e.g. aboriginals, Blacks, Hispanics, people with disabilities, first-generation university students)._

    And by “particular initiative” I don’t mean “we started a mentorship programme for women in CS, somebody could make a mentorship programme for students with disabilities in CS” – I mean “we started a mentorship programme that all students can participate in”.

    Why is this important?

    First off, well-intentioned diversity initiatives can sadly be counterproductive:

    By calling out women for extra help, it reinforces that they are different, which reinforces their otherness. It can also trigger stereotype threat. Overtly feminine role models hurt girls’ interest in science – these women are seen as being unrealistic, and are not mentally categorized as scientists When teaching/recruiting, women speaking about CS are more likely to say the field is “hard” – and perceived difficulty pushes prospective students away from CS Diversity programmes cause people to take discrimination cases less seriously
    These types of initiatives are also prone to survivorship bias
    The empirical research we have on hand about what has long-term benefits shows us that the tricks that help women help everybody – and unintuitively, many of these are very small changes to make!
    Using assignments in first-year CS that demonstrate how CS contributes to society
    Value-affirming exercises to decrease stereotype threat Mentorship programmes for all students
    Exposure to non-traditional but non-counterstereotypic role models Ditching the nerd stereotype when depicting CS in media
    Shifting students from fixed mindsets to growth mindsets– for example, by talking about the struggles that great scientists have encountered and how they surpassed them – rather than focusing on their achievements Improving parental leave – having men and women share parenting more equally keeps more women in CS
    * Letting students know that it’s normal to worry you won’t fit in at first, but that it will go away with time
    Improving diversity for all underrepresented groups makes it easier for the other ones to show up – you’re removing pollution from the lake. Women are more likely to feel at home in a CS department that is multiracial – the more you pry CS away from being a white-and-Asian-boys club, the more you help all underrepresented groups join the community.

    We already know a lot about why women drop out or aren’t interested in CS. Let’s target those underlying reasons and fix them for all students, without framing them as women’s issues or ghettoizing women. It’s not about the frogs – it’s about the lake.
  • Correspondence tests: uncovering biases against women in science

    Part of the controversy surrounding affirmative action and other systems which give preferential treatment to minority groups comes from the ideal notion that people are judged on their merits – and not their gender/race/etc [6]. In such an ideal world, for instance, a female scientist would be equally likely to be hired, given tenure, or accolades as an identical male scientist.

    Science likes to bill itself as a meritocracy, in which scientists are evaluated only their work. A lot of the unease many scientists have about preferential treatment is that it goes against that ideal of meritocratic science [5]. So, it’s worth asking: is a female scientist equally likely to be hired/tenured/etc as an identical male scientist?

    Probably the best study design for probing this type of question are correspondence tests. These refer to studies where you describe either a female individual or a male individual to a group of participants – keeping everything but gender (or race, ethnicity, etc) constant – and see if participants respond differently to to the woman/man.

    Correspondence tests are generally easier to run than audit studies, where you hire actors to be identical to one another except for gender/race/etc. Both types of studies are useful for identifying discrimination against particular groups. Another approach is to pair real male and female scientists with equal on-paper qualifications and see whether they are equally likely to be given tenure. This approach, however, suffers from the problem of pairing: are that female and male scientist really identical except for on-paper qualifications?

    In this post, I’ll be describing the results of three correspondence tests looking at discrimination against women in science. These three studies are also the only such studies that I know of to have been published since the 90s. (There’s an older one from the 70s that is now a bit dated.)

    The effect of gender on tenurability

    Published in 1999, Steinpreis et al [1] ran a correspondence test looking at the effect of gender on tenure. They sent out hundreds of questionnaires to academic psychologists (randomly selected from the Directory of the American Psychological Association). The paper describes two studies, one on tenurability, and one on hirability. Over a hundred questionnaires were returned on the tenurability study of the paper.

    Each questionnaire contained a CV, and participants were asked to rate the CV: would they tenure this individual? Participants were told only that this was part of a study on how CVs are reviewed for tenure decisions.

    The CV was that of a real psychologist, who had been given early tenure – a random half of the participants got a version of the CV with the name changed to “Karen Miller” – the other half of the participants got “Brian Miller”. (The questionnaire also asked if the participant recognized any of the names on the CV – such participants were removed from the analysis.)

    Each questionnaire had a hidden code on the sheet that indicated the gender and institution of the participant it was sent to – this way the researchers did not have to ask their participants for their gender (which could bias them by getting them consciously thinking about gender).

    The results? “Brian Miller” and “Karen Miller” were equally likely to be offered tenure – but participants were also four times more likely to write cautionary comments about “Karen” than “Brian”, such as “I would need to see evidence that she had gotten these grants and publications on her own” and “We would have to see her job talk”.

    A caveat of the study, however, is that this was the CV of a psychologist who had been offered early tenure – in short, this was an unambiguously competent applicant. In correspondence studies used in non-science contexts, ambiguity has been repeatedly found to play a large role: a minority applicant who is ambiguously qualified for a job (or loan) is less likely to receive the job than a majority applicant – but in the face of unambiguous qualifications, biases are muted [2].

    The effect of gender on hirability for a tenure-track position

    The Steinpreis et al paper contains another correspondence test, looking at the effect of gender on applying for tenure-track jobs. They used roughly the same approach for this as they did for the other correspondence test, also with over a hundred participants.

    Here, the CV was that of the same individual, but at an earlier stage in her career; the dates were shifted to make it seem recent. Like the other study, participants either saw the CV as that of “Karen Miller” or “Brian Miller”. Participants were asked if they would hire the applicant, and what starting salary they would suggest.

    Unlike the tenure study, significant differences were seen between the ratings of “Karen” and “Brian”. “Brian” was significantly more likely to be hired, and he was significantly more likely to be rated as having adequate research experience, along with adequate teaching experience and adequate service experience. He was offered a larger starting salary.

    Both female and male participants demonstrated these biases – there was no effect of the participant’s own gender in any part of Steinpreis et al’s two studies.

    The effect of gender on hirability for a lab manager position

    Thirteen years after the Steinpreis et al study, Moss-Racusin et al ran a correspondence study looking at the effect of gender on the hirability of a canditate for a lab manager position [3]. The candidate here is somebody with a Bachelors degree – this is a lower-position job than the tenure-track job in the Steinpres et al paper.

    Moss-Racusin et al sent job packets to 547 tenure-track/tenured faculty in biology, chemistry and physics departments at American R1 institutions, found through the websites of those departments. 127 respondents fully completed the study.

    Each job packet contained the resume and references of the applicant – who was randomly assigned either the name “Jennifer” or “John”. Unlike the Steinpres et al study which used a real scientist’s CV, this job packet was created specifically for the study. The applicant was designed to reflect what the authors described as a “slightly ambiguous competence”.

    “John”/“Jennifer” was “in the ballpark” for the position but not an obvious star [3]. They had two years of research experience and a journal publication – but a mediocre GPA and mixed references.

    Similar to the Steinpreis et al study on hirability, “John” was statistically significantly more likely to be hired than “Jennifer” and was offered a larger starting salary. He was also rated as more competent than “Jennifer”. Participants also indicated a greater inclination to mentor “John” than “Jennifer”. While the differences in the ratings between “John” and “Jennifer” were not huge, the effect sizes were all moderate to large (d = 0.60-0.75).

    And similar to the Steinpreis et al study on hirability, both female and male participants were equally likely to rate “John” above “Jennifer”.

    The effect of gender on perceived publication quality and collaboration interest

    In the two papers I’ve described above, the correspondence studies all used job application materials for the “correspondence”. Knobloch-Westerwick et al [4] took a look at gender discrimination through a different lens: by having participants rate conference abstracts whose authors were rotated as female or male.

    Participants in this study were graduate students (n=243), all of whom were in communications programmes; abstracts were all taken from the 2010 annual conference of the International Communication Association. Participants had not attended this conference.

    Unlike the Steinpreis et al and Moss-Racusin et al papers, participants evaluated multiple “correspondences” – they each saw 15 abstracts. The participants rated each article on a scale of 0-10 for how interesting, relevant, rigourous, and publishable the abstract was. Participants also rated abstracts on how much they would like to chat to the author, and potentially collaborate with them.

    Overall, they found that abstracts with male authors were rated as having statistically significantly higher scientific quality than when these abstracts were presented with female authors. Abstracts with male authors were more likely to be deemed worthy of talking to – and collaborating with – the author. The gender of the participant did not have an effect on the ratings they gave.

    Given the other studies I’ve described here, this probably isn’t surprising. What I found quite neat about the paper is they then broke it down by subfield. There’s two steps to this analysis. Before the ran the main study, they ran a preliminary study with assistant professors, which involved these participants rating whether a given abstract fell into a female-typed subfield, or into a male-typed subfield. Knobloch-Westerwick et al then rigged the abstract selection in the main study to show equal numbers of abstracts from these three categories. Female-typed subfields turned out to be communications relating to children, parenting and body image; male-typed subfields were political communication, computer-mediated communication, news, and journalism. Health communication, intercultural communication were rated as gender-neutral.

    In female-typed subfields, female authors were rated higher than male authors. In male-typed subfields, the male authors were rated higher than female authors. And in the gender-neutral areas, female and male authors were rated equally. (It should also be noted that the female-typed abstracts were rated less favourably than gender-neutral and male-typed abstracts.)

    This brings us to role congruity theory. Role congruity theory looks at gender through the social construct of gender roles – gender roles not only represent beliefs about the attributes of women and men, but also normative expectations about their behaviour [4]. What we saw in the subfield results is that people who are role-incongruous are discriminated against.

    Per the article, “Role congruity theory postulates that bias against female scientists originates in differences between a female gender role and the common expectations towards individuals in a scientist role.” [4] In short, where women go against societal gender norms, they’re viewed less favourably.

    Discussion

    From the articles here, two things emerge for whether we’ll see discrimination against women in a correspondence study: whether they’re role-congruent or role-incongruent, and the level of ambiguity in the study.

    When faced with an extraordinary tenure candidate, it doesn’t matter whether they’re role-congruent or role-incongruent. Bias is more likely when the applicant is ambiguously qualified (which is really most of the time). Often, this will mean that a female scientist needs to be more qualified to get the same job: a male scientist can get it for being “good enough” – but the woman needs to be amazing.

    The three papers together paint a fairly clear picture that subtle bias occurs against women in science – and that female academics are just as prone to bias as their male colleagues.

    While there are a number of issues with affirmative action and other preferential treatment systems for minorities (see [2]) – the notion that scientists are rated independent of gender isn’t one of them. These biases exist and add up quickly over an entire discipline – and over the course of an individual’s life.

    References:

    1. Steinpreis, R. E., Anders, K. A., & Ritzke, D. (1999). The impact of gender on the review of the curricula vitae of job applicants and tenure candidates: A national empirical study. Sex roles, _41_(7-8), 509-528.
    2. Heilman, M. E., Block, C. J., & Stathatos, P. (1997). The affirmative action stigma of incompetence: Effects of performance information ambiguity. Academy of Management Journal, _40_(3), 603-625.
    3. Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., & Handelsman, J. (2012). Science faculty’s subtle gender biases favor male students. Proceedings of the National Academy of Sciences, 109(41), 16474-16479.
    4. Knobloch-Westerwick, S., Glynn, C. J., & Huge, M. (2013). The Matilda Effect in Science Communication: An Experiment on Gender Bias in Publication Quality Perceptions and Collaboration Interest. Science Communication.
    5. van den Brink, M., & Benschop, Y. (2012). Gender practices in the construction of academic excellence: Sheep with five legs. Organization, _19_(4), 507-524.
    6. Crosby, F., & Clayton, S. (1990). Affirmative action and the issue of expectancies. Journal of Social issues, _46_(2), 61-79.
  • Why Are There More Women in CS in Other Cultures?

    The rates of female participation in CS – and STEM in general – vary wildly from culture to culture. In the US, women currently make up about 18% of undergraduate CS students [1], but over in Qatar, women make up about 70% of CS undergrads [2].

    Women in STEM are better represented in countries such as Turkey, Hungary, Portugal, and the Philippines. In these countries, women make up approximately 50% of STEM undergrads [3]. Indeed, well-developed countries like Canada, the US, and the UK have some of the lowest levels of female participation in STEM.

    So, what cultural factors lead to fewer or more women in STEM? Per the work of Barinaga, there are five factors [3]:

    1. Recently developed science capabilities, resulting in an unentrenched scientific community
    2. Perception of science as a low status career
    3. Class issues that overshadow gender issues
    4. Compulsory math and science education in secondary school
    5. Large social support for raising families

    New to Science

    While it’s a bit surprising that Portugal and Mexico have better levels of female participation in science despite these countries not having well established scientific scenes, the evidence is actually that they have these better levels because of the newness of their scientific communities [3]. In countries like the US and the UK, the scientific communties have entrenched cultures. So called “old boys networks” were built up before women were allowed into the labour market; science has been firmly established as a masculine occupation. Portugal, for instance, begin its scientific and technological establishments in the 20th century, when society was more open to female participation.

    It should be noted, however, that while countries like Portugal may have large numbers of women in science, few are making it to the top. Beatriz Ruivo, who studies female participation in Portugese science, has found that the
    glass ceiling there is partly due to the lack of a strong women’s movement in Portugal [3]. We see an interesting parallel in the history of computer science. In the early days of computer programming (30s-60s), most programmers and coders were women [4]. It was later when stereotypes of programmers being nerds developed – and IT companies began specifically hiring those who were like the nerds in order to make up for a labour shortage in the late 60s – that programming became highly masuclinized.

    Science As a Low-Status Occupation

    It is fairly established in the sociology literature that, across cultures, the lower the status and pay an occupation, the more likely it is that women will be found there [3]. And not only are women more socially encouraged to stay in low-status occupations, but some occupations are reinforced as having low status due to the large numbers of women – forming “occupational ghettos”.

    This was certainly the case in the early history of computer programming. Women were traditionally “computers” – those that did the hand computations, whereas men actually did the science [5]. When computers entered the mix,
    it was the men who were to decide what the computers should calculate, and women were left as the low status “coders” to carry out the low-level work [4].

    For countries with recently developed science communities, basic science is not highly connected to the production of goods and services. Science is hence seen only as an intellectual, cultural pursuit – not unlike how the humanities are regarded in the US and Canada. The humanities in North America are frequently (and unfortunately) derided as being “useless” – and have largely equal levels of women and men in modern day.

    In computer science, it has been noted that male students often select careers in CS for the money. As computer science has become known as a lucrative field, more men have been specifically drawn to the field – and driving out their female colleagues.

    A Matter of Privilege

    In India, southern Europe, and Latin America, the social hierarchy puts high class women above low class men [3]. In these countries, education is often limited to the upper classes, resulting in a very different environment in academia than in the general population.

    In North America, women from affluent communities, with parents in IT, were more likely to go into computer science themselves [6]. In short, the more privilege you have, the more likely you are to study CS – for instance, a White woman from a rich family and urban neighbourhood is more likely to have a job in STEM than than an Aboriginal man from a poor, rural family.

    For computer science, the digital divide plays in to class issues [6]. The low classes not only are less likely to receive higher education, but also less likely to be connected to modern computing. Without a connection to computers, one would expect fewer of them to study computer science.

    Compulsory Schooling – And Mindset

    Former Soviet countries have higher rates of female participation in science, and Barinaga attributes this partly to the requirement that all secondary school students take multiple science courses and mathematics [3]. As a result, girls “can’t ‘chicken out’” of science and don’t close doors on themselves before they reach university’’. The policy of teaching all science subjects, in particular, is beneficial – when students can choose one science out of a list (as is the case in many Canadian provinces), female participation in physics is reduced.

    The American approach of science being optional – and hence avoided by all but the gifted students – leads to a mentality to that you either have talent in science, or you don’t [3]. This fixed mindset approach to science has been consistently found detrimental both to individual success in science, as well as for minorities. In countries like Italy, where all sciences are mandatory, the communal mindset about science is a growth mindset: anybody can do it.

    Support For Families

    Forty percent of women who leave the workforce cite their husbands – and specifically, their husbands’ inability to pull their weight with housework and childcare – as their reason for leaving [8]. The United States was described by Barinaga’s international participants as “just a horrible place to try to raise a family and have a career’’. Without state-mandated parental leave, allowances for dads to stay home to look after children, and daycare, it is difficult for many women to manage both career and family.

    Contributing to the problem is the Protestant work ethic for men, leading men to focus only on work and leave everything else to their wives. In northern Europe, Canada, and the US, fathers spend less time looking after their families [3]. Female science participation is higher in countries where childcare is a shared responsibility: not just between father and mother, but also with the extended family, and society at large.

    This shared responsibility needs to be present in the workplace too; as one of Barinaga’s participants described: “if I missed a half-day of work [in the United States because] my kid had a temperature of 104, I was lectured on how this let down the [department]. In Israel there is 3 months paid maternity leave, day-care centers on every block, and if you don’t take off from work for your kid’s birthday party the department chairman will lecture you on how important these things are to kids and how he never missed one while his kids were little (Emphasis added).

    A Final Note

    Culture is a complex issue. None of the issues listed here can be a panacea for North American STEM. For example, even if we made CS obligatory in high school, it’s unlikely to have an effect for many racial minorities (Black/Hispanic Americans, Aboriginal Canadians, New Zealand Maori, etc), as these groups have low rates of high school completion [7]. By identifying these cross-cultural factors that promote women in STEM, we can better identify what factors (plural!) need addressing here in North America.

    References:
    [1] NCWIT By the Numbers. http://www.ncwit.org/resources/numbers
    [2] Guzdial. Women in CS in Qatar: It’s Complicated. http://computinged.wordpress.com/2010/05/03/women-in-cs-in-qatar-its-complicated/
    [3] Barinaga. “Surprises Across the Gender Divide”. Science 263, number 5152 (1994): 1486.
    [4] Ensmenger. “The Computer Boys Take Over”.
    [5] Rossiter. “Women scientists in America: Struggles and Strategies to 1940”, volume 1.
    [6] Ashcraft, Eger and Friend. “Girls in IT: The Facts”. http://www.ncwit.org/resources/girls-it-facts
    [7] Adams, Hazzan, Loftsson, and Young. “International Perspective of Women and Computer Science”. http://dl.acm.org/citation.cfm?id=611892.611897
    [8] Stone. “Opting Out? Why Women Really Quit Careers and Head Home”. University of California Press, 2007.

  • Generational differences of female scientists in academia

    In my last post, I described how the experiences of women in CS have changed historically. In this post, we saw that the academic side of computer science is a relatively recent thing. For this post, I’d like to focus some more on that aspect of the history. Like that last post, this post will be specifically focusing on North American CS (we’ve seen previously that female participation in CS is different outside the West!).

    Generational differences exist between female scientists in academia. Etzkowitz et al in a 1994 paper found differences in experiences and values between the trailblazing “First Generation” of women in a field, and the subsequent “Second Generation”. As the paper is now 20 years old, it’s not too surprising that it feels a bit out of date – what comes after the Second Generation? (Another dated thing about the paper is that CS is described as being as female-friendly as biology.)

    The Etzkowitz et al paper studied 30 academic science departments (biology, chemistry, physics, CS, and electrical engineering). They went into the study interested in the notion of critical mass – whether having enough women in a department would lead to a positive feedback cycle leading to gender equality. (Answer: it’s not that simple.) In the process of studying critical mass, they found the women who had entered the field before it was attained (First Gen) had fundamentally different experiences than the women who entered after.

    The First Generation

    The trailblazing women who entered CS – or similar disciplines – when there were no other women in their departments learned to cope with the culture by adopting the “male model” of a scientist. These women generally did not have families, and for those that did, it took a clear backseat to their scientific careers.

    In departments without other women, these trailblazers often encountered blatant sexism and harassment. This open sexism did not abate until a critical mass of women was reached and women not only had “safety in numbers” but men were more aware that this behaviour was inappropriate. Etzkowitz et al describe the critical mass as a “strong minority of at least 15%”. Note that in this statistic, they are referring to how many women are faculty and graduate students in a department – this does not include undergrads.

    These trailblazers were often uneasy about forming Women in Science type clubs, sometimes refusing to participate out of fear of stigmatization by their male colleagues. These women, having fought tooth and nail for any status and accomplishments they have, were sometimes afraid that association with women’s movements would devalue their achievements. Instead of being viewed on par with the other men, they worried they would be judged only in the “women’s track”. (There are certainly women who have gone against this – Maria Klawe would be a clear example of a First Gen computer scientist who has been promoting women in CS clubs and conferences.)

    A quote from the paper really sums up the First Gen – one senior female scientist participating in the study described her generation: “The ones who did [science] were really tough cookies. Now it’s easier to get in. At one time it wasn’t even acceptable to start. So if you started back then you were tough to begin with. I have quivering women coming through who are very smart asking can they compete with men, and can they compete on a very competitive, fierce playing field. Of course they can. They just are not taught to be competitive. They don’t expect to win. The reason why I am successful is because I never felt this way.”

    Competitiveness was a large source of tension between these women and the Second Generation. In the mind of the First Gen, women need to adapt themselves to the man’s word – and need to be competitive. Second Gen women have instead favoured trying to change the culture to allow women who meet cultural notions of femininity: making the culture more friendly and collaborative.

    The Second Generation

    Women who entered CS after critical mass was achieved had a very different experience coming into the field. Etzkowitz et al don’t provide timelines in their paper; from talking to female faculty in my department, I’d guess that this generation begins with the women who entered CS as undergraduates in the 80s.

    These women tended to have high expectations about the (First Gen) female faculty in their departments, wanting their moral support and guidance for coping in a male-dominated culture. Often, they were disappointed. The Second Gen women wanted to have it all: to be women and scientists – and the First Gen women failed as role models in this regard.

    For the Second Gen women who had First Gen women as advisors, there was tension. One Second Gen participant described: “[having a woman advisor] turned out to be somewhat of a mistake. I was under the impression that having a woman adviser would make life a bit easier… It turned out to be worse… Their motto is sink or swim… My adviser’s approach was to put it too far out of my grasp.

    First Gen women, as advisors, were extra hard on their female advisees, “to prepare them to meet the higher standards that they would be held to as women.” And as advisors, the First Gen women felt unable to help their advisees; as one participant put it, “They ask me when they should have children, can I take a part-time post-doc and then get back in? I don’t know [the answers]. I can’t help them.”

    Most of the Women in CS/Science initiatives appear to have been started by Second Gen women, partly in response to the unhelpfulness of the First Gen women in terms of advising them about work-life balance and coping with a hostile, isolating work environment. And many Second Gen women left academia to look after their families, convinced that they would not be able to do both – if an academic career required conforming to the man’s world like the First Gen did, they decided they did not want to be a part of it.

    Post-Etzkowitz et al: A Third Generation?

    As I noted already, the Etzkowitz et al paper was published 20 years ago. I took my first CS course in 2007, and for me and my cohort it was a very different experience than that of the Second Gen women. Approximately 20% of the CVS faculty at my alma mater are women, predominantly women of the Second Generation. They have families and the Focus on Women in Computer Science club was (and still is) highly visible and active. Personally, I’ve received a lot of invaluable mentorship and advice from Second Gen women.

    My generation is far removed from the overt sexism that the First Gen experienced, and we don’t appear as worried about balancing a career with family. For a lot of us, these feel like problems of the past. Occasionally I’ll hear friends comment about Women in CS events that “I feel like the women running this are trying to make up for what they didn’t have when they were our age rather than what our generation wants.” The best Women in CS events seem to be the ones that take generational differences into account.

    Growing up, girls of my generation performed equally well in science and math as boys (sometimes outperforming). For a lot of us – though hardly all – there was no expectation setting foot in a CS class for the first time that it would be unfriendly to women. My experience of undergraduate CS was that of a collaborative field. Personally, it wasn’t until graduate school that I felt I encountered gender-based barriers.

    But despite many improvements in the culture, female enrollment in CS hasn’t improved a whole lot since hitting that 15% critical mass. Despite an uptick in the mid-80s, the numbers are now down to around 18%. Clearly, critical mass isn’t enough on its own to get female participation to 50%.

    For biology, however, the numbers have been increasing – 53% of biology doctorates in the US in 2009 were given to women (Zuk & O’Rourke). (I’ve posted previously about why biology has more women than CS.) But as Zuk and O’Rourke caution: “First, demography alone has not solved the problem [of gender inequality] in the past. We frequently make presentations about gender and science to young audiences; since perhaps the early 1990s, a common response from graduate students to the concern about lack of female professors is that “their” cohort had not yet gone through the system. In other words, the students optimistically suggested, all we needed to do was wait for them to move into the academic job market in equivalent proportion to their numbers. Unfortunately, that has not occurred over the past few decades, and it is not likely to happen now. Although the landmark majority of female biology Ph.D.’s was reached only recently, the number of women in undergraduate and graduate programs in the life sciences has been increasing for the past several decades.”

    Subtle, social-psychological barriers still remain in the scientific community (see: Moss-Racusin et alSteinpreis et al, Knobloch-Westerwick et al, Heilman et al). It’s unlikely that biology or any other science will get to having 50% female faculty until these barriers are gone. In a previous post I talked about how the key to changing stereotypes about women is to get people to see women as heterogeneous – generational differences are just one way that women in CS are heterogeneous.

  • Why are there more women in some STEM fields than in others?

    Why is it that there are more women in biology than there are in computer science in North America? Women in the biomedical fields are now earning more than 50% of undergraduate degrees in the US [1].

    Biology, like computer science, was once stereotyped as masculine. Medicine continues to be stereotyped as masculine, especially fields such as surgery. Why has biology attracted so many more women than computer science?

    To answer this question, I’ll be synthesizing the findings of Cheryan’s “Understanding the Paradox in Math-Related Fields: Why Do Some Gender Gaps Remain While Others Do Not?” [2], Cohoon’s “Women in CS and Biology” [3], and Carter’s “Why students with an apparent aptitude for computer science don’t choose to major in computer science” [4].

    Between these three papers, four themes emerge for why women choose one STEM field over another:

    1. Exposure to the field
    2. Expected value of the major
    3. Lack of prejudice in the scientific culture
    4. Prospects of raising a family in that scientific culture

    Exposure

    The ultimate finding of Carter’s “Why students with an apparent aptitude for computer science don’t choose to major in computer science” is that students simply didn’t know what CS is, or had misconceptions of the field [4].

    Most undergraduates in North America never have to take any CS, and never saw any in high school. The big boon to biology enrollment is that biology is a course that pretty much everybody has to take in k-12. As we saw in comparing female representation in STEM between cultures, compulsory schooling plays a role in getting women into STEM.

    But high school science isn’t the only way to expose young men and women to science. Women are better represented in astronomy and the earth sciences than they are in computer science, and neither of those fields are well-represented in k-12. Exposure can come from museums; television programmes and other documentaries; popular science books, magazines and blogs; public lectures; and science camps. Computer science does comparatively little public outreach.

    Early exposure is also important. In Carter’s study, numerous students – disproportionately female – would only discover CS near the end of their degrees – too late to major or minor in the field. Multiple points of entry to CS majors, and multidisciplinary programmes, are hence recommended to increase female participation in CS [5].

    Exposure at an early age also is useful. Girls who are given hands-on exposure to computers at an early age are more likely to wind up in CS [6]. Girls whose mothers are confident around computers are more likely to be confident around computers [6]. Girls who come from academic families are more likely to wind up in CS [6].

    Finally, exposure is important for overcoming stereotypes about CS. Cheryan compared giving women descriptions of computer science as being a nerdy discipline – versus descriptions of computer science “not being like that” [7]. Women were statistically significantly more interested in computer science when given a non-stereotypic description of computer science.

    Expected Value

    Expectancy-value theory is one of the numerous theories out there used to model how undergraduates choose their majors. In a nutshell: undergrads are more likely to choose majors that they expect to align with their values and beliefs.

    Cheryan argues that women are choosing biology over CS because they see in as more fulfilling: there is the promise of intellectual challenge combined with the promise of benefiting society [2].

    But it’s not that simple – not all women have the same values, beliefs, and backgrounds. Margolis and Fisher found that women from racial minorities and international students who came to the US to study were motivated by the financial stability promised by a CS career [8]. And biology careers tend to appear more stable to undergraduates: biology faculty almost never turn over, whereas CS faculty will leave academia to go to industry. Maintaining a stable faculty in a department is good for gender representation [3].

    Actual Openness

    Another finding of Cohoon’s is that biology professors have better opinions of female students than CS professors do [3]. Biology professors also spend more time mentoring students than do CS professors [3].

    Biology continues to have issues with prejudice. Women are less likely to be hired than equally competent men [9], will be offered lower salaries [9], and their work is viewed less favourably [10]. But the evidence indicates that biology is still more open to women to female scientists than CS is. And as we saw in the cross-cultural comparison, an unentrenched scientific community is conducive for minorities to enter the community.

    Prospects of Raising a Family

    There’s little evidence that women consciously choose majors based on how friendly the major is with respect to raising a future family. But in a society where women are socialized from a young age to expect to be the primary caretakers of their future offspring, it is not surprising that women are deterred from fields that seem unfriendly to raising a future family.

    The process is more of an accumulation of red flags: The long hours in CS are only one red flag. As Carter found, CS is considered a volatile field without job security [4]. A lack of role models that are actively parenting adds to the notion of family-unfriendliness: they fail to provide evidence that women can have families and be in computer science. The relatability of role models is important: it is counterproductive in this regard to see female professors who have no families and are focused only on science [1].

    The stereotypes about computer scientists are another red flag: computer scientists are seen as unattractive, singularly focused on technology, and asocial. Male computer scientists hence are unattractive as potential partners – and there’s plenty of evidence that humans are subconsciously drawn towards careers that are more conducive to meeting potential partners [11].

    The sad evidence is that a fraction of white women are deterred from STEM because they do not want to be seen as unfeminine or intimidating to future partners [11]. Women who do go into STEM are more likely than non-STEM women to believe that men are unintimidated by their career choice, and they are more likely to have fathers, brothers and boyfriends that support this belief [11].

    Overall, this lines up with what we saw in the cross-cultural comparison: women are more likely to go into STEM in cultures where raising a family is viewed as a communal responsibility.

    References:
    [1] Ashcraft, Eger and Friend. “Girls in IT: The Facts”. http://www.ncwit.org/resources/girls-it-facts
    [2] Cheryan. “Understanding the Paradox in Math-Related Fields: Why Do Some Gender Gaps Remain While Others Do Not?” 10.1007/s11199-011-0060-z, Sex Roles 66 (3 2012): 184–190. issn: 0360-0025. http://dx.doi.org/10.1007/s11199-011-0060-z.
    [3] Cohoon. “Women in CS and biology.” SIGCSE Bull. (New York, NY, USA) 34, number 1 (February 2002): 82–86. issn: 0097-8418. doi:10.1145/563517.563370. http://doi.acm.org/10.1145/563517.563370.
    [4] Carter. “Why students with an apparent aptitude for computer science don’t choose to major in computer science.” SIGCSE Bull. (New York, NY, USA) 38, number 1 (March 2006): 27–31. issn: 0097-8418. doi:10.1145/1124706.1121352. http://doi.acm.org/10.1145/1124706.1121352.
    [5] Cohoon. “Recruiting and retaining women in undergraduate computing majors.” SIGCSE Bull. (New York, NY, USA) 34, number 2 (June 2002): 48–52. issn: 0097-8418. doi:10.1145/543812.543829. http://doi.acm.org/10.1145/543812.543829.
    [7] Cheryan, Plaut and Handron. “The Stereotypical Computer Scientist: Gendered Media Representations as a Barrier to Inclusion for Women.” Sex roles (2013): 1–14.
    [8] Margolis and Fisher. Unlocking the clubhouse: Women in computing. MIT press, 2003.
    [9] Moss-Racusin, Dovidio, Brescoll, Graham and Handelsman. “Science
    faculty’s subtle gender biases favor male students.” Proceedings of the National Academy of Sciences 109, number 41 (2012): 16474–16479. doi:10.1073/pnas.1211286109. eprint: http://www.pnas.org/content/
    109/41/16474.full.pdf+html. http://www.pnas.org/content/109/41/16474.abstract.
    [10] Knobloch-Westerwick, Glynn and Huge. “The Matilda Effect in Science Communication: An Experiment on Gender Bias in Publication Quality Perceptions and Collaboration Interest.” Science Communication (2013).
    [11] Hawley. “Perceptions of male models of femininity related to career choice.” Journal of Counseling Psychology 19, number 4 (1972): 308.

  • Women in CS: A Historical Perspective

    |

    Female participation in computer science in North America has varied a great deal over time. Women were the original “computers” before the days of computing machines – and then were hired as the low-status “coders” to run those machines. Over time, coding/programming was more widely recognized to be difficult – and it was shifted from being “women’s work” to “men’s work”.

    When computer science emerged as an academic discipline in the 70s and 80s, women were well-represented (30-40%). As enrollments in CS programmes exceeded what departments could manage, they tightly restricted the paths one could take into a CS major – unintentionally pushing non-traditional students like women out of the field. A big lesson from that period is that non-traditional students come from non-traditional paths – many of these women were starting in majors such as psychology or linguistics, or transferring from community colleges, and hence did not follow the “standard” path into computing careers.

    Women as Computers: from the 1820s to the 1910s

    Our view of women in computer science begins with the history of women in academia. The 19th century marked the rise of women’s colleges in the United States [1] as policies barring women from education were loosened. Women campaining for access to higher education did so on an argument that it would “produce better wives and mothers’’ for Americans [1]. For women of privilege in American society, a basic understanding of science and math in turn became “necessary for motherhood.’’

    It should be emphasized that this was a trend for white women of privilege – most women who studied science in the 19th century were the daughters of scientists and other intellectuals.

    For the women scientists that emerged from these colleges, there were few job opportunities. Teaching at the women’s colleges was the main possibility [1]. Working as a “computer’’ was another possibility. Women pursuing PhDs or faculty positions were expected to be single or “in no danger of marrying’’; marriage meant resigning from the programme or their job [1]. As time progressed and society progressed, women in these positions began to feel they could be both wives and scientists – when they resisted the norm of resigning upon marriage, they were met with opposition: they were threatened and usually fired [1].

    1870-1900 marked an era of slow infiltration: women began entering doctorate programmes at traditional (male) institutions in countries such as the US and Germany [1]. Most universities were hesitant to allow the women into the PhD programmes, but would instead admit them as “special students’’ and give them additional bachelor’s degrees at the end of their studies. While by 1910 women were starting a presence in science at traditional institutions, there was no equality in employment, and jobs remained deeply sex typed.

    With the slow rise of women in science came the corresponding rise of “women’s work‘’ in science. So-called women’s jobs typically were “assistants’’ to scientists, or working as computers for larger groups. These women were systematically ignored in the larger scientific community, left out of lists of scientists, conferences, and histories [1]. Indeed, from 1911 onward there were overt efforts to reduce the numbers of women in science, even with their roles undervalued [1].

    It should be emphasized that computation was considered “women’s work’’ in the 19th and early 20th century. Looking at the history of the biological and social sciences in this time, quantitative methods were considered “low’’ enough that women could do them – but qualitative methods required “the intellect of a man’’ [2]. The reversal of the status (and gendering) of quantitative vs. qualitative work in the social and biological sciences happened well into the 20th century (sometime between the 30s-50s) [2].

    The expansion of “Women’s Work”: 1920s to 40s

    By the 1920s, women in academia were still largely kept to the women’s colleges [1]. The colleges, however, allowed a place to organize campaigns for change. Women began fighting for access to education using evidence from psychology and anthropology that women too were capable of science and math [1].

    The 20s and 30s marked an expansion of government-employed scientists, who were assigned “women’s work’’ (assistants, computers, etc) and were grossly underpaid and undervalued [1]. The World Wars increased the scope of “women’s work’’ as labour shortages necessitated it. By 1938, the numbers of women working in scientific and technological roles for the US government had dramatically increased – despite overtly hostile job conditions [1].

    The World Wars also marked the birth of digital computing. Computing machines were devised in the UK for cryptographic purposes. These machines, and the hand computations done in the wars throughout the world, were commonly performed by women. ENIAC, arguably the first real computer, was announced in 1946. The plan to run the ENIAC was such: a male scientist would be the planner, deciding what was to be computed – and a low-rank, female “coder’’ would do the actual machine coding [3]. These “Eniac Girls” and the other female machine operators of their time have been frequently forgotten in the history of science; at the time they were not seen as important and it is really only in recent decades that their work has been recognized.

    Grace Hopper, who worked on the ENIAC, later described programming as “it’s just like planning a dinner. You have to plan ahead and schedule everything so it’s ready when you need it. Programming requires patience and the ability to handle detail. Women are ‘naturals’ at computer programming.” [4]

    The Continual IT Labour Crisis: the 50s through 70s

    What was not anticipated was that the coding would actually be difficult [3]. As computers began being used for commercial purposes in the 50s, a labour shortage emerged. The status of being a programmer rose; as the difficulty of its task was recognized, the assumption that it should be done by men took over. Computing in the 50s and 60s can be characterized by a large, shotgun approach to recruiting “good programmers’’ with little knowledge of what a “good programmer’’ was [3]. Programming began to be seen as a “dark art’’, and programmers began to be seen as asocial [3].

    As computer programming rose in prominence, it became masculinized. Women were still allowed entry to the jobs due to the desperation for quality labour. However, lazy hiring practices that focused on spurious aptitude and personality tests hurt female participation in the industry [3]. Inconsistent professionalization efforts also hurt female participation by restricting what it mean to be a programmer [3]. The men running the show simply did not consider how their hiring practices discriminated against women.

    Computer programming stayed largely independent from academic computer science. In the 50s and 60s, computer science was conducted through other departments, typically as a hobby or side-project [3]. The first CS classes were offered in the 60s, as the discipline struggled to assert itself as a discipline of its own [3].

    By 1969, MIT had opened an undergraduate programme in CS – and the 70s marked the beginning of bachelor’s degrees in CS offered typically through electrical engineering or mathematics [3]. It would not be until the 80s, though, that CS programmes moved into their own departments.

    From the start, computer science seemed like a “grab bag of various topics’’ related to computers [3] and attempts to define the discipline were inconsistent. Was computer science about information? Analysis? Algorithms? No consistent narrative was established, though algorithms eventually became dominant. This inconsistent narrative continues to be a difficulty in public outreach for computer science.

    Academic CS: cyclical enrollments from the 80s to present

    The opening of CS departments in the 80s provided a fertile ground for women. Women were increasingly studying the sciences in the 80s [5] – and academic CS had a relatively unentrenched culture. Women of the time flocked to CS in what is now seen as a golden age of female participation in the field. 37% of American CS degrees in 1985 were awarded to women [5]. In my next post, I’ll talk about how the experiences of these were different than the previous generations of women in CS. (Edit: the generational differences post is here)

    The early 80s were also a boom-time for student enrollment in CS [6], which was linked to the rise of the personal computer. Personal computers had not been available until the late 70s; prior to then, computer science was hence only pertinent to academia, military, and business.

    However, by the late-80s, enrollments began dropping – and disproportionately so for women [7]. The decline was “largely the result of explicit steps taken by academic institutions to reduce computer science enrollments when it became impossible to hire sufficient faculty to meet the demand.’’ [7] Steps included adding new GPA requirements for entering CS programmes, requiring more prerequisites, and retooling first-year CS as a weeder course. These actions disproportionately hurt not only female participation in the field, but participation of racial minorities as well. These “non-traditional’’ students had disproportionately come to CS via non-traditional paths (such as via psychology or linguistics) and disproportionately lacked the prerequisites as a result. The retooling of first-year CS as a weeder course also resulted in a competitive atmosphere that deterred many women.

    The personal computer also led to further masculinization of computing [8]. Five reasons thought to have reduced female participation in the 90s were: the rise of video games, subsequent changes in stereotypes/perceptions of computing, the encouragement of boys to go into the field and not girls, an inhospitable social environment for women, and a lack of female role models [8].

    The birth of the World Wide Web in the 90s and its spread beyond academic/military use led to a second bubble in CS enrolments. The hype of the dot-com bubble and the promise that a CS degree would lead to easy prosperity
    led to a resurgence in enrollments in the late 90s. The dot-com bubble burst in 2000 – and enrollment with it a few years later [6]. Indeed, the NASDAQ has been found to be a predictor of CS enrolment at Stanford [9]. The perception of CS jobs as being volatile has also been implicated as a reason why women are deterred from CS careers [10].

    The boom-time in the late 90s and early 00s led to a return of strict enrolment controls and a spree of hiring more CS faculty [6]. These boom-times also reduced the amount of service teaching: with CS programmes overburdened, CS departments had few resources and little motivation to teach non-CS students. At some universities, departments such as physics or math began offering their own CS classes to their own students – leading to CS becoming increasingly isolated from the other sciences – and from non-traditional students.

    When the bubble burst, the “get-rich-quicker’’s disappeared – and CS departments were left trying to get more “bums in seats’’. Enrolments did not recover again until the mid 00s – and have been on the rise since [6]. Overall, a pattern of cyclical enrolment emerges. Boom times lead to more students, then more enrolment controls; bust times lead to more outreach. Bust times also result in disproportionately many women leaving the field, or not going in at all [6] – indeed, as of 2011, 18% of CS students are female [5].

    Enrollments in CS are now skyrocketing again: the 2012 Taulbee Survey found that CS enrollments have risen for the fifth straight year [10]. Facing packed classrooms and overburdened teaching resources, some CS departments
    are once again considering cutting their interdisciplinary programmes and service courses. Hopefully this time around we’ll have learnt from the past.

    References

    1. Rossiter, Margaret W. Women scientists in America: Struggles and strategies to 1940. JHU Press, 1982.
    2. Luker, Kristin. Salsa dancing into the social sciences: Research in an age of info-glut. Harvard University Press, 2008.
    3. Ensmenger, Nathan. The computer boys take over: Computers, programmers, and the politics of technical expertise. MIT Press, 2010.
    4. Normalizing Female Computer Programmers in the ’60s
    5. Ashcraft, Catherine, Elizabeth Eger, and Michelle Friend. Girls in IT: The Facts, 2012.
    6. Slonim, Jacob, Sam Scully, and Michael McAllister. Outlook on Enrolments in Computer Science in Canadian Universities. Information / Communications Technology Council, 2008.7. Roberts, Eric S, Marina Kassianidou, and Lilly Irani. “Encouraging women in computer science.” ACM SIGCSE Bulletin 34, number 2 (2002): 84–88.
    7. Camp, Tracy, and D Gurer. “Women in computer science: where have we been and where are we going?” In Technology and Society, 1999. Women and Technology: Historical, Societal, and Professional Perspectives. Proceedings. 1999 International Symposium on, 242–244. IEEE, 1999.
    8. McGettrick, Andrew, Eric Roberts, Daniel D. Garcia, and Chris Stevenson. “Rediscovering the passion, beauty, joy and awe: making computing fun again.” In Proceedings of the 39th SIGCSE technical symposium on Computer science education, 217–218. SIGCSE ’08. Portland, OR, USA: ACM, 2008. isbn: 978-1-59593-799-5. doi:10.1145/1352135.1352213. http://doi.acm.org/10.1145/1352135.1352213.
    9. Cohoon, J. McGrath. “Women in CS and biology.” SIGCSE Bull. (New York, NY, USA) 34, number 1 (February 2002): 82–86. issn: 0097-8418. doi:10.1145/563517.563370. http://doi.acm.org/10.1145/563517.563370.
    10. McGettrick, Andrew, and Yan Timanovsky. “Digest of ACM educational activities.” ACM Inroads 3, number 2 (2012): 24–27.