ARTICLES

Big Data/Surveillance

Scalable Annotation of Fine-Grained Categories Without Experts: Timnit Gebru, Jonathan Krause, Jia Deng, Li Fei-Fei

How Surveillance Has Always Reinforced Racism, WIRED

How Do You Vote? 50 Million Google Images Give a Clue

Why Statistics Don’t Capture The Full Extent Of The Systemic Bias In Policing, FiveThirtyEight

Bioethics

Socially Desirable Reporting and the Expression of Biological Concepts of Race: Ann Morning, Hannah Brückner, And Alondra Nelson

Biotechnology and Empire: The Global Power of Seeds and Science, Sheila Jasonoff

No One Should Edit The Genes Of Embryos To Make Babies, NIH Chief Says, Buzzfeed

The Social Impact of Natural Language Processing, Dirk Hovy and Shannon L. Spruit

Artificial Intelligence/Algorithms

Racist in the Machine, The Disturbing Implications of Algorithmic Bias, Megan Garcia

Disability, Bias, and AI: Meredith Whittaker, Meryl Alper, Cynthia L. Bennett, Sara Hendren, Liz Kaziunas, Mara Mills, Meredith Ringel Morris, Joy Rankin, Emily Rogers, Marcel Salas, Sarah Myers West

Assessing Risk, Automating Racism, Ruha Benjamin

Model Cards for Model Reporting: Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru

Ten simple rules for responsible big data research: Matthew Zook, Solon Barocas, danah boyd, Kate Crawford, Emily Keller, Seeta Peña Gangadharan, Alyssa Goodman, Rachelle Hollander, Barbara A. Koenig, Jacob Metcalf, Arvind Narayanan, Alondra Nelson, Frank Pasquale

Youth and Artificial Intelligence: Where We Stand: Hasse, Alexa Cortesi, Sandra Lombana Bermudez, Andres Gasser

Artificial Intelligence and Human Rights: Opportunities and Risks: Raso, Filippo and Hilligoss, Hannah and Krishnamurthy, Vivek and Bavitz, Christopher and Kim, Levin Yerin

A Harm-Reduction Framework for Algorithmic Fairness: Micah Altman, Alexandra Wood, Effy Vayena

Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products, Inioluwa Deborah Raji and Joy Buolamwini

Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing, Inioluwa Deborah Raji et al.

Predictive Inequity in Object Detection, Benjamin Wilson, Judy Hoffman, and Jamie Morgenstern

Does Object Recognition Work for Everyone? Terrance DeVries et al.

Deep Learning for Face Recognition: Pride or Prejudiced? Shruti Nagpal et al.

ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases, Pierre Stock and Moustapha Cisse

Mitigating unwanted biases with adversarial learning, Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell

Principled Frameworks for Evaluating Ethics in NLP Systems, Shrimai Prabhumoye, Elijah Mayfield, and Alan W. Black

Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting, Maria De-Arteaga et al.

Language (Technology) is Power: A Critical Survey of “Bias” in NLP, Su Lin Blodgett et al.

The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning, Sam Corbett-Davies and Sharad Goel

The Frontiers of Fairness in Machine Learning, Alexandra Chouldechova and Aaron Roth

A Survey on Bias and Fairness in Machine Learning, Ninareh Mehrabi et al.

Fairness in Deep Learning: A Computational Perspective, Megnan Du et al.

Racism in technology: how our tools acquire bias

Why Algorithms can be racist and sexist, Vox

NIST study evaluates effects of race, age, sex on face recognition software

Discriminating systems: Gender, race, and power in AI

West, S.M., Whittaker, M. and Crawford, K. (2019). Discriminating Systems: Gender, Race and Power in AI. AI Now Institute.

Machine Bias, Pro Publica

Healthcare Algorithm Used Across America has Dramatic Racial Biases, The Guardian

“I sold my face to Google for $5”: Why Google’s attempt to make facial recognition tech more inclusive failed, Vox

White Supremacy and Artificial Intelligence, YES! Magazine

Facial Recognition Is Accurate, if You’re a White Guy, The New York Times

A machine-learning census of America’s cities, The Economist

Social Media

Black Memes Matter: #LivingWhileBlack: Becky and Karen, Apryl Williams

Tech Industry

Technological elites, the meritocracy, and postracial myths in Silicon Valley, Dr. Safiya Noble and Dr. Sarah Roberts

Hacking the Feminist Disabled Body, Laura Forlano

Computational social science: Obstacles and opportunities: David M. J. Lazer, Alex Pentland, Duncan J. Watts, Sinan Aral, Susan Athey, Noshir Contractor, Deen Freelon, Sandra Gonzalez-Bailon, Gary King, Helen Margetts, Alondra Nelson, Matthew J. Salganik, Markus Strohmaier, Alessandro Vespignani, Claudia Wagner

Data Science as Political Action: Grounding Data Science in a Politics of Justice, Ben Green

Mapping for accessibility: A case study of ethics in data science for social good, Anissa Tanweer et al.

Equal Employment Opportunity Commission says tech industry is underutilizing diverse talent pool, TechCrunch

The future of work in Black America, McKinsey

Big tech was allowed to spread misinformation unchecked. Will Biden hold them accountable?

Why Is Big Tech Policing Speech? Because the Government Isn’t

This Company Wants to Replace Therapy With Wearable Tech

How to make racist AI without really trying

MULTIMEDIA

Big Data/Surveillance

White Surveillance and Black Digital Publics

Surveillance and Race Online | Simone Browne at MozFest

Surveillance in an Era of Pandemic and Protest

Safiya U. Noble and Tristan Harris | TIME100 Talks

PLENARY – Social, Cultural & Ethical Dimensions of “Big Data”

Policing Without the Police: Race, Technology and the New Jim Code

Bioethics

Genetic Testing Is Recreating Bonds Broken by Slavery

Alondra Nelson: The Need For a New Bioethics

Artificial Intelligence/Algorithms

AI, Ain’t I A Woman – Joy Buolamwini

Gender Shades: How well do IBM, Microsoft, and Face++ AI services guess the gender of a face?

Coded Bias Documentary

Fighting the “Coded Gaze”: How we make technology benefit all

Lafayette Lens: Exploring Artificial Intelligence, PBS WLVT Specials

Voicing Erasure – A Spoken Word Piece Exploring Bias in Voice Recognition Technology

Search Engine Breakdown | NOVA | PBS

Social Media

Desmond, Patton (2016, November). Community Violence and Social Media [Video]. Youtube

Tech Industry

Why tech made racial injustice worse, and how to fix it

PODCASTS

Big Data/Surveillance

Defunding The Police Could Lead To More Surveillance, WNYC

Artificial Intelligence/Algorithms

Bias in Commercial Search Engines: A Conversation With Safiya Umoja Noble, Out Of The Echo Chamber

Bias Exists in Our Technology, The Edge with Michelle Bookoff-Bajdek

How algorithms create a ‘digital underclass’, CBC

Why AI Is A Growing Part Of The Criminal Justice System, NPR

Breaking the Black Box, The Rework Podcast

Race, Technology and Abolition – A Conversation with Ruha Benjamin, Cite Black Women Podcast

Tech Industry

‘It’s on us to dismantle racism.’ 10 steps tech and business leaders can take toward equity, GeekWire

Reimagining Science and Technology, Princeton AAS Podcast w/ Eddie Glaude

Ethics & Race in Tech, City Arts & Lectures

TED TALKS

Artificial Intelligence/Algorithms

How I’m fighting bias in algorithms, Joy Buolamwini

Social Media

Frey, William (2017, November). Can a Tweet Lead to Violence? [Video]. Ted Conferences.

TED. (2017, May). They are Children: How Posts on Social Media Lead to Gang Violence | Desmond Patton. [Youtube].

Tech Industry

From park bench to lab bench – What kind of future are we designing? Ruha Benjamin

BOOKS

Big Data/Surveillance

Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, Cathy O’Neil

Dark Matters: On the Surveillance of Blackness, Simone Browne

Bioethics

Genetics and the Unsettled Past: The Collision of DNA, Race, and History, Alondra Nelson

The Social Life of DNA: Race, Reparations, and Reconciliation After the Genome, Alondra Nelson

Artificial Intelligence/Algorithms

Algorithms of Oppression, Dr. Safiya Noble

Artificial Unintelligence: How Computers Misunderstand the World, Meredith Broussard

Algorithms of Oppression, Safiya Noble

How High-Tech Tools Profile, Police, and Punish the Poor, Virginia Eubanks

Captivating Technology, Ruha Benjamin

The Ethical Algorithm, Michael Kearns and Aaron Roth

Fairness and Machine Learning textbook, Solon Barocas, Moritz Hardt, and Arvind Narayanan

Social Media

Bearing Bearing Witness While Black: African Americans, Smartphones, and the New Protest #Journalism, Allissa V. Richardson

Tech Industry

Race After Technology, Ruha Benjamin

Technicolor: Race, Technology, and Everyday Life, Alondra Nelson

Race, Rhetoric, and Technology, Dr. Adam J. Banks

Design with Disability, Mara Mills and Rebecca Sanchez

How Users Matter, Ben Schneiderman

Accessible America: A History of Disability and Design, Bess Williamson

How to Stop Silicon Valley from Building a New Global Underclass, Mary L. Gray and Siddharth Suri

Giving Voice: Mobile Communication, Disability, and Inequality, Meryl Alper

Appropriating Technology: Vernacular Science and Social Power. Minneapolis, Ron Eglash

Building Access: Universal Design and the Politics of Disability. Minneapolis, Aimi Hamraie

Making Computers Accessible: Disability Rights and Digital Technology, Elizabeth R. Petrick

A People’s History of Computing in the United States. Cambridge Massachusetts and London, Joy Lisi Rankin

The Intersectional Internet, Safiya Noble

Design justice: community-led practices to build the worlds we need. MIT Press, Sasha Costanza-Chock

Designs for the pluriverse: Radical interdependence, autonomy, and the making of worlds, Arturo Escobar

Value sensitive design: Shaping technology with moral imagination,  Batya Friedman and David G. Hendry

Mismatch: How Inclusion Shapes Design, Kat Holmes

Afrofuturism, Alondra Nelson

The Ethics of Invention: Technology and the Human Future, Sheila Jasonoff

White Logic, White Methods: Racism and Methodology, Tukufu Zuberi and Eduardo Bonilla-Silva

Decolonizing Methodologies, Linda Tuhiwai Smith

Indigenous Statistics, Maggie Walter and Chris Andersen

Analyzing Inequalities: An Introduction to Race, Class, Gender, and Sexuality Using the General Social Survey, Catherine E. Harnois

Just Research in Contentious Times, Michelle Fine

PEOPLE

Alondra Nelson

Mutale Nkonde

Ruha Benjamin

Safiya Noble

Sheila Jasanoff

Simone Browne

Timnit Gebru

PROGRAMS and ORGANIZATIONS

Design Justice Network

AI For the People (AFP)

Algorithmic Justice League

Allied Media Projects

Black Girls Code | Twitter

Center for Media Justice

Chupadatos

ColorCoded

Code2040 | Twitter

Data 4 Black Lives

/dev/color | Twitter

Equitable Internet Initiative

Just Data Lab

#MoreThanCode

Our Collective

The Stanford Open Policing Project

We All Count

INSTITUTES and CENTERS

AI Now Institute

Berkman Klein Center for Internet Studies at Harvard University

Center for Information Technology Policy at Princeton

Center for Critical Race and Digital Studies

Data and Society

MIT MediaLab

Program on Science, Technology, & Society

CONFERENCES

Simone Browne: Keynote at Subverting Surveillance: Strategies to End State Violence

Data for Black Lives (Ruha Benjamin, Abolition in the Age of Big Data, Code Black – Closing the Health Equity Gap)

Plenary Panel: Inequality, Labor, Health, and Ethics in AI, AI Now 2016 Public Symposium

‘People fix things. Tech doesn’t fix things,’ TechCrunch

Calculating the cost of tech-fueled discrimination, MIT News

Bias^2 – The Harvard Data Science Initiative (video)

AMC Fairness Accountability and Transparency

WORKSHOPS and COURSES

AI #Xplained – digital series explaining AI & bias

Youth and Digital Citizenship+ (Plus)

“Drag vs. AI” Workshop

Advancing racial literacy in tech, Data & Society Project

Tutorial (2020): Fairness, Accountability, Transparency, and Ethics in Computer Vision by Timnit Gebru and Emily Denton

Tutorial (2019): Bias and Fairness in Natural Language Processing by Kai-Wei Chang, Vicente Ordonez, Margaret Mitchell, and Vinodkumar Prabhakaran

TOOLKITS and GUIDES

Web-based portal by Sheila Jasanoff and colleagues for exchanges among STS scholars on issues of contemporary political and policy significance

Skin in the Game: Modulate AI and Addressing the Legal and Ethical Challenges of Voice Skin Technology

AI: Educational Activities

Facial Recognition Technologies: A Primer

AI Now’s Algorithmic Accountability Policy Toolkit

Guide to Responsible Tech: How to Get Involved & Build a Better Tech Future

Our Data Bodies

Civic Tech Field Guide

MoreThanCode Directory

Resource Guide by Ruha Benjamin

The COVID Racial Data Tracker

Indicators Relevant for Indigenous Peoples: A Resource Book

Data Ethics syllabus by Rachel Thomas

A Resource Guide on Racial Profiling Data Collection Systems

A People’s Guide to AI

Data & Society “Algorithmic Accountability” Statement

STATEMENTS and ADVOCACY

Principled Artificial Intelligence

International Indigenous Design Charter

Seven Principles of Universal Design

Ban the Scan, Amnesty International

The Court Monitoring Project

Humanitarian AI Distillation

Humanitarian AI Catalog

Algorithmic Accountability: A Primer

An Open Letter to Facebook from the Data for Black Lives Movement

Guidelines for Equitable Open Data

Principles of a Feminist Internet

Science for the People

Tech Workers Coalition Community Guide

#NoTechforICE

#Techwontbuildit Statement

OPPORTUNITIES and INTERNSHIPS

Ernest Houston Johnson Scholars Program

BlackAIR Summer Research Grant Program

POCIT – People of Color in Tech

Public Service Data Science Graduate Fellowship

JOURNALS

Catalyst: Feminism, Theory, Technoscience

Design Justice