ARTICLES
Big Data/Surveillance
Scalable Annotation of Fine-Grained Categories Without Experts: Timnit Gebru, Jonathan Krause, Jia Deng, Li Fei-Fei
How Surveillance Has Always Reinforced Racism, WIRED
How Do You Vote? 50 Million Google Images Give a Clue
Why Statistics Don’t Capture The Full Extent Of The Systemic Bias In Policing, FiveThirtyEight
Bioethics
Socially Desirable Reporting and the Expression of Biological Concepts of Race: Ann Morning, Hannah Brückner, And Alondra Nelson
Biotechnology and Empire: The Global Power of Seeds and Science, Sheila Jasonoff
No One Should Edit The Genes Of Embryos To Make Babies, NIH Chief Says, Buzzfeed
The Social Impact of Natural Language Processing, Dirk Hovy and Shannon L. Spruit
Artificial Intelligence/Algorithms
Racist in the Machine, The Disturbing Implications of Algorithmic Bias, Megan Garcia
Disability, Bias, and AI: Meredith Whittaker, Meryl Alper, Cynthia L. Bennett, Sara Hendren, Liz Kaziunas, Mara Mills, Meredith Ringel Morris, Joy Rankin, Emily Rogers, Marcel Salas, Sarah Myers West
Assessing Risk, Automating Racism, Ruha Benjamin
Model Cards for Model Reporting: Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru
Ten simple rules for responsible big data research: Matthew Zook, Solon Barocas, danah boyd, Kate Crawford, Emily Keller, Seeta Peña Gangadharan, Alyssa Goodman, Rachelle Hollander, Barbara A. Koenig, Jacob Metcalf, Arvind Narayanan, Alondra Nelson, Frank Pasquale
Youth and Artificial Intelligence: Where We Stand: Hasse, Alexa Cortesi, Sandra Lombana Bermudez, Andres Gasser
Artificial Intelligence and Human Rights: Opportunities and Risks: Raso, Filippo and Hilligoss, Hannah and Krishnamurthy, Vivek and Bavitz, Christopher and Kim, Levin Yerin
A Harm-Reduction Framework for Algorithmic Fairness: Micah Altman, Alexandra Wood, Effy Vayena
Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products, Inioluwa Deborah Raji and Joy Buolamwini
Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing, Inioluwa Deborah Raji et al.
Predictive Inequity in Object Detection, Benjamin Wilson, Judy Hoffman, and Jamie Morgenstern
Does Object Recognition Work for Everyone? Terrance DeVries et al.
Deep Learning for Face Recognition: Pride or Prejudiced? Shruti Nagpal et al.
ConvNets and ImageNet Beyond Accuracy: Understanding Mistakes and Uncovering Biases, Pierre Stock and Moustapha Cisse
Mitigating unwanted biases with adversarial learning, Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell
Principled Frameworks for Evaluating Ethics in NLP Systems, Shrimai Prabhumoye, Elijah Mayfield, and Alan W. Black
Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting, Maria De-Arteaga et al.
Language (Technology) is Power: A Critical Survey of “Bias” in NLP, Su Lin Blodgett et al.
The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning, Sam Corbett-Davies and Sharad Goel
The Frontiers of Fairness in Machine Learning, Alexandra Chouldechova and Aaron Roth
A Survey on Bias and Fairness in Machine Learning, Ninareh Mehrabi et al.
Fairness in Deep Learning: A Computational Perspective, Megnan Du et al.
Racism in technology: how our tools acquire bias
Why Algorithms can be racist and sexist, Vox
NIST study evaluates effects of race, age, sex on face recognition software
Discriminating systems: Gender, race, and power in AI
West, S.M., Whittaker, M. and Crawford, K. (2019). Discriminating Systems: Gender, Race and Power in AI. AI Now Institute.
Machine Bias, Pro Publica
Healthcare Algorithm Used Across America has Dramatic Racial Biases, The Guardian
“I sold my face to Google for $5”: Why Google’s attempt to make facial recognition tech more inclusive failed, Vox
White Supremacy and Artificial Intelligence, YES! Magazine
Facial Recognition Is Accurate, if You’re a White Guy, The New York Times
A machine-learning census of America’s cities, The Economist
Social Media
Black Memes Matter: #LivingWhileBlack: Becky and Karen, Apryl Williams
Tech Industry
Technological elites, the meritocracy, and postracial myths in Silicon Valley, Dr. Safiya Noble and Dr. Sarah Roberts
Hacking the Feminist Disabled Body, Laura Forlano
Computational social science: Obstacles and opportunities: David M. J. Lazer, Alex Pentland, Duncan J. Watts, Sinan Aral, Susan Athey, Noshir Contractor, Deen Freelon, Sandra Gonzalez-Bailon, Gary King, Helen Margetts, Alondra Nelson, Matthew J. Salganik, Markus Strohmaier, Alessandro Vespignani, Claudia Wagner
Data Science as Political Action: Grounding Data Science in a Politics of Justice, Ben Green
Mapping for accessibility: A case study of ethics in data science for social good, Anissa Tanweer et al.
Equal Employment Opportunity Commission says tech industry is underutilizing diverse talent pool, TechCrunch
The future of work in Black America, McKinsey
Big tech was allowed to spread misinformation unchecked. Will Biden hold them accountable?
Why Is Big Tech Policing Speech? Because the Government Isn’t
This Company Wants to Replace Therapy With Wearable Tech
How to make racist AI without really trying
MULTIMEDIA
White Surveillance and Black Digital Publics
Surveillance and Race Online | Simone Browne at MozFest
Surveillance in an Era of Pandemic and Protest
Safiya U. Noble and Tristan Harris | TIME100 Talks
PLENARY – Social, Cultural & Ethical Dimensions of “Big Data”
Policing Without the Police: Race, Technology and the New Jim Code
Genetic Testing Is Recreating Bonds Broken by Slavery
Alondra Nelson: The Need For a New Bioethics
AI, Ain’t I A Woman – Joy Buolamwini
Gender Shades: How well do IBM, Microsoft, and Face++ AI services guess the gender of a face?
Coded Bias Documentary
Fighting the “Coded Gaze”: How we make technology benefit all
Lafayette Lens: Exploring Artificial Intelligence, PBS WLVT Specials
Voicing Erasure – A Spoken Word Piece Exploring Bias in Voice Recognition Technology
Search Engine Breakdown | NOVA | PBS
Desmond, Patton (2016, November). Community Violence and Social Media [Video]. Youtube
Why tech made racial injustice worse, and how to fix it
PODCASTS
Defunding The Police Could Lead To More Surveillance, WNYC
Bias in Commercial Search Engines: A Conversation With Safiya Umoja Noble, Out Of The Echo Chamber
Bias Exists in Our Technology, The Edge with Michelle Bookoff-Bajdek
How algorithms create a ‘digital underclass’, CBC
Why AI Is A Growing Part Of The Criminal Justice System, NPR
Breaking the Black Box, The Rework Podcast
Race, Technology and Abolition – A Conversation with Ruha Benjamin, Cite Black Women Podcast
‘It’s on us to dismantle racism.’ 10 steps tech and business leaders can take toward equity, GeekWire
Reimagining Science and Technology, Princeton AAS Podcast w/ Eddie Glaude
Ethics & Race in Tech, City Arts & Lectures
TED TALKS
How I’m fighting bias in algorithms, Joy Buolamwini
Frey, William (2017, November). Can a Tweet Lead to Violence? [Video]. Ted Conferences.
TED. (2017, May). They are Children: How Posts on Social Media Lead to Gang Violence | Desmond Patton. [Youtube].
From park bench to lab bench – What kind of future are we designing? Ruha Benjamin
BOOKS
Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy, Cathy O’Neil
Dark Matters: On the Surveillance of Blackness, Simone Browne
Genetics and the Unsettled Past: The Collision of DNA, Race, and History, Alondra Nelson
The Social Life of DNA: Race, Reparations, and Reconciliation After the Genome, Alondra Nelson
Algorithms of Oppression, Dr. Safiya Noble
Artificial Unintelligence: How Computers Misunderstand the World, Meredith Broussard
Algorithms of Oppression, Safiya Noble
How High-Tech Tools Profile, Police, and Punish the Poor, Virginia Eubanks
Captivating Technology, Ruha Benjamin
The Ethical Algorithm, Michael Kearns and Aaron Roth
Fairness and Machine Learning textbook, Solon Barocas, Moritz Hardt, and Arvind Narayanan
Bearing Bearing Witness While Black: African Americans, Smartphones, and the New Protest #Journalism, Allissa V. Richardson
Race After Technology, Ruha Benjamin
Technicolor: Race, Technology, and Everyday Life, Alondra Nelson
Race, Rhetoric, and Technology, Dr. Adam J. Banks
Design with Disability, Mara Mills and Rebecca Sanchez
How Users Matter, Ben Schneiderman
Accessible America: A History of Disability and Design, Bess Williamson
How to Stop Silicon Valley from Building a New Global Underclass, Mary L. Gray and Siddharth Suri
Giving Voice: Mobile Communication, Disability, and Inequality, Meryl Alper
Appropriating Technology: Vernacular Science and Social Power. Minneapolis, Ron Eglash
Building Access: Universal Design and the Politics of Disability. Minneapolis, Aimi Hamraie
Making Computers Accessible: Disability Rights and Digital Technology, Elizabeth R. Petrick
A People’s History of Computing in the United States. Cambridge Massachusetts and London, Joy Lisi Rankin
The Intersectional Internet, Safiya Noble
Design justice: community-led practices to build the worlds we need. MIT Press, Sasha Costanza-Chock
Designs for the pluriverse: Radical interdependence, autonomy, and the making of worlds, Arturo Escobar
Value sensitive design: Shaping technology with moral imagination, Batya Friedman and David G. Hendry
Mismatch: How Inclusion Shapes Design, Kat Holmes
Afrofuturism, Alondra Nelson
The Ethics of Invention: Technology and the Human Future, Sheila Jasonoff
White Logic, White Methods: Racism and Methodology, Tukufu Zuberi and Eduardo Bonilla-Silva
Decolonizing Methodologies, Linda Tuhiwai Smith
Indigenous Statistics, Maggie Walter and Chris Andersen
Analyzing Inequalities: An Introduction to Race, Class, Gender, and Sexuality Using the General Social Survey, Catherine E. Harnois
Just Research in Contentious Times, Michelle Fine
PEOPLE
Alondra Nelson
Mutale Nkonde
Ruha Benjamin
Safiya Noble
Sheila Jasanoff
Simone Browne
Timnit Gebru
PROGRAMS and ORGANIZATIONS
Design Justice Network
AI For the People (AFP)
Algorithmic Justice League
Allied Media Projects
Black Girls Code | Twitter
Center for Media Justice
Chupadatos
ColorCoded
Code2040 | Twitter
Data 4 Black Lives
/dev/color | Twitter
Equitable Internet Initiative
Just Data Lab
#MoreThanCode
Our Collective
The Stanford Open Policing Project
We All Count
INSTITUTES and CENTERS
AI Now Institute
Berkman Klein Center for Internet Studies at Harvard University
Center for Information Technology Policy at Princeton
Center for Critical Race and Digital Studies
Data and Society
MIT MediaLab
Program on Science, Technology, & Society
CONFERENCES
Simone Browne: Keynote at Subverting Surveillance: Strategies to End State Violence
Data for Black Lives (Ruha Benjamin, Abolition in the Age of Big Data, Code Black – Closing the Health Equity Gap)
Plenary Panel: Inequality, Labor, Health, and Ethics in AI, AI Now 2016 Public Symposium
‘People fix things. Tech doesn’t fix things,’ TechCrunch
Calculating the cost of tech-fueled discrimination, MIT News
Bias^2 – The Harvard Data Science Initiative (video)
AMC Fairness Accountability and Transparency
WORKSHOPS and COURSES
AI #Xplained – digital series explaining AI & bias
Youth and Digital Citizenship+ (Plus)
“Drag vs. AI” Workshop
Advancing racial literacy in tech, Data & Society Project
Tutorial (2020): Fairness, Accountability, Transparency, and Ethics in Computer Vision by Timnit Gebru and Emily Denton
Tutorial (2019): Bias and Fairness in Natural Language Processing by Kai-Wei Chang, Vicente Ordonez, Margaret Mitchell, and Vinodkumar Prabhakaran
TOOLKITS and GUIDES
Web-based portal by Sheila Jasanoff and colleagues for exchanges among STS scholars on issues of contemporary political and policy significance
Skin in the Game: Modulate AI and Addressing the Legal and Ethical Challenges of Voice Skin Technology
AI: Educational Activities
Facial Recognition Technologies: A Primer
AI Now’s Algorithmic Accountability Policy Toolkit
Guide to Responsible Tech: How to Get Involved & Build a Better Tech Future
Our Data Bodies
Civic Tech Field Guide
MoreThanCode Directory
Resource Guide by Ruha Benjamin
The COVID Racial Data Tracker
Indicators Relevant for Indigenous Peoples: A Resource Book
Data Ethics syllabus by Rachel Thomas
A Resource Guide on Racial Profiling Data Collection Systems
A People’s Guide to AI
Data & Society “Algorithmic Accountability” Statement
STATEMENTS and ADVOCACY
Principled Artificial Intelligence
International Indigenous Design Charter
Seven Principles of Universal Design
Ban the Scan, Amnesty International
The Court Monitoring Project
Humanitarian AI Distillation
Humanitarian AI Catalog
Algorithmic Accountability: A Primer
An Open Letter to Facebook from the Data for Black Lives Movement
Guidelines for Equitable Open Data
Principles of a Feminist Internet
Science for the People
Tech Workers Coalition Community Guide
#NoTechforICE
#Techwontbuildit Statement
OPPORTUNITIES and INTERNSHIPS
Ernest Houston Johnson Scholars Program
BlackAIR Summer Research Grant Program
POCIT – People of Color in Tech
Public Service Data Science Graduate Fellowship
JOURNALS
Catalyst: Feminism, Theory, Technoscience
Design Justice