About

Recent years have seen an astounding growth in deployment of AI systems in critical domains such as autonomous vehicles, criminal justice, healthcare, hiring, housing, human resource management, law enforcement, and public safety, where decisions taken by AI agents directly impact human lives. Consequently, there is an increasing concern if these decisions can be trusted to be correct, reliable, fair, and safe, especially under adversarial attacks.

Under the umbrella of trustworthy computing, there is a long-established framework employing formal methods and verification techniques for ensuring trust properties like reliability, security, and privacy of traditional software and hardware systems. Just as for trustworthy computing, formal verification could be an effective approach for building trust in AI-based systems. However, the set of properties needs to be extended beyond reliability, security, and privacy to include fairness, robustness, probabilistic accuracy under uncertainty, and other properties yet to be identified and defined. Further, there is a need for new property specifications and verification techniques to handle new kinds of artifacts, e.g., data distributions, probabilistic programs, and machine learning based models that may learn and adapt automatically over time.

This first Trustworthy AI Symposium aims to bring together researchers from the trustworthy computing and artificial intelligence communities, along with researchers and practitioners utilizing AI methods in a variety of domains, to explore the future of trust, fairness, privacy, and robustness in AI-based systems. Through a mix of lightning talks and tutorial-style talks, interspersed with break-out sessions for exploring new interdisciplinary research directions, we hope to lay down the seeds of a long-term research agenda for the whole computing community. Our goal is to give reason for people, communities, and society to trust the computing systems we build, now and for the future. The symposium, which is by invitation only, is sponsored by Capital One, a DSI Industry Affiliate.

Event Details

Dates: Wednesday, October 30 – Friday, November 1, 2019
Location (symposium): Casa Italiana, 1161 Amsterdam Ave, New York, NY 10027
Location (reception): Brown Institute for Media Innovation, 2950 Broadway, New York, NY 1002

Agenda

Day 1: Wednesday October 30, 2019

8:30 AM – 9:00 AM: Opening Remarks by Jeannette M. Wing

8:00 AM – 10:00 AM: Keynote Speakers: Somesh Jha and Aaron Roth; Session Chair: Jeannette M. Wing

10:00 AM – 10:30 AM: Break

10:30 AM – 11:30 AM: Speakers: Suman Jana, Anupam Datta, Golnoosh Farnadi, Bo Cowgill, Sanjit Seshia; Session Chair: Suman Jana

11:30 AM – 01:00 PM: Lunch

1:00 PM – 2:00 PM: Keynote Speakers: Bin Yu and Keegan Hines; Session Chair: Shipra Agrawal

2:00 PM – 2:30 PM: Break

2:30 PM – 3:30 PM: Speakers: Andre Platzer, Aleksander Madry, Brian Barr, Kamalika Chaudhari, Roxana Geambasu; Session Chair: Roxana Geambasu

3:30 PM – 5:30 PM: Breakout Discussions and Report
Breakout Leaders:
Shipra Agrawal and Pushmeet Kohli
Bo Cowgill and Elisa Celis
Carl Vondrick and Nicholas Carlini
Suman Jana and Sanjit Seshia

6:30 PM – 8:30 PM: Reception

Day 2, Thursday October 31, 2019

9:00 AM – 10:00 AM: Speakers: Sriram Rajamani and Aleksandra Korolova; Session Chair: Jeannette M. Wing

10:00 AM – 10:30 AM: Break

10:30 AM – 11:30 AM: Speakers: Dj Dijotham, Nicholas Carlini, Nicolas Papernot, Aleksandar Zeljic, Elisa Celis; Session Chair: Daniel Hsu

11:30 AM – 1:00 PM: Lunch

1:00 PM – 2:00 PM: Keynote Speakers: Ulfar Erlingsson and Frida Polli; Session Chair: Augustin Chaintreau

2:00 PM – 2:30 PM: Break

2:30 PM – 3:30 PM: Speakers: Claudia Perlich, Lily Hu, Eric Talley, Ronghui Gu; Session Chair: Ronghui Gu

3:30 PM – 5:30 PM: Breakout Discussions (and Report)
Breakout Leaders:
Roxana Geambasu and Anupam Datta
Eugene Wu and Ulfar Erlingsson
Jeannette M. Wing and Somesh Ja
Augustin Chaintreau and Lily Hu

Day 3, Friday November 1, 2019

9:00 AM – 10:00 AM: Keynote Speakers: Laurent El Ghaoui and David Blei; Session Chair: Shipra Agrawal

10:00 AM – 10:30 AM: Break

10:30 AM – 11:30 AM: Speakers: Augustin Chaintreau, Rachel Cummings, Marta Kwiatkowska, Carl Vondrick; Session Chair: Carl Vondrick

11:30 AM – 1:00 AM: Summary and Next Steps

Participants:

  • Elias Barenboim, Associate Professor of Computer Science and Data Science Institute, Columbia University
  • Brian Barr, Machine Learning Researcher, Capital One
  • Karen Bhatia, Senior Vice President, Tech, NYCEDC
  • David Blei, Professor of Statistics and Computer Science and Data Science Institute, Columbia University
  • Nicholas Carlini, Research Scientist, Google Brain
  • Elisa Celis, Assistant Professor of Statistics and Data Science, Yale University
  • Kamalika Chaudhuri, Associate Professor of Computer Science and Engineering, UC San Diego
  • Bo Cowgill, Assistant Professor of Business and Data Science Institute, Columbia University
  • Rachel Cummings: Assistant Professor in the H. Milton Stewart School of Industrial and Systems Engineering, Georgia Tech
  • Anupam Datta: Professor of Electrical and Computer Engineering and (by courtesy) Computer Science, Carnegie Mellon University
  • Laurent El Ghaoui, Professor, EECS and IEOR Departments, UC Berkeley
  • Krishnamurthy (Dj) Dvijotham, Research Scientist, DeepMind
  • Ulfar Erlingsson, Research Scientist, Google Brain
  • Golnoosh Farnadi, Postdoctoral fellow, Polytechnique Montréal
  • Ronghui Gu, Assistant Professor of Computer Science and Data Science Institute, Columbia University
  • Mark Hansen, Professor of Journalism and Data Science Institute, Columbia University
  • Keegan Hines, Director of Machine Learning Research, Capital One
  • Daniel Hsu, Associate Professor of Computer Science and Data Science Institute, Columbia University
  • Lily Hu, PhD Candidate in Applied Mathematics, Harvard University and Fellow at the Berkman Klein Center for Internet and Society
  • Somesh Jha, Professor of Computer Science, UW-Madison
  • Pushmeet Kohli, Computer Scientist, Google DeepMind
  • Aleksandra Korolova, Assistant Professor of Computing Science at USC
  • Marta Kwiatkowska: Professor of Computing Systems, Fellow, Trinity College, University of Oxford
  • Himabindu Lakkaraju, Postdoctoral Fellow, Harvard
  • Aleksander Madry, NBX Career Development Associate Professor of Computer Science, MIT
  • Brad Martin, Senior Researcher, National Security Agency
  • Aleksandra (Saska) Mojsilovic, IBM Fellow, AI Science, Thomas J. Watson Research Center
  • Nicolas Papernot, Assistant Professor, University of Toronto and Vector Institute
  • Desmond Patton, Associate Professor of Social Work and Data Science Institute, Columbia University
  • Claudia Perlich, Senior Data Scientist, Two Sigma
  • Andre Platzer, Associate Professor of Computer Science, Carnegie Mellon University
  • Frida Polli, CEO and co-founder of pymetrics
  • Sriram Rajamani, Distinguished Scientist and Managing Director of Microsoft Research India
  • Aaron Roth, Associate Professor of Computer and Information Science, University of Pennsylvania
  • Sanjit Seshia, Professor, Department of Electrical Engineering and Computer Sciences, UC Berkeley
  • Eric Talley, Isidor and Seville Sulzbacher Professor of Law and Data Science Institute, Columbia University
  • Kunal Talwar, Research Scientist, Google Brain
  • Carl Vondrick, Assistant Professor of Computer Science and Data Science Institute, Columbia University
  • Eugene Wu, Assistant Professor of Computer Science and Data Science Institute, Columbia University
  • Bin Yu, Chancellor’s Professor, Departments of Statistics and Electrial Engineering & Computer Sciences at UC Berkeley
  • Aleksandar Zeljic, Postdoctoral Research Fellow, Computer Science, Stanford

Participants:

  • Shipra Agrawal, Assistant Professor of Industrial Engineering & Operations Research and Data Science Institute, Columbia University (co-chair)
  • Augustin Chaintreau, Assistant Professor of Computer Science and Data Science Institute, Columbia University
  • Roxana Geambasu, Associate Professor of Computer Science and Data Science Institute, Columbia University
  • Suman Jana, Assistant Professor of Computer Science and Data Science Institute, Columbia University
  • Cathryn Posey, Senior Technology Director, Machine Learning, Capital One
  • Jeannette M. Wing, Avanessians Director of the Data Science Institute and Professor of Computer Science, Columbia University