Our Work

Innovating Public Procurement to Mitigate the Risks of Artificial Intelligence Systems

Artificial Intelligence (AI) systems are increasingly deployed in the public sector. Existing public procurement processes and standards are in urgent need of innovation to address potential risks and harms to citizens. Read our primer based on our research and on input from leading experts in the public sector, data science, civil society, policy, social science, and the law to learn about pathways forward.

Learn MoreRight Arrow

Terra Incognita NYC

Terra Incognita NYC set out as a collaboration of New_Public and principal investigator Mona Sloane, a Fellow with New York University’s Institute for Public Knowledge to learn from this public migration online and and map out the unknown digital public spaces—terra incognita—forming in the nation’s largest city. With a team of digital ethnographers, we spent the summer of 2020 listening to New Yorkers, across the five boroughs of New York City, about their digital lives since the pandemic began.

Learn MoreRight Arrow

Ranking Facts

Ranking Facts is a standardized, human-interpretable summary of the ranking methodology and of its result.

Learn MoreRight Arrow

Fair Prep

FairPrep is a design and evaluation framework for fairness-enhancing interventions that treats data as a first-class citizen.

Learn MoreRight Arrow

Data Synthesizer

DataSynthesizer generates synthetic data that simulates a given dataset.

Learn MoreRight Arrow

Teaching Responsible Data Science: Charting New Pedagogical Territory

Armanda Lewis

Julia Stoyanovich

International Journal of Artificial Intelligence in Education

Learn MoreRight Arrow

Public Engagement Showreel Int 1894

Julia Stoyanovich

Steven Kuyan

Meghan McDermott

Maria Grillo

Mona Sloane

Learn MoreRight Arrow

Teaching responsible data science

Julia Stoyanovich

Armanda Lewis

International Journal of Artificial Intelligence in Education (IJAIED), 2021, Note: Special Issue: The FATE of AI in Education: Fairness, Accountability, Transparency, and Ethics

Learn MoreRight Arrow

Lightweight inspection of data preprocessing in native machine learning pipelines

Stefan Grafberger

Julia Stoyanovich

Sebastian Schelter

CIDR 2021, 11th Conference on Innovative Data Systems Research, Online Proceedings

Learn MoreRight Arrow

Taming technical bias in machine learning pipelines

Sebastian Schelter

Julia Stoyanovich

IEEE Data Eng. Bull., vol. 43, 2020

Learn MoreRight Arrow

FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions

Sebastian Schelter

Yuxuan He

Jatin Khilnani

Julia Stoyanovich

EDBT 2020 (short paper), arXiv, November 2019, EDBT talk video

Learn MoreRight Arrow

Fairness-Aware Instrumentation of Preprocessing Pipelines for Machine Learning

Ke Yang, Biao Huang

Julia Stoyanovich

Sebastian Schelter

Proceedings of HILDA 2020 (an ACM SIGMOD workshop)

Learn MoreRight Arrow

Responsible Data Management

Julia Stoyanovich

Bill Howe

H.V. Jagadish

PVLDB 13(12): 3474-3489 (2020), invited paper accompanying VLDB 2020 keynote presentation

Learn MoreRight Arrow

The Imperative of Interpretable Machines

Julia Stoyanovich

Jay J. Van Bavel

Tessa V. West

Nature Machine Intelligence, April 2020

Learn MoreRight Arrow

Causal Intersectionality for Fair Ranking

Ke Yang

Joshua R. Loftus

Julia Stoyanovich

arXiv, June 2020

Learn MoreRight Arrow

Balanced Ranking with Diversity Constraints

Ke Yang

Vasilis Gkatzelis

Julia Stoyanovich

Proceedings of IJCAI 2019

Learn MoreRight Arrow

Designing Fair Ranking Schemes

Abolfazl Asudeh

H. V. Jagadish

Julia Stoyanovich

Gautam Das

Proceedings of ACM SIGMOD, 2019

Learn MoreRight Arrow

MithraRanking: A System for Responsible Ranking Design

Yifan Guan

Abolfazl Asudeh

Pranav Mayuram

Hosagrahar V. Jagadish

Julia Stoyanovich

Gerome Miklau

Gautam Das

Proceedings of ACM SIGMOD, 2019

Learn MoreRight Arrow

Transparency, Fairness, Data Protection, Neutrality: Data Management Challenges in the Face of New Regulation

Serge Abiteboul

Julia Stoyanovich

ACM Journal of Data and Information Quality, 2019

Learn MoreRight Arrow

Nutritional Labels for Data and Models

Julia Stoyanovich

Bill Howe

IEEE Data Engineering Bulletin 42(3): 13-23 (2019)

Learn MoreRight Arrow

Towards Responsible Data-driven Decision Making in Score-Based Systems

Abolfazl Asudeh

H. V. Jagadish

Julia Stoyanovich

IEEE Data Engineering Bulletin 42(3): 76-87 (2019)

Learn MoreRight Arrow

TransFAT: Translating Fairness, Accountably and Transparency into Data Science Practice

Julia Stoyanovich

International Workshop on Processing Information Ethically (PIE@CAiSE) (2019)

Learn MoreRight Arrow

WE are AI 5-week learning circle course – Introduction to the basics of AI and the social and ethical dimensions of the use of AI in modern life.

Learn MoreRight Arrow

Undergraduate and Graduate Responsible Data Science Courses at NYU CDS

Learn MoreRight Arrow

AI Ethics: Global Perspectives

Learn MoreRight Arrow

The Data, Responsibly Comic Series

Learn MoreRight Arrow