Associate Professor and Director of R/AI – stoyanovich (at) nyu.edu – Personal Website
CV Google Scholar DBLP LinkedIn Twitter
Julia is an Institute Associate Professor of Computer Science and Engineering at the Tandon School of Engineering, Associate Professor of Data Science at the Center for Data Science, and Director of the Center for Responsible Ai. Julia’s goal is to make “Responsible AI” synonymous with “AI”. She works towards this goal by engaging in academic research, education and technology policy, and by speaking about the benefits and harms of AI to practitioners and members of the public.
Julia’s research interests include AI ethics and legal compliance, and data management and AI systems. In addition to academic publications, she has written for the New York Times, the Wall Street Journal, and Le Monde. Julia has been teaching courses on responsible data science and AI to students, practitioners and the general public. She is a co-author of “Data, Responsibly”, an award-winning comic book series for data science enthusiasts, and “We are AI”, a comic book series for the general audience.
Julia is engaged in technology policy and regulation in the US and internationally, having served on the New York City Automated Decision Systems Task Force, by mayoral appointment, among other roles.
Julia received her M.S. and Ph.D. degrees in Computer Science from Columbia University, and a B.S. in Computer Science and in Mathematics & Statistics from the University of Massachusetts at Amherst. She is a recipient of the NSF CAREER Award and a Senior Member of the ACM.
Selected publications
Responsible Model Selection with Virny and VirnyView
Denys Herasymuk, Falaah Arif Khan, and Julia Stoyanovich
In Companion of the International Conference on Management of Data, SIGMOD/PODS, Santiago, Chile 2024
@inproceedings { DBLP:conf/sigmod/HerasymukKS24 ,
author = {Herasymuk, Denys and Khan, Falaah Arif and Stoyanovich, Julia} ,
editor = {Barcel{\'{o}}, Pablo and Pi, Nayat S{\'{a}}nchez and Meliou, Alexandra and Sudarshan, S.} ,
title = {Responsible Model Selection with Virny and VirnyView} ,
booktitle = {Companion of the International Conference on Management of Data,
{SIGMOD/PODS}, Santiago, Chile} ,
pages = {488--491} ,
publisher = {{ACM}} ,
year = {2024} ,
url = {https://doi.org/10.1145/3626246.3654738} ,
doi = {10.1145/3626246.3654738} ,
keywords = {data,conference,demo,RAIforUkraine} ,
author+an = {1=self;2=self;3=self}
}
Epistemic Parity: Reproducibility as an Evaluation Metric for Differential Privacy
Lucas Rosenblatt, Bernease Herman, Anastasia Holovenko, Wonkwon Lee, Joshua R. Loftus, Elizabeth McKinnie, Taras Rumezhak, Andrii Stadnik, Bill Howe, and Julia Stoyanovich
SIGMOD Rec. 2024
@article { DBLP:journals/sigmod/RosenblattHHLLMRSHS24 ,
author = {Rosenblatt, Lucas and Herman, Bernease and Holovenko, Anastasia and Lee, Wonkwon and Loftus, Joshua R. and McKinnie, Elizabeth and Rumezhak, Taras and Stadnik, Andrii and Howe, Bill and Stoyanovich, Julia} ,
title = {Epistemic Parity: Reproducibility as an Evaluation Metric for Differential
Privacy} ,
journal = {{SIGMOD} Rec.} ,
volume = {53} ,
number = {1} ,
pages = {65--74} ,
year = {2024} ,
url = {https://doi.org/10.1145/3665252.3665267} ,
doi = {10.1145/3665252.3665267} ,
keywords = {journal,privacy,RAIforUkraine} ,
author+an = {1=self;3=self;4=self;6=self;7=self;8=self;10=self}
}
The Possibility of Fairness: Revisiting the Impossibility Theorem in Practice
Andrew Bell, Lucius Bynum, Nazarii Drushchak, Tetiana Zakharchenko, Lucas Rosenblatt, and Julia Stoyanovich
In Proceedings of the ACM Conference on Fairness, Accountability, and Transparency, FAccT, Chicago, IL, USA 2023
@inproceedings { DBLP:conf/fat/BellBDZRS23 ,
author = {Bell, Andrew and Bynum, Lucius and Drushchak, Nazarii and Zakharchenko, Tetiana and Rosenblatt, Lucas and Stoyanovich, Julia} ,
title = {The Possibility of Fairness: Revisiting the Impossibility Theorem
in Practice} ,
booktitle = {Proceedings of the {ACM} Conference on Fairness, Accountability,
and Transparency, FAccT, Chicago, IL, USA} ,
pages = {400--422} ,
publisher = {{ACM}} ,
year = {2023} ,
doi = {10.1145/3593013.3594007} ,
keywords = {conference,fair,RAIforUkraine} ,
author+an = {1=self;2=self;3=self;4=self;5=self;6=self}
}
Responsible AI literacy: A stakeholder-first approach
Daniel Dominguez, and Julia Stoyanovich
Big Data and Society 2023
@article { DominguezStoyanovich23 ,
author = {Dominguez, Daniel and Stoyanovich, Julia} ,
title = {Responsible AI literacy: A stakeholder-first approach} ,
journal = {Big Data and Society} ,
year = {2023} ,
keywords = {journal,education,rds} ,
doi = {https://doi.org/10.1177/20539517231219958} ,
}
Setting the Right Expectations: Algorithmic Recourse Over Time
João Fonseca, Andrew Bell, Carlo Abrate, Francesco Bonchi, and Julia Stoyanovich
In Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, EAAMO 2023, Boston, MA, USA, 30 October 2023 - 1 November 2023 2023
@inproceedings { DBLP:conf/eaamo/FonsecaBABS23 ,
author = {Fonseca, Jo{\~{a}}o and Bell, Andrew and Abrate, Carlo and Bonchi, Francesco and Stoyanovich, Julia} ,
title = {Setting the Right Expectations: Algorithmic Recourse Over Time} ,
booktitle = {Proceedings of the 3rd {ACM} Conference on Equity and Access in Algorithms,
Mechanisms, and Optimization, {EAAMO} 2023, Boston, MA, USA, 30 October
2023 - 1 November 2023} ,
pages = {29:1--29:11} ,
publisher = {{ACM}} ,
year = {2023} ,
url = {https://doi.org/10.1145/3617694.3623251} ,
doi = {10.1145/3617694.3623251} ,
timestamp = {Thu, 09 Nov 2023 21:12:58 +0100} ,
biburl = {https://dblp.org/rec/conf/eaamo/FonsecaBABS23.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference, fairness} ,
}
Query Refinement for Diversity Constraint Satisfaction
Jinyang Li, Yuval Moskovitch, Julia Stoyanovich, and H. V. Jagadish
Proc. VLDB Endow. 2023
@article { DBLP:journals/pvldb/LiMSJ23 ,
author = {Li, Jinyang and Moskovitch, Yuval and Stoyanovich, Julia and Jagadish, H. V.} ,
title = {Query Refinement for Diversity Constraint Satisfaction} ,
journal = {Proc. {VLDB} Endow.} ,
volume = {17} ,
number = {2} ,
pages = {106--118} ,
year = {2023} ,
timestamp = {Mon, 27 Nov 2023 13:13:34 +0100} ,
biburl = {https://dblp.org/rec/journals/pvldb/LiMSJ23.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,fairness,data} ,
}
ERICA: Query Refinement for Diversity Constraint Satisfaction
Jinyang Li, Alon Silberstein, Yuval Moskovitch, Julia Stoyanovich, and H. V. Jagadish
Proc. VLDB Endow. 2023
@article { DBLP:journals/pvldb/LiSMSJ23 ,
author = {Li, Jinyang and Silberstein, Alon and Moskovitch, Yuval and Stoyanovich, Julia and Jagadish, H. V.} ,
title = {{ERICA:} Query Refinement for Diversity Constraint Satisfaction} ,
journal = {Proc. {VLDB} Endow.} ,
volume = {16} ,
number = {12} ,
pages = {4070--4073} ,
year = {2023} ,
doi = {10.14778/3611540.3611623} ,
timestamp = {Mon, 23 Oct 2023 16:16:16 +0200} ,
biburl = {https://dblp.org/rec/journals/pvldb/LiSMSJ23.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,fairness,data} ,
}
Subset Modelling: A Domain Partitioning Strategy for Data-efficient Machine-Learning
Vı́tor Ribeiro, Eduardo H. M. Pena, Raphael Freitas Saldanha, Reza Akbarinia, Patrick Valduriez, Falaah Arif Khan, Julia Stoyanovich, and Fábio Porto
In Proceedings of the 38th Brazilian Symposium on Databases, SBBD 2023, Belo Horizonte, MG, Brazil, September 25-29, 2023 2023
@inproceedings { DBLP:conf/sbbd/RibeiroPSAVKS023 ,
author = {Ribeiro, V{\'{\i}}tor and Pena, Eduardo H. M. and de Freitas Saldanha, Raphael and Akbarinia, Reza and Valduriez, Patrick and {Arif Khan}, Falaah and Stoyanovich, Julia and Porto, F{\'{a}}bio} ,
title = {Subset Modelling: {A} Domain Partitioning Strategy for Data-efficient
Machine-Learning} ,
booktitle = {Proceedings of the 38th Brazilian Symposium on Databases, {SBBD} 2023,
Belo Horizonte, MG, Brazil, September 25-29, 2023} ,
pages = {318--323} ,
publisher = {{SBC}} ,
year = {2023} ,
timestamp = {Wed, 25 Oct 2023 16:14:33 +0200} ,
biburl = {https://dblp.org/rec/conf/sbbd/RibeiroPSAVKS023.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,data} ,
}
Responsible Data Management
Julia Stoyanovich, Bill Howe, and HV Jagadish
Proceedings of the VLDB Endowment 2020
@article { DBLP:journals/pvldb/StoyanovichHJ20 ,
title = {Responsible Data Management} ,
author = {Stoyanovich, Julia and Howe, Bill and Jagadish, HV} ,
journal = {Proceedings of the VLDB Endowment} ,
volume = {13} ,
number = {12} ,
year = {2020} ,
keywords = {fairness,data,journal} ,
doi = {10.14778/3415478.3415570} ,
}
Spending Privacy Budget Fairly and Wisely
Lucas Rosenblatt, Joshua Allen, and Julia Stoyanovich
Theory and Practice of Differential Privacy (@ICML) 2022
@article { rosenblatt2022spending ,
title = {Spending Privacy Budget Fairly and Wisely} ,
author = {Rosenblatt, Lucas and Allen, Joshua and Stoyanovich, Julia} ,
journal = {Theory and Practice of Differential Privacy (@ICML)} ,
year = {2022} ,
keywords = {differential privacy, fairness, databases} ,
}
Automated Data Cleaning Can Hurt Fairness in Machine Learning-based Decision Making
Shubha Guha, Falaah Arif Khan, Julia Stoyanovich, and Sebastian Schelter
In Proceedings of the 39th International Conference on Data Engineering, ICDE 2023
@inproceedings { guha_23 ,
author = {Guha, Shubha and Khan, Falaah Arif and Stoyanovich, Julia and Schelter, Sebastian} ,
year = {2023} ,
title = {Automated Data Cleaning Can Hurt Fairness in Machine Learning-based Decision Making} ,
keywords = {conference,data,fair} ,
booktitle = {Proceedings of the 39th International Conference on Data Engineering, {ICDE}} ,
}
The Unbearable Weight of Massive Privilege: Revisiting Bias-Variance Trade-Offs in the Context of Fair Prediction
Falaah Arif Khan, and Julia Stoyanovich
CoRR 2023
@article { DBLP:journals/corr/abs-2302-08704 ,
author = {Khan, Falaah Arif and Stoyanovich, Julia} ,
title = {The Unbearable Weight of Massive Privilege: Revisiting Bias-Variance
Trade-Offs in the Context of Fair Prediction} ,
journal = {CoRR} ,
volume = {abs/2302.08704} ,
year = {2023} ,
doi = {10.48550/arXiv.2302.08704} ,
eprinttype = {arXiv} ,
eprint = {2302.08704} ,
keywords = {working,fairness,stability} ,
}
The Imperative of Interpretable Machines
Julia Stoyanovich, Jay J. Van Bavel, and Tessa V. West
Nature Machine Intelligence 2020
@article { NMI_2020 ,
author = {Stoyanovich, Julia and {Van Bavel}, Jay J. and West, Tessa V.} ,
title = {The Imperative of Interpretable Machines} ,
journal = {Nature Machine Intelligence} ,
volume = {2} ,
year = {2020} ,
pages = {197--199} ,
doi = {https://doi.org/10.1038/s42256-020-0171-8} ,
keywords = {journal,explainability} ,
}
Introducing contextual transparency for automated decision systems
Mona Sloane, Ian Solano-Kamaiko, Jun Yuan, Aritra Dasgupta, and Julia Stoyanovich
Nature Machine Intelligence 2023
@article { NMI_2023 ,
author = {Sloane, Mona and Solano-Kamaiko, Ian and Yuan, Jun and Dasgupta, Aritra and Stoyanovich, Julia} ,
title = {Introducing contextual transparency for automated decision systems} ,
journal = {Nature Machine Intelligence} ,
volume = {5} ,
year = {2023} ,
pages = {187-–195} ,
doi = {https://doi.org/10.1038/s42256-023-00623-7} ,
keywords = {journal,explainability,policy,hiring} ,
}
The Many Facets of Data Equity
H.V. Jagadish, Julia Stoyanovich, and Bill Howe
ACM Journal of Data and Information Quality 2023
@article { jdiq23 ,
author = {Jagadish, H.V. and Stoyanovich, Julia and Howe, Bill} ,
title = {The Many Facets of Data Equity} ,
journal = {ACM Journal of Data and Information Quality} ,
year = {2023} ,
keywords = {journal,data,fair} ,
volume = {14} ,
issue = {4} ,
pages = {1--21} ,
doi = {https://doi.org/10.1145/3533425} ,
}
Most Expected Winner: An Interpretation of Winners over Uncertain Voter Preferences
Haoyue Ping, and Julia Stoyanovich
Proc. ACM Manag. Data 2023
Supporting Hard Queries over Probabilistic Preferences
Haoyue Ping, Julia Stoyanovich, and Benny Kimelfeld
PVLDB 2020
Counterfactuals for the Future
Lucius E. J. Bynum, Joshua R. Loftus, and Julia Stoyanovich
CoRR 2022
An Interactive Introduction to Causal Inference
Lucius E.J. Bynum, Falaah Arif Khan, Oleksandra Konopatska, Joshua R. Loftus, and Julia Stoyanovich
VISxAI: Workshop on Visualization for AI Explainability 2022
@article { bynum2022interactive ,
author = {Bynum, Lucius E.J. and Khan, Falaah Arif and Konopatska, Oleksandra and Loftus, Joshua R. and Stoyanovich, Julia} ,
title = {An Interactive Introduction to Causal Inference} ,
journal = {VISxAI: Workshop on Visualization for AI Explainability} ,
year = {2022} ,
site = {https://r-ai.co/ci-playground} ,
publisher = {IEEE} ,
keywords = {workshop,education,playground,RAIforUkraine} ,
}
Rankers, Rankees, & Rankings: Peeking into the Pandora’s Box from a Socio-Technical Perspective
Jun Yuan, Julia Stoyanovich, and Aritra Dasgupta
CoRR 2022
@article { DBLP:journals/corr/abs-2211-02932 ,
author = {Yuan, Jun and Stoyanovich, Julia and Dasgupta, Aritra} ,
title = {Rankers, Rankees, {\&} Rankings: Peeking into the Pandora's Box
from a Socio-Technical Perspective} ,
journal = {CoRR} ,
volume = {abs/2211.02932} ,
year = {2022} ,
url = {https://doi.org/10.48550/arXiv.2211.02932} ,
doi = {10.48550/arXiv.2211.02932} ,
keywords = {working,ranking,explainability} ,
eprinttype = {arXiv} ,
eprint = {2211.02932} ,
timestamp = {Wed, 09 Nov 2022 17:33:26 +0100} ,
biburl = {https://dblp.org/rec/journals/corr/abs-2211-02932.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
}
The Many Facets of Data Equity
H. V. Jagadish, Julia Stoyanovich, and Bill Howe
In Proceedings of the Workshops of the EDBT/ICDT 2021 Joint Conference, Nicosia, Cyprus, March 23, 2021 2021
@inproceedings { DBLP:conf/edbt/JagadishSH21 ,
author = {Jagadish, H. V. and Stoyanovich, Julia and Howe, Bill} ,
editor = {Costa, Constantinos and Pitoura, Evaggelia} ,
title = {The Many Facets of Data Equity} ,
booktitle = {Proceedings of the Workshops of the {EDBT/ICDT} 2021 Joint Conference,
Nicosia, Cyprus, March 23, 2021} ,
series = {{CEUR} Workshop Proceedings} ,
volume = {2841} ,
publisher = {CEUR-WS.org} ,
year = {2021} ,
keywords = {workshop,data,fairness} ,
}
Translational Tutorial: Fairness and Friends
Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich
In 4th Annual Conference on Fairness, Accountability, and Transparency, ACM FAccT 2021
All Aboard! Making AI Education Accessible
Falaah Arif Khan, Lucius Bynum, Amy Hurst, Lucas Rosenblatt, Meghana Shanbhogue, Mona Sloane, and Julia Stoyanovich
Center for Responsible AI, New York University 2023
@article { AllAboard ,
author = {{Arif Khan}, Falaah and Bynum, Lucius and Hurst, Amy and Rosenblatt, Lucas and Shanbhogue, Meghana and Sloane, Mona and Stoyanovich, Julia} ,
title = {{All Aboard! Making AI Education Accessible}} ,
journal = {Center for Responsible AI, New York University} ,
keywords = {panel,education,weareai} ,
year = {2023} ,
}
The Algorithmic Transparency Playbook: A Stakeholder-first Approach to Creating Transparency for Your Organization’s Algorithms
Andrew Bell, Oded Nov, and Julia Stoyanovich
In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems, CHI EA 2023, Hamburg, Germany, April 23-28, 2023 2023
@inproceedings { DBLP:conf/chi/BellNS23 ,
author = {Bell, Andrew and Nov, Oded and Stoyanovich, Julia} ,
title = {The Algorithmic Transparency Playbook: {A} Stakeholder-first Approach
to Creating Transparency for Your Organization's Algorithms} ,
booktitle = {Extended Abstracts of the 2023 {CHI} Conference on Human Factors in
Computing Systems, {CHI} {EA} 2023, Hamburg, Germany, April 23-28,
2023} ,
pages = {554:1--554:4} ,
publisher = {{ACM}} ,
year = {2023} ,
site = {https://r-ai.co/transparency-playbook} ,
doi = {10.1145/3544549.3574169} ,
keywords = {panel,policy,explanability,education,playbook,governance} ,
addendum = {peer-reviewed course} ,
author+an = {1=self;3=self}
}
Personal Data for Personal Use: Vision or Reality?
Xin Luna Dong, Bo Li, Julia Stoyanovich, Anthony Kum Hoe Tung, Gerhard Weikum, Alon Y. Halevy, and Wang-Chiew Tan
In Companion of the 2023 International Conference on Management of Data, SIGMOD/PODS 2023, Seattle, WA, USA, June 18-23, 2023 2023
@inproceedings { DBLP:conf/sigmod/DongLSTWHT23 ,
author = {Dong, Xin Luna and Li, Bo and Stoyanovich, Julia and Tung, Anthony Kum Hoe and Weikum, Gerhard and Halevy, Alon Y. and Tan, Wang{-}Chiew} ,
title = {Personal Data for Personal Use: Vision or Reality?} ,
booktitle = {Companion of the 2023 International Conference on Management of Data,
{SIGMOD/PODS} 2023, Seattle, WA, USA, June 18-23, 2023} ,
pages = {263--264} ,
publisher = {{ACM}} ,
year = {2023} ,
doi = {10.1145/3555041.3589378} ,
keywords = {panel,data,privacy} ,
addendum = {panelist, by invitation} ,
}
Fairness in Ranking: From Values to Technical Choices and Back
Julia Stoyanovich, Meike Zehlike, and Ke Yang
In Companion of the 2023 International Conference on Management of Data, SIGMOD/PODS 2023, Seattle, WA, USA, June 18-23, 2023 2023
@inproceedings { DBLP:conf/sigmod/StoyanovichZY23 ,
author = {Stoyanovich, Julia and Zehlike, Meike and Yang, Ke} ,
editor = {Das, Sudipto and Pandis, Ippokratis and Candan, K. Sel{\c{c}}uk and Amer{-}Yahia, Sihem} ,
title = {Fairness in Ranking: From Values to Technical Choices and Back} ,
booktitle = {Companion of the 2023 International Conference on Management of Data,
{SIGMOD/PODS} 2023, Seattle, WA, USA, June 18-23, 2023} ,
pages = {7--12} ,
publisher = {{ACM}} ,
year = {2023} ,
doi = {10.1145/3555041.3589405} ,
keywords = {panel,fairness,ranking} ,
addendum = {peer-reviewed tutorial} ,
}
Spending Privacy Budget Fairly and Wisely
Lucas Rosenblatt, Joshua Allen, and Julia Stoyanovich
CoRR 2022
@article { DBLP:journals/corr/abs-2204-12903 ,
author = {Rosenblatt, Lucas and Allen, Joshua and Stoyanovich, Julia} ,
title = {Spending Privacy Budget Fairly and Wisely} ,
journal = {CoRR} ,
volume = {abs/2204.12903} ,
year = {2022} ,
doi = {10.48550/arXiv.2204.12903} ,
eprinttype = {arXiv} ,
eprint = {2204.12903} ,
timestamp = {Fri, 29 Apr 2022 13:26:05 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {working,privacy,fairness} ,
author+an = {1=self;3=self}
}
Temporal graph patterns by timed automata
Amir Pouya Aghasadeghi, Jan Van Bussche, and Julia Stoyanovich
VLDB Journal 2023
Think About the Stakeholders First! Towards an Algorithmic Transparency Playbook for Regulatory Compliance
Andrew Bell, Oded Nov, and Julia Stoyanovich
Data & Policy 2023
@article { bell_nov_stoyanovich_2023 ,
author = {Bell, Andrew and Nov, Oded and Stoyanovich, Julia} ,
title = {Think About the Stakeholders First! {T}owards an Algorithmic Transparency
Playbook for Regulatory Compliance} ,
volume = {5} ,
journal = {Data \& Policy} ,
publisher = {Cambridge University Press} ,
year = {2023} ,
keywords = {journal,policy,explainability,education,playbook,governance} ,
}
Zooming Out on an Evolving Graph
Amir Aghasadeghi, Vera Zaychik Moffitt, Sebastian Schelter, and Julia Stoyanovich
In Proceedings of the 23nd International Conference on Extending Database Technology, EDBT 2020
FairPrep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing Interventions
Sebastian Schelter, Yuxuan He, Jatin Khilnani, and Julia Stoyanovich
In Proceedings of the 23nd International Conference on Extending Database Technology, EDBT 2020
@inproceedings { DBLP:conf/edbt/SchelterHKS20 ,
author = {Schelter, Sebastian and He, Yuxuan and Khilnani, Jatin and Stoyanovich, Julia} ,
title = {{F}air{P}rep: Promoting Data to a First-Class Citizen in Studies on Fairness-Enhancing
Interventions} ,
booktitle = {Proceedings of the 23nd International Conference on Extending Database
Technology, {EDBT}} ,
pages = {395--398} ,
year = {2020} ,
doi = {10.5441/002/edbt.2020.41} ,
timestamp = {Wed, 25 Mar 2020 15:46:06 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,data,fair} ,
}
Towards Responsible Data-driven Decision Making in Score-Based Systems
Abolfazl Asudeh, H. V. Jagadish, and Julia Stoyanovich
IEEE Data Eng. Bull. 2019
@article { DBLP:journals/debu/AsudehJS19 ,
author = {Asudeh, Abolfazl and Jagadish, H. V. and Stoyanovich, Julia} ,
title = {Towards Responsible Data-driven Decision Making in Score-Based Systems} ,
journal = {{IEEE} Data Eng. Bull.} ,
volume = {42} ,
number = {3} ,
pages = {76--87} ,
year = {2019} ,
timestamp = {Tue, 10 Mar 2020 16:23:50 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,fair,ranking} ,
author+an = {3=self}
}
Nutritional Labels for Data and Models
Julia Stoyanovich, and Bill Howe
IEEE Data Eng. Bull. 2019
@article { DBLP:journals/debu/StoyanovichH19 ,
author = {Stoyanovich, Julia and Howe, Bill} ,
title = {Nutritional Labels for Data and Models} ,
journal = {{IEEE} Data Eng. Bull.} ,
volume = {42} ,
number = {3} ,
pages = {13--23} ,
year = {2019} ,
timestamp = {Tue, 10 Mar 2020 16:23:50 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,explainability} ,
}
Transparency, Fairness, Data Protection, Neutrality: Data Management Challenges in the Face of New Regulation
Serge Abiteboul, and Julia Stoyanovich
ACM Journal of Data and Information Quality 2019
@article { DBLP:journals/jdiq/AbiteboulS19 ,
author = {Abiteboul, Serge and Stoyanovich, Julia} ,
title = {Transparency, Fairness, Data Protection, Neutrality: Data Management
Challenges in the Face of New Regulation} ,
journal = {ACM Journal of Data and Information Quality} ,
volume = {11} ,
number = {3} ,
pages = {15:1--15:9} ,
year = {2019} ,
doi = {10.1145/3310231} ,
timestamp = {Tue, 20 Aug 2019 08:40:18 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,data,fairness,policy,governance} ,
}
MithraLabel: Flexible Dataset Nutritional Labels for Responsible Data Science
Chenkai Sun, Abolfazl Asudeh, H. V. Jagadish, Bill Howe, and Julia Stoyanovich
In Proceedings of the 28th International Conference on Information and Knowledge Management, CIKM 2019
@inproceedings { DBLP:conf/cikm/SunAJHS19 ,
author = {Sun, Chenkai and Asudeh, Abolfazl and Jagadish, H. V. and Howe, Bill and Stoyanovich, Julia} ,
title = {MithraLabel: Flexible Dataset Nutritional Labels for Responsible Data
Science} ,
booktitle = {Proceedings of the 28th International Conference on Information
and Knowledge Management, {CIKM}} ,
pages = {2893--2896} ,
publisher = {{ACM}} ,
year = {2019} ,
doi = {10.1145/3357384.3357853} ,
timestamp = {Mon, 04 Nov 2019 11:09:32 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,data,explainability} ,
}
Balanced Ranking with Diversity Constraints
Ke Yang, Vasilis Gkatzelis, and Julia Stoyanovich
In Proceedings of the 28th International Joint Conference on Artificial Intelligence, IJCAI 2019
@inproceedings { DBLP:conf/ijcai/YangGS19 ,
author = {Yang, Ke and Gkatzelis, Vasilis and Stoyanovich, Julia} ,
title = {Balanced Ranking with Diversity Constraints} ,
booktitle = {Proceedings of the 28th International Joint Conference on
Artificial Intelligence, {IJCAI}} ,
pages = {6035--6042} ,
publisher = {ijcai.org} ,
year = {2019} ,
doi = {10.24963/ijcai.2019/836} ,
timestamp = {Tue, 20 Aug 2019 16:18:18 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,fair,ranking} ,
author+an = {1=self;3=self}
}
Designing Fair Ranking Schemes
Abolfazl Asudeh, H. V. Jagadish, Julia Stoyanovich, and Gautam Das
In Proceedings of the 2019 International Conference on the Management of Data, SIGMOD 2019
@inproceedings { DBLP:conf/sigmod/AsudehJS019 ,
author = {Asudeh, Abolfazl and Jagadish, H. V. and Stoyanovich, Julia and Das, Gautam} ,
title = {Designing Fair Ranking Schemes} ,
booktitle = {Proceedings of the 2019 International Conference on the Management of
Data, {SIGMOD}} ,
pages = {1259--1276} ,
publisher = {{ACM}} ,
year = {2019} ,
doi = {10.1145/3299869.3300079} ,
timestamp = {Sat, 22 Jun 2019 17:10:04 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,fair,ranking} ,
author+an = {3=self}
}
MithraRanking: A System for Responsible Ranking Design
Yifan Guan, Abolfazl Asudeh, Pranav Mayuram, H. V. Jagadish, Julia Stoyanovich, Gerome Miklau, and Gautam Das
In Proceedings of the 2019 International Conference on the Management of Data, SIGMOD 2019
@inproceedings { DBLP:conf/sigmod/GuanAMJSM019 ,
author = {Guan, Yifan and Asudeh, Abolfazl and Mayuram, Pranav and Jagadish, H. V. and Stoyanovich, Julia and Miklau, Gerome and Das, Gautam} ,
title = {{M}ithra{R}anking: {A} System for Responsible Ranking Design} ,
booktitle = {Proceedings of the 2019 International Conference on the Management of
Data, {SIGMOD}} ,
pages = {1913--1916} ,
publisher = {{ACM}} ,
year = {2019} ,
doi = {10.1145/3299869.3320244} ,
timestamp = {Sat, 22 Jun 2019 17:10:04 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,fairness,ranking} ,
addendum = {demonstration}
}
The Responsibility Challenge for Data
H. V. Jagadish, Francesco Bonchi, Tina Eliassi-Rad, Lise Getoor, Krishna P. Gummadi, and Julia Stoyanovich
In Proceedings of the 2019 International Conference on the Management of Data, SIGMOD 2019
@inproceedings { DBLP:conf/sigmod/JagadishBEGGS19 ,
author = {Jagadish, H. V. and Bonchi, Francesco and Eliassi{-}Rad, Tina and Getoor, Lise and Gummadi, Krishna P. and Stoyanovich, Julia} ,
title = {The Responsibility Challenge for Data} ,
booktitle = {Proceedings of the 2019 International Conference on the Management of
Data, {SIGMOD}} ,
pages = {412--414} ,
publisher = {{ACM}} ,
year = {2019} ,
doi = {10.1145/3299869.3314327} ,
timestamp = {Sat, 22 Jun 2019 17:10:04 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data} ,
author+an = {6=self} ,
addendum = {plenary panel co-organizer and presenter} ,
}
Research Directions for Principles of Data Management, Dagstuhl Perspectives Workshop 16151)
Serge Abiteboul, Marcelo Arenas, Pablo Barceló, Meghyn Bienvenu, Diego Calvanese, Claire David, Richard Hull, Eyke Hüllermeier, Benny Kimelfeld, Leonid Libkin, Wim Martens, Tova Milo, Filip Mpdfak, Frank Neven, Magdalena Ortiz, Thomas Schwentick, Julia Stoyanovich, Jianwen Su, Dan Suciu, Victor Vianu, and Ke Yi
Dagstuhl Manifestos 2018
@article { DBLP:journals/dagstuhl-manifestos/AbiteboulABBCD018 ,
title = {Research Directions for Principles of Data Management, {D}agstuhl Perspectives
Workshop 16151)} ,
journal = {Dagstuhl Manifestos} ,
volume = {7} ,
number = {1} ,
pages = {1--29} ,
year = {2018} ,
doi = {10.4230/DagMan.7.1.1} ,
timestamp = {Tue, 21 May 2019 07:19:14 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data} ,
author+an = {17=self} ,
addendum = {workshop report contributor, by invitation}
}
On Obtaining Stable Rankings
Abolfazl Asudeh, H. V. Jagadish, Gerome Miklau, and Julia Stoyanovich
PVLDB 2018
@article { DBLP:journals/pvldb/AsudehJMS18 ,
author = {Asudeh, Abolfazl and Jagadish, H. V. and Miklau, Gerome and Stoyanovich, Julia} ,
title = {On Obtaining Stable Rankings} ,
journal = {PVLDB} ,
volume = {12} ,
number = {3} ,
pages = {237--250} ,
year = {2018} ,
doi = {10.14778/3291264.3291269} ,
timestamp = {Sat, 25 Apr 2020 13:58:47 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {journal,stable,ranking} ,
author+an = {4=self}
}
Panel: A Debate on Data and Algorithmic Ethics
Julia Stoyanovich, Bill Howe, H. V. Jagadish, and Gerome Miklau
PVLDB 2018
@article { DBLP:journals/pvldb/StoyanovichHJM18 ,
author = {Stoyanovich, Julia and Howe, Bill and Jagadish, H. V. and Miklau, Gerome} ,
title = {Panel: {A} Debate on Data and Algorithmic Ethics} ,
journal = {PVLDB} ,
volume = {11} ,
number = {12} ,
pages = {2165--2167} ,
year = {2018} ,
doi = {10.14778/3229863.3240494} ,
timestamp = {Sat, 25 Apr 2020 13:59:10 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data} ,
author+an = {1=self} ,
addendum = {plenary panel co-organizer and presenter}
}
Probabilistic Inference Over Repeated Insertion Models
Batya Kenig, Lovro Ilijasic, Haoyue Ping, Benny Kimelfeld, and Julia Stoyanovich
In Proceedings of the 32nd Conference on Artificial Intelligence, AAAI 2018
Online Set Selection with Fairness and Diversity Constraints
Julia Stoyanovich, Ke Yang, and H. V. Jagadish
In Proceedings of the 21th International Conference on Extending Database Technology, EDBT 2018
@inproceedings { DBLP:conf/edbt/StoyanovichYJ18 ,
author = {Stoyanovich, Julia and Yang, Ke and Jagadish, H. V.} ,
title = {Online Set Selection with Fairness and Diversity Constraints} ,
booktitle = {Proceedings of the 21th International Conference on Extending Database
Technology, {EDBT}} ,
pages = {241--252} ,
publisher = {OpenProceedings.org} ,
year = {2018} ,
doi = {10.5441/002/edbt.2018.22} ,
timestamp = {Fri, 16 Mar 2018 23:12:22 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,fair,ranking} ,
author+an = {1=self;2=self}
}
Computational Social Choice Meets Databases
Benny Kimelfeld, Phokion G. Kolaitis, and Julia Stoyanovich
In Proceedings of the 27th International Joint Conference on Artificial Intelligence, IJCAI 2018
Generating Evolving Property Graphs with Attribute-Aware Preferential Attachment
Amir Aghasadeghi, and Julia Stoyanovich
In Proceedings of the 7th International Workshop on Testing Database Systems, DBTest at SIGMOD 2018
A Query Engine for Probabilistic Preferences
Uzi Cohen, Batya Kenig, Haoyue Ping, Benny Kimelfeld, and Julia Stoyanovich
In Proceedings of the 2018 International Conference on the Management of Data, SIGMOD 2018
Special Session: A Technical Research Agenda in Data Ethics and Responsible Data Management
Julia Stoyanovich, Bill Howe, and H. V. Jagadish
In Proceedings of the 2018 International Conference on the Management of Data, SIGMOD 2018
@inproceedings { DBLP:conf/sigmod/StoyanovichHJ18 ,
author = {Stoyanovich, Julia and Howe, Bill and Jagadish, H. V.} ,
title = {Special Session: {A} Technical Research Agenda in Data Ethics and
Responsible Data Management} ,
booktitle = {Proceedings of the 2018 International Conference on the Management of
Data, {SIGMOD}} ,
publisher = {{ACM}} ,
year = {2018} ,
doi = {10.1145/3183713.3205185} ,
timestamp = {Wed, 21 Nov 2018 12:44:08 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data} ,
author+an = {1=self} ,
addendum = {co-organizer and presenter at this plenary panel}
}
A Nutritional Label for Rankings
Ke Yang, Julia Stoyanovich, Abolfazl Asudeh, Bill Howe, H. V. Jagadish, and Gerome Miklau
In Proceedings of the 2018 International Conference on the Management of Data, SIGMOD 2018
@inproceedings { DBLP:conf/sigmod/YangSAHJM18 ,
author = {Yang, Ke and Stoyanovich, Julia and Asudeh, Abolfazl and Howe, Bill and Jagadish, H. V. and Miklau, Gerome} ,
title = {A Nutritional Label for Rankings} ,
booktitle = {Proceedings of the 2018 International Conference on the Management of
Data, {SIGMOD}} ,
publisher = {{ACM}} ,
year = {2018} ,
doi = {10.1145/3183713.3193568} ,
timestamp = {Wed, 21 Nov 2018 12:44:08 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,ranking,explanability} ,
}
MobilityMirror: Bias-Adjusted Transportation Datasets
Luke Rodriguez, Babak Salimi, Haoyue Ping, Julia Stoyanovich, and Bill Howe
In Proceedings of the 1st Workshop on Big Social Data and Urban Computing, BiDU at VLDB 2018
Zooming in on NYC Taxi Data with Portal
Julia Stoyanovich, Matthew Gilbride, and Vera Zaychik Moffitt
In Poster Track of the 1st Workshop on Big Social Data and Urban Computing, BiDU at VLDB 2018
Diversity in Big Data: A Review
Marina Drosou, H. V. Jagadish, Evaggelia Pitoura, and Julia Stoyanovich
Big Data 2017
A Database Framework for Probabilistic Preferences
Batya Kenig, Benny Kimelfeld, Haoyue Ping, and Julia Stoyanovich
In Proceedings of the 11th Alberto Mendelzon International Workshop on Foundations of Data Management and the Web, AMW 2017
Automatically and Adaptively Determining Execution Plans for Queries with Parameter Markers
Wei Fan, Guy Lohman, Volker Markl, Nimrod Megiddo, Jun Rao, David Simmen, and Julia Stoyanovich
2011
Social Behavior Analysis and Inferring Social Networks for a Recommendation System
Sihem Amer-Yahia, Evgeniy Gabrilovic, Bo Pang, Julia Stoyanovich, and Cong Yu
2011
Temporal graph algebra
Vera Zaychik Moffitt, and Julia Stoyanovich
In Proceedings of The 16th International Symposium on Database Programming Languages, DBPL 2017
Querying Probabilistic Preferences in Databases
Batya Kenig, Benny Kimelfeld, Haoyue Ping, and Julia Stoyanovich
In Proceedings of the 36th Symposium on the Principles of Database Systems, PODS 2017
DataSynthesizer: Privacy-Preserving Synthetic Datasets
Haoyue Ping, Julia Stoyanovich, and Bill Howe
In Proceedings of the 29th International Conference on Scientific and Statistical Database Management, SSDBM 2017
@inproceedings { DBLP:conf/ssdbm/PingSH17 ,
author = {Ping, Haoyue and Stoyanovich, Julia and Howe, Bill} ,
title = {{DataSynthesizer}: Privacy-Preserving Synthetic Datasets} ,
booktitle = {Proceedings of the 29th International Conference on Scientific and
Statistical Database Management, {SSDBM}} ,
pages = {42:1--42:5} ,
publisher = {{ACM}} ,
year = {2017} ,
doi = {10.1145/3085504.3091117} ,
timestamp = {Tue, 06 Nov 2018 16:57:31 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,privacy} ,
author+an = {1=self;3=self}
}
Fides: Towards a Platform for Responsible Data Science
Julia Stoyanovich, Bill Howe, Serge Abiteboul, Gerome Miklau, Arnaud Sahuguet, and Gerhard Weikum
In Proceedings of the 29th International Conference on Scientific and Statistical Database Management, SSDBM 2017
@inproceedings { DBLP:conf/ssdbm/StoyanovichHAMS17 ,
author = {Stoyanovich, Julia and Howe, Bill and Abiteboul, Serge and Miklau, Gerome and Sahuguet, Arnaud and Weikum, Gerhard} ,
title = {Fides: Towards a Platform for Responsible Data Science} ,
booktitle = {Proceedings of the 29th International Conference on Scientific and
Statistical Database Management, {SSDBM}} ,
pages = {26:1--26:6} ,
publisher = {{ACM}} ,
year = {2017} ,
doi = {10.1145/3085504.3085530} ,
timestamp = {Tue, 06 Nov 2018 16:57:31 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,data} ,
author+an = {1=self}
}
Measuring Fairness in Ranked Outputs
Ke Yang, and Julia Stoyanovich
In Proceedings of the 29th International Conference on Scientific and Statistical Database Management, SSDBM 2017
@inproceedings { DBLP:conf/ssdbm/YangS17 ,
author = {Yang, Ke and Stoyanovich, Julia} ,
title = {Measuring Fairness in Ranked Outputs} ,
booktitle = {Proceedings of the 29th International Conference on Scientific and
Statistical Database Management, {SSDBM}} ,
pages = {22:1--22:6} ,
publisher = {{ACM}} ,
year = {2017} ,
doi = {10.1145/3085504.3085526} ,
timestamp = {Tue, 06 Nov 2018 16:57:31 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {fairness, ranking, data management} ,
author+an = {1=self;2=self}
}
Synthetic Data for Social Good
Bill Howe, Julia Stoyanovich, Haoyue Ping, Bernease Herman, and Matt Gee
Proceedings of Data for Good Exchange D4GX 2017
Data, Responsibly: Fairness, Neutrality and Transparency in Data Analysis
Julia Stoyanovich, Serge Abiteboul, and Gerome Miklau
In Proceedings of the 19th International Conference on Extending Database Technology, EDBT 2016
@inproceedings { DBLP:conf/edbt/StoyanovichAM16 ,
author = {Stoyanovich, Julia and Abiteboul, Serge and Miklau, Gerome} ,
title = {{Data, Responsibly}: Fairness, Neutrality and Transparency in Data Analysis} ,
booktitle = {Proceedings of the 19th International Conference on Extending Database
Technology, {EDBT}} ,
pages = {718--719} ,
publisher = {OpenProceedings.org} ,
year = {2016} ,
doi = {10.5441/002/edbt.2016.103} ,
timestamp = {Sun, 21 May 2017 00:19:15 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data,fair,expl} ,
author+an = {1=self} ,
addendum = {peer-reviewed tutorial}
}
Workload-driven learning of Mallows mixtures with pairwise preference data
Julia Stoyanovich, Lovro Ilijasic, and Haoyue Ping
In Proceedings of the 19th International Workshop on Web and Databases, WebDB at SIGMOD 2016
Towards a Distributed Infrastructure for Evolving Graph Analytics
Vera Zaychik Moffitt, and Julia Stoyanovich
In Proceedings of the 6th Temporal Web Analytics Workshop, TempWeb at WWW 2016
The Elephant in the Room: Getting Value from Big Data
Serge Abiteboul, Xin Luna Dong, Oren Etzioni, Divesh Srivastava, Gerhard Weikum, Julia Stoyanovich, and Fabian M. Suchanek
In Proceedings of the 18th International Workshop on Web and Databases, WebDB at SIGMOD 2015
@inproceedings { DBLP:conf/webdb/AbiteboulDESWSS15 ,
author = {Abiteboul, Serge and Dong, Xin Luna and Etzioni, Oren and Srivastava, Divesh and Weikum, Gerhard and Stoyanovich, Julia and Suchanek, Fabian M.} ,
title = {The Elephant in the Room: Getting Value from Big Data} ,
booktitle = {Proceedings of the 18th International Workshop on Web and Databases, {WebDB} at {SIGMOD}} ,
pages = {1--5} ,
publisher = {{ACM}} ,
year = {2015} ,
doi = {10.1145/2767109.2770014} ,
timestamp = {Tue, 06 Nov 2018 16:58:14 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {public,data} ,
author+an = {6=self} ,
addendum = {editorial in WebDB 2015 proceedings}
}
Analyzing Crowd Rankings
Julia Stoyanovich, Marie Jacob, and Xuemei Gong
In Proceedings of the 18th International Workshop on Web and Databases, WebDB at SIGMOD 2015
Data, Responsibly (Dagstuhl Seminar 16291)
Serge Abiteboul, Gerome Miklau, Julia Stoyanovich, and Gerhard Weikum
Dagstuhl Reports 2016
@article { DBLP:journals/dagstuhl-reports/AbiteboulMSW16 ,
author = {Abiteboul, Serge and Miklau, Gerome and Stoyanovich, Julia and Weikum, Gerhard} ,
title = {{Data, Responsibly (Dagstuhl Seminar 16291)}} ,
journal = {Dagstuhl Reports} ,
volume = {6} ,
number = {7} ,
pages = {42--71} ,
year = {2016} ,
doi = {10.4230/DagRep.6.7.42} ,
timestamp = {Wed, 07 Jun 2017 14:40:01 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {panel,data} ,
author+an = {3=self} ,
addendum = {workshop co-chair, authors in alphabetical order}
}
Collaborative Access Control in WebdamLog
Vera Zaychik Moffitt, Julia Stoyanovich, Serge Abiteboul, and Gerome Miklau
In Proceedings of the 2015 International Conference on the Management of Data, SIGMOD 2015
A System for Management and Analysis of Preference Data
Marie Jacob, Benny Kimelfeld, and Julia Stoyanovich
PVLDB 2014
Understanding Local Structure in Ranked Datasets
Julia Stoyanovich, Sihem Amer-Yahia, Susan B. Davidson, Marie Jacob, and Tova Milo
In Proceedings of 6th Biennial Conference on Innovative Data Systems Research, CIDR 2013
@inproceedings { DBLP:conf/cidr/StoyanovichADJM13 ,
author = {Stoyanovich, Julia and Amer{-}Yahia, Sihem and Davidson, Susan B. and Jacob, Marie and Milo, Tova} ,
title = {Understanding Local Structure in Ranked Datasets} ,
booktitle = {Proceedings of 6th Biennial Conference on Innovative Data Systems Research, {CIDR}} ,
publisher = {www.cidrdb.org} ,
year = {2013} ,
timestamp = {Thu, 12 Mar 2020 11:32:33 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,pref,ranking} ,
author+an = {1=self}
}
Learning Feature Weights from Positive Cases
Sidath Gunawardena, Rosina O. Weber, and Julia Stoyanovich
In Proceedings of 21st International Conference on Case-Based Reasoning Research and Development, ICCBR 2013
Rule-based application development using Webdamlog
Serge Abiteboul, Antoine, Gerome Miklau, Julia Stoyanovich, and Jules Testard
In Proceedings of the 2013 International Conference on the Management of Data, SIGMOD 2013
Search and result presentation in scientific workflow repositories
Susan B. Davidson, Xiaocheng Huang, Julia Stoyanovich, and Xiaojie Yuan
In Proceedings of the Conference on Scientific and Statistical Database Management, SSDBM 2013
Learning to explore scientific workflow repositories
Julia Stoyanovich, Paramveer S. Dhillon, Susan B. Davidson, and Brian Lyons
In Proceedings of the Conference on Scientific and Statistical Database Management, SSDBM 2013
Viewing the Web as a Distributed Knowledge Base
Serge Abiteboul, Antoine, and Julia Stoyanovich
In Proceedings of the 28th International Conference on Data Engineering, ICDE 2012
AnnotCompute: Annotation-based exploration and meta-analysis of genomics experiments
Jie Zheng, Julia Stoyanovich, Elisabetta Manduchi, Junmin Liu, and Christian J. Stoeckert Jr.
Database 2011
Putting Lipstick on Pig: Enabling Database-style Workflow Provenance
Yael Amsterdamer, Susan B. Davidson, Daniel Deutch, Tova Milo, Julia Stoyanovich, and Val Tannen
PVLDB 2011
Keyword Search in Workflow Repositories with Access Control
Susan B. Davidson, Soohyun Lee, and Julia Stoyanovich
In Proceedings of the 5th Alberto Mendelzon International Workshop on Foundations of Data Management, AMW 2011
Enabling Privacy in Provenance-Aware Workflow Systems
Susan B. Davidson, Sanjeev Khanna, Val Tannen, Sudeepa Roy, Julia Stoyanovich, Yi Chen, and Tova Milo
In Proceedings of the 5th Biennial Conference on Innovative Data Systems Research, CIDR 2011
Making interval-based clustering rank-aware
Julia Stoyanovich, Sihem Amer-Yahia, and Tova Milo
In Proceedings of the 14th International Conference on Extending Database Technology, EDBT 2011
@inproceedings { DBLP:conf/edbt/StoyanovichAM11 ,
author = {Stoyanovich, Julia and Amer{-}Yahia, Sihem and Milo, Tova} ,
title = {Making interval-based clustering rank-aware} ,
booktitle = {Proceedings of the 14th International Conference on Extending Database Technology, {EDBT}} ,
pages = {437--448} ,
publisher = {{ACM}} ,
year = {2011} ,
doi = {10.1145/1951365.1951417} ,
timestamp = {Tue, 06 Nov 2018 16:59:06 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,ranking,fairness} ,
author+an = {1=self}
}
Deriving probabilistic databases with inference ensembles
Julia Stoyanovich, Susan B. Davidson, Tova Milo, and Val Tannen
In Proceedings of the 27th International Conference on Data Engineering, ICDE 2011
On provenance and privacy
Susan B. Davidson, Sanjeev Khanna, Sudeepa Roy, Julia Stoyanovich, Val Tannen, and Yi Chen
In Proceedings of the 14th International Conference on Database Theory, ICDT 2011
SkylineSearch: semantic ranking and result visualization for PubMed
Julia Stoyanovich, Mayur Lodha, William Mee, and Kenneth A. Ross
In Proceedings of the 2011 International Conference on the Management of Data, SIGMOD 2011
@inproceedings { DBLP:conf/sigmod/StoyanovichLMR11 ,
author = {Stoyanovich, Julia and Lodha, Mayur and Mee, William and Ross, Kenneth A.} ,
title = {{SkylineSearch}: semantic ranking and result visualization for {PubMed}} ,
booktitle = {Proceedings of the 2011 International Conference on the Management
of Data, {SIGMOD}} ,
pages = {1247--1250} ,
publisher = {{ACM}} ,
year = {2011} ,
doi = {10.1145/1989323.1989467} ,
timestamp = {Tue, 06 Nov 2018 11:07:37 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,ranking} ,
author+an = {1=self}
}
Semantic ranking and result visualization for life sciences publications
Julia Stoyanovich, William Mee, and Kenneth A. Ross
In Proceedings of the 26th International Conference on Data Engineering, ICDE 2010
@inproceedings { DBLP:conf/icde/StoyanovichMR10 ,
author = {Stoyanovich, Julia and Mee, William and Ross, Kenneth A.} ,
title = {Semantic ranking and result visualization for life sciences publications} ,
booktitle = {Proceedings of the 26th International Conference on Data Engineering,
{ICDE}} ,
publisher = {{IEEE} Computer Society} ,
year = {2010} ,
doi = {10.1109/ICDE.2010.5447931} ,
timestamp = {Wed, 16 Oct 2019 14:14:56 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,ranking} ,
author+an = {1=self}
}
Rank-aware clustering of structured datasets
Julia Stoyanovich, and Sihem Amer-Yahia
In Proceedings of the 18th Conference on Information and Knowledge Management, CIKM 2009
@inproceedings { DBLP:conf/cikm/StoyanovichA09 ,
author = {Stoyanovich, Julia and Amer{-}Yahia, Sihem} ,
title = {Rank-aware clustering of structured datasets} ,
booktitle = {Proceedings of the 18th Conference on Information and Knowledge
Management, {CIKM}} ,
pages = {1429--1432} ,
publisher = {{ACM}} ,
year = {2009} ,
doi = {10.1145/1645953.1646137} ,
timestamp = {Tue, 06 Nov 2018 16:57:46 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {conference,ranking,fairness} ,
author+an = {1=self}
}
Epistemic Parity: Reproducibility as an Evaluation Metric for Differential Privacy
Lucas Rosenblatt, Bernease Herman, Anastasia Holovenko, Wonkwon Lee, Joshua R. Loftus, Elizabeth Mckinnie, Taras Rumezhak, Andrii Stadnik, Bill Howe, and Julia Stoyanovich
Proc. VLDB Endow. 2023
@article { DBLP:journals/pvldb/RosenblattHHLLM23 ,
author = {Rosenblatt, Lucas and Herman, Bernease and Holovenko, Anastasia and Lee, Wonkwon and Loftus, Joshua R. and Mckinnie, Elizabeth and Rumezhak, Taras and Stadnik, Andrii and Howe, Bill and Stoyanovich, Julia} ,
title = {Epistemic Parity: Reproducibility as an Evaluation Metric for Differential
Privacy} ,
journal = {Proc. {VLDB} Endow.} ,
volume = {16} ,
number = {11} ,
pages = {3178--3191} ,
year = {2023} ,
doi = {10.14778/3611479.3611517} ,
timestamp = {Mon, 23 Oct 2023 16:16:16 +0200} ,
biburl = {https://dblp.org/rec/journals/pvldb/RosenblattHHLLM23.bib} ,
keywords = {journal,privacy,RAIforUkraine} ,
author+an = {1=self;3=self;4=self;6=self;7=self;8=self;10=self}
}
Efficient network aware search in collaborative tagging sites
Sihem Amer-Yahia, Michael Benedikt, Laks V. S. Lakshmanan, and Julia Stoyanovich
PVLDB 2008
Leveraging Tagging to Model User Interests in del.icio.us
Julia Stoyanovich, Sihem Amer-Yahia, Cameron Marlow, and Cong Yu
In Proceedings of the Spring Symposium on Social Information Processing 2008
Schema polynomials and applications
Kenneth A. Ross, and Julia Stoyanovich
In Proceedings of the 11th International Conference on Extending Database Technology, EDBT 2008
From del.icio.us to x.qui.site: recommendations in social tagging sites
Sihem Amer-Yahia, Alban Galland, Julia Stoyanovich, and Cong Yu
In Proceedings of the 2008 International Conference on the Management of Data, SIGMOD 2008
EntityAthority: Semantically Enriched Graph-Based Authority Propagation
Julia Stoyanovich, Srikanta J. Bedathur, Klaus Berberich, and Gerhard Weikum
In Proceedings of the 10th International Workshop on the Web and Databases, WebDB at SIGMOD 2007
A Faceted Query Engine Applied to Archaeology
Kenneth A. Ross, Angel Janevski, and Julia Stoyanovich
In Proceedings of the 31st International Conference on Very Large Data Bases, VLDB 2005
Symmetric Relations and Cardinality-Bounded Multisets in Database Systems
Kenneth A. Ross, and Julia Stoyanovich
In Proceedings of the 30th International Conference on Very Large Data Bases, VLDB 2004
A Faceted Query Engine Applied to Archaeology
Kenneth A. Ross, Angel Janevski, and Julia Stoyanovich
Internet Archaeology 2007
TransFAT: Translating Fairness, Accountability, and Transparency into Data Science Practice
Julia Stoyanovich
In Proceedings of the 1st International Workshop on Processing Information Ethically, PIE at CAiSE 2019
@inproceedings { DBLP:conf/caise/Stoyanovich19 ,
author = {Stoyanovich, Julia} ,
title = {TransFAT: Translating Fairness, Accountability, and Transparency into
Data Science Practice} ,
booktitle = {Proceedings of the 1st International Workshop on Processing Information
Ethically, {PIE} at {CAiSE}} ,
series = {{CEUR} Workshop Proceedings} ,
volume = {2417} ,
publisher = {CEUR-WS.org} ,
year = {2019} ,
timestamp = {Wed, 12 Feb 2020 16:44:33 +0100} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {invited,data} ,
author+an = {1=self}
}
Towards sequenced semantics for evolving graphs
Vera Zaychik Moffitt, and Julia Stoyanovich
In Proceedings of the 20th International Conference on Extending Database Technology, EDBT 2017
Follow the Data! Algorithmic Transparency Starts with Data Transparency
Julia Stoyanovich, and Bill Howe
The Ethical Machine Nov 2018
@article { Follow ,
title = {Follow the Data! {A}lgorithmic Transparency Starts with Data Transparency} ,
author = {Stoyanovich, Julia and Howe, Bill} ,
journal = {The Ethical Machine} ,
year = {2018} ,
month = nov ,
day = {27} ,
publisher = {Shorenstein Center on Media, Politics, and Public Policy, Harvard Kennedy School} ,
keywords = {public,data,explainability,policy} ,
author+an = {1=self}
}
MobilityMirror: Bias-Adjusted Transportation Datasets
Luke Rodriguez, Babak Salimi, Haoyue Ping, Julia Stoyanovich, and Bill Howe
In Big Social Data and Urban Computing - First Workshop, BiDU@VLDB 2018, Rio de Janeiro, Brazil, August 31, 2018, Revised Selected Papers Nov 2018
@inproceedings { DBLP:conf/vldb/RodriguezSPSH19 ,
author = {Rodriguez, Luke and Salimi, Babak and Ping, Haoyue and Stoyanovich, Julia and Howe, Bill} ,
editor = {Oliveira, Jonice and de Farias, Claudio M. and Pacitti, Esther and Fortino, Giancarlo} ,
title = {MobilityMirror: Bias-Adjusted Transportation Datasets} ,
booktitle = {Big Social Data and Urban Computing - First Workshop, BiDU@VLDB 2018,
Rio de Janeiro, Brazil, August 31, 2018, Revised Selected Papers} ,
series = {Communications in Computer and Information Science} ,
volume = {926} ,
pages = {18--39} ,
publisher = {Springer} ,
year = {2018} ,
url = {https://doi.org/10.1007/978-3-030-11238-7_2} ,
doi = {10.1007/978-3-030-11238-7_2} ,
keywords = {privacy} ,
timestamp = {Tue, 29 Jan 2019 14:00:34 +0100} ,
biburl = {https://dblp.org/rec/conf/vldb/RodriguezSPSH18.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org}
}
What is AI?
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol1 ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {What is AI?} ,
journal = {We are AI Comic Series} ,
volume = {1} ,
year = {2021} ,
keywords = {public,education,comics,english} ,
}
What is AI? (Spanish Edition)
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol1_sp ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {What is AI? (Spanish Edition)} ,
journal = {We are AI Comic Series} ,
volume = {1} ,
year = {2021} ,
keywords = {public,education,comics,spanish} ,
}
What is AI? (Greek Edition)
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol1_gr ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {What is AI? (Greek Edition)} ,
journal = {We are AI Comic Series} ,
volume = {1} ,
year = {2021} ,
keywords = {public,education,comics,other} ,
}
Learning from data
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol2 ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {Learning from data} ,
journal = {We are AI Comic Series} ,
volume = {2} ,
year = {2021} ,
keywords = {public,education,comics,english} ,
}
Learning from data (Spanish Edition)
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol2_sp ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {Learning from data (Spanish Edition)} ,
journal = {We are AI Comic Series} ,
volume = {2} ,
year = {2021} ,
keywords = {public,education,comics,spanish} ,
}
Who lives, who dies, who decides?
Julia Stoyanovich, Mona Sloane, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol3 ,
author = {Stoyanovich, Julia and Sloane, Mona and Khan, Falaah Arif} ,
title = {Who lives, who dies, who decides?} ,
journal = {We are AI Comic Series} ,
volume = {3} ,
year = {2021} ,
keywords = {public,education,comics,english} ,
}
Who lives, who dies, who decides? (Spanish Edition)
Julia Stoyanovich, Mona Sloane, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol3_sp ,
author = {Stoyanovich, Julia and Sloane, Mona and Khan, Falaah Arif} ,
title = {Who lives, who dies, who decides? (Spanish Edition)} ,
journal = {We are AI Comic Series} ,
volume = {3} ,
year = {2021} ,
keywords = {public,education,comics,spanish} ,
}
All about that bias
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol4 ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {All about that bias} ,
journal = {We are AI Comic Series} ,
volume = {4} ,
year = {2021} ,
keywords = {public,education,comics,english}
}
All about that bias (Spanish Edition
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol4_sp ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {All about that bias (Spanish Edition} ,
journal = {We are AI Comic Series} ,
volume = {4} ,
year = {2021} ,
keywords = {public,education,comics,spanish}
}
We are AI
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol5 ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {We are AI} ,
journal = {We are AI Comic Series} ,
volume = {5} ,
year = {2021} ,
keywords = {public,education,comics,english} ,
}
We are AI
Julia Stoyanovich, and Falaah Arif Khan
We are AI Comic Series Nov 2021
@article { weareaicomic_vol5_sp ,
author = {Stoyanovich, Julia and Khan, Falaah Arif} ,
title = {We are AI} ,
journal = {We are AI Comic Series} ,
volume = {5} ,
year = {2021} ,
keywords = {public,education,comics,english} ,
}
Mirror, Mirror
Falaah Arif Khan, and Julia Stoyanovich
Data, Responsibly Comic Series Nov 2020
@article { rdscomic_vol1 ,
author = {Khan, Falaah Arif and Stoyanovich, Julia} ,
title = {Mirror, Mirror} ,
journal = {Data, Responsibly Comic Series} ,
volume = {1} ,
year = {2020} ,
keywords = {public,edu,comics,english} ,
}
Mirror, Mirror (French Edition)
Falaah Arif Khan, and Julia Stoyanovich
Data, Responsibly Comic Series Nov 2020
@article { rdscomic_vol1_fr ,
author = {Khan, Falaah Arif and Stoyanovich, Julia} ,
title = {Mirror, Mirror (French Edition)} ,
journal = {Data, Responsibly Comic Series} ,
volume = {1} ,
year = {2020} ,
keywords = {public,edu,comics,other} ,
}
Mirror, Mirror (Spanish Edition)
Falaah Arif Khan, and Julia Stoyanovich
Data, Responsibly Comic Series Nov 2020
@article { rdscomic_vol1_sp ,
author = {Khan, Falaah Arif and Stoyanovich, Julia} ,
title = {Mirror, Mirror (Spanish Edition)} ,
journal = {Data, Responsibly Comic Series} ,
volume = {1} ,
year = {2020} ,
keywords = {public,edu,comics,spanish} ,
}
Mirror, Mirror (Portugueze Edition)
Falaah Arif Khan, and Julia Stoyanovich
Data, Responsibly Comic Series Nov 2020
@article { rdscomic_vol1_br ,
author = {Khan, Falaah Arif and Stoyanovich, Julia} ,
title = {Mirror, Mirror (Portugueze Edition)} ,
journal = {Data, Responsibly Comic Series} ,
volume = {1} ,
year = {2020} ,
keywords = {public,edu,comics,other} ,
}
Fairness and Friends
Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich
Data, Responsibly Comic Series Nov 2021
@article { rdscomic_Vol2 ,
author = {Khan, Falaah Arif and Manis, Eleni and Stoyanovich, Julia} ,
title = {Fairness and Friends} ,
journal = {Data, Responsibly Comic Series} ,
volume = {2} ,
year = {2021} ,
keywords = {public,edu,comics,english} ,
}
Revealing Algorithmic Rankers
Julia Stoyanovich, and Ellen P. Goodman
Freedom to Tinker, Center for Information Technology Policy, Princeton University Aug 2016
@article { citp_1 ,
author = {Stoyanovich, Julia and Goodman, Ellen P.} ,
title = {Revealing Algorithmic Rankers} ,
journal = {Freedom to Tinker, Center for Information Technology Policy, Princeton University} ,
year = {2016} ,
month = aug ,
day = {5} ,
keywords = {public,ranking,explainability} ,
author+an = {1=self}
}
Analyzing Crowd Rankings
Julia Stoyanovich, Marie Jacob, and Xuemei Gong
In Proceedings of the 18th International Workshop on Web and Databases, Melbourne, VIC, Australia, May 31, 2015 Aug 2015
@inproceedings { DBLP:conf/webdb/StoyanovichJG16 ,
author = {Stoyanovich, Julia and Jacob, Marie and Gong, Xuemei} ,
editor = {Stoyanovich, Julia and Suchanek, Fabian M.} ,
title = {Analyzing Crowd Rankings} ,
booktitle = {Proceedings of the 18th International Workshop on Web and Databases,
Melbourne, VIC, Australia, May 31, 2015} ,
pages = {41--47} ,
keywords = {ranking} ,
publisher = {{ACM}} ,
year = {2015} ,
url = {https://doi.org/10.1145/2767109.2767110} ,
doi = {10.1145/2767109.2767110} ,
timestamp = {Tue, 06 Nov 2018 16:58:14 +0100} ,
biburl = {https://dblp.org/rec/conf/webdb/StoyanovichJG15.bib} ,
bibsource = {dblp computer science bibliography, https://dblp.org}
}
Refining the Concept of a Nutritional Label for Data and Models
Julia Stoyanovich, and Bill Howe
Freedom to Tinker, Center for Information Technology Policy, Princeton University May 2018
@article { citp_2 ,
author = {Stoyanovich, Julia and Howe, Bill} ,
title = {Refining the Concept of a Nutritional Label for Data and Models} ,
journal = {Freedom to Tinker, Center for Information Technology Policy, Princeton University} ,
year = {2018} ,
month = may ,
day = {3} ,
keywords = {public,ranking,explainability} ,
}
The Data, Responsibly Manifesto
Serge Abiteboul, and Julia Stoyanovich
ACM SIGMOD blog Nov 2015
@article { manifesto ,
author = {Abiteboul, Serge and Stoyanovich, Julia} ,
title = {The Data, Responsibly Manifesto} ,
year = {2015} ,
month = nov ,
day = {20} ,
keywords = {public,data} ,
author+an = {2=self}
}
Search and Ranking in Semantically Rich Applications
Julia Stoyanovich
Nov 2010
Temporal Regular Path Queries
Marcelo Arenas, Pedro Bahamondes, Amir Aghasaedeghi, and Julia Stoyanovich
In Proceedings of the 38th International Conference on Data Engineering, ICDE Nov 2022
Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines
Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich
In Equity and Access in Algorithms, Mechanisms, and Optimization, EAAMO 2022, Arlington, VA, USA, October 6-9, 2022 Nov 2022
Disaggregated Interventions to Reduce Inequality
Lucius Bynum, Joshua R. Loftus, and Julia Stoyanovich
In EAAMO 2021: ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, Virtual Event, USA, October 5 - 9, 2021 Nov 2021
Resume Format, LinkedIn pdfs and Other Unexpected Influences on AI Personality Prediction in Hiring: Results of an Audit
Alene K. Rhea, Kelsey Markey, Lauren D’Arinzo, Hilke Schellmann, Mona Sloane, Paul Squires, and Julia Stoyanovich
In Proceedings of the Fifth AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES) Nov 2022
@inproceedings { hiringaudit ,
author = {Rhea, Alene K. and Markey, Kelsey and D'Arinzo, Lauren and Schellmann, Hilke and Sloane, Mona and Squires, Paul and Stoyanovich, Julia} ,
year = {2022} ,
booktitle = {Proceedings of the Fifth AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES)} ,
keywords = {conference,stab,audit,hiring} ,
}
An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring
Alene K. Rhea, Kelsey Markey, Lauren D’Arinzo, Hilke Schellmann, Mona Sloane, Paul Squires, Falaah Arif Khan, and Julia Stoyanovich
Data Mining and Knowledge Discovery, Special Issue on Bias and Fairness in AI Nov 2022
@article { hiringaudit_journal ,
author = {Rhea, Alene K. and Markey, Kelsey and D'Arinzo, Lauren and Schellmann, Hilke and Sloane, Mona and Squires, Paul and {Arif Khan}, Falaah and Stoyanovich, Julia} ,
title = {An External Stability Audit Framework to Test the Validity of Personality Prediction in AI Hiring} ,
year = {2022} ,
journal = {Data Mining and Knowledge Discovery, Special Issue on Bias and Fairness in AI} ,
keywords = {journal,stab,audit,hiring} ,
}
COVID-19 Brings Data Equity Challenges to the Fore
H. V. Jagadish, Julia Stoyanovich, and Bill Howe
Digit. Gov. Res. Pract. Nov 2021
@article { DBLP:journals/dgov/JagadishSH21 ,
author = {Jagadish, H. V. and Stoyanovich, Julia and Howe, Bill} ,
title = {{COVID-19} Brings Data Equity Challenges to the Fore} ,
journal = {Digit. Gov. Res. Pract.} ,
volume = {2} ,
number = {2} ,
pages = {24:1--24:7} ,
year = {2021} ,
doi = {10.1145/3440889} ,
keywords = {journal,data,fairness} ,
}
Fairness in Ranking, Part I: Score-Based Ranking
Meike Zehlike, Ke Yang, and Julia Stoyanovich
ACM Computing Surveys Nov 2023
@article { 10.1145/3533379 ,
author = {Zehlike, Meike and Yang, Ke and Stoyanovich, Julia} ,
title = {Fairness in Ranking, Part I: Score-Based Ranking} ,
journal = {{ACM} Computing Surveys} ,
volume = {55} ,
number = {6} ,
pages = {118:1--118:36} ,
year = {2023} ,
doi = {10.1145/3533379} ,
keywords = {journal,fair,ranking} ,
author+an = {2=self;3=self} ,
}
Fairness in Ranking, Part II: Learning-to-Rank and Recommender Systems
Meike Zehlike, Ke Yang, and Julia Stoyanovich
ACM Computing Surveys Nov 2023
@article { 10.1145/3533380 ,
author = {Zehlike, Meike and Yang, Ke and Stoyanovich, Julia} ,
title = {Fairness in Ranking, Part II: Learning-to-Rank and Recommender Systems} ,
journal = {{ACM} Computing Surveys} ,
volume = {55} ,
number = {6} ,
pages = {117:1--117:41} ,
year = {2023} ,
doi = {10.1145/3533380} ,
keywords = {journal,fair,ranking} ,
}
Fairness-Aware Instrumentation of Preprocessing Pipelines for Machine Learning
Ke Yang, Biao Huang, Julia Stoyanovich, and Sebastian Schelter
In Proceedings of the Workshop on Human-In-the-Loop Data Analytics, HILDA at SIGMOD Nov 2020
@inproceedings { DBLP:hilda20 ,
author = {Yang, Ke and Huang, Biao and Stoyanovich, Julia and Schelter, Sebastian} ,
title = {Fairness-Aware Instrumentation of Preprocessing~Pipelines for Machine Learning} ,
booktitle = {Proceedings of the Workshop on Human-In-the-Loop Data Analytics, {HILDA} at {SIGMOD}} ,
year = {2020} ,
doi = {https://doi.org/10.1145/3398730.3399194} ,
keywords = {workshop,data,fairness} ,
}
Lightweight Inspection of Data Preprocessing in Native Machine Learning Pipelines
Stefan Grafberger, Julia Stoyanovich, and Sebastian Schelter
In CIDR 2021, 11th Conference on Innovative Data Systems Research, Online Proceedings Nov 2021
@inproceedings { cidr21 ,
author = {Grafberger, Stefan and Stoyanovich, Julia and Schelter, Sebastian} ,
title = {Lightweight Inspection of Data Preprocessing in~Native~Machine~Learning~Pipelines} ,
booktitle = {{CIDR} 2021, 11th Conference on Innovative Data Systems Research, Online Proceedings} ,
publisher = {www.cidrdb.org} ,
year = {2021} ,
keywords = {conference,data} ,
author+an = {1=self;2=self}
}
Taming Technical Bias in Machine Learning Pipelines
Sebastian Schelter, and Julia Stoyanovich
IEEE Data Eng. Bull. Nov 2020
@article { debull21 ,
author = {Schelter, Sebastian and Stoyanovich, Julia} ,
title = {Taming Technical Bias in Machine Learning Pipelines} ,
journal = {{IEEE} Data Eng. Bull.} ,
year = {2020} ,
volume = {43} ,
number = {4} ,
keywords = {journal,data,fairness} ,
author+an = {2=self} ,
}
Data Distribution Debugging in Machine Learning Pipelines
Stefan Grafberger, Paul Groth, Julia Stoyanovich, and Sebastian Schelter
The VLDB Journal — The International Journal on Very Large Data Bases (Special Issue on Data Science for Responsible Data Management Nov 2021
@article { grafberger22 ,
author = {Grafberger, Stefan and Groth, Paul and Stoyanovich, Julia and Schelter, Sebastian} ,
year = {2021} ,
title = {Data Distribution Debugging in Machine Learning Pipelines} ,
journal = {The VLDB Journal — The International Journal on Very Large Data Bases (Special Issue on Data Science for Responsible Data Management} ,
doi = {10.1007/s00778-021-00726-w} ,
keywords = {journal,data} ,
author+an = {3=self}
}
Algorithmic Techniques for Necessary and Possible Winners
Vishal Chakraborty, Theo Delemazure, Benny Kimelfeld, Phokion G. Kolaitis, Kunal Relia, and Julia Stoyanovich
ACM/IMS Trans. Data Sci. Jul 2021
Causal Intersectionality and Fair Ranking
Ke Yang, Joshua Loftus, and Julia Stoyanovich
In Symposium on the Foundations of Responsible Computing FORC Jul 2021
@inproceedings { forc21 ,
author = {Yang, Ke and Loftus, Joshua and Stoyanovich, Julia} ,
title = {Causal Intersectionality and Fair Ranking} ,
booktitle = {Symposium on the Foundations of Responsible Computing {FORC}} ,
year = {2021} ,
doi = {10.4230/LIPIcs.FORC.2021.7} ,
keywords = {conference,fair,ranking} ,
author+an = {1=self;3=self}
}
Comparing Apples and Oranges: Fairness and Diversity in Ranking (Invited Talk)
Julia Stoyanovich
In 24th International Conference on Database Theory, ICDT 2021, March 23-26, 2021, Nicosia, Cyprus Jul 2021
@inproceedings { DBLP:conf/icdt/Stoyanovich21 ,
author = {Stoyanovich, Julia} ,
editor = {Yi, Ke and Wei, Zhewei} ,
title = {Comparing Apples and Oranges: Fairness and Diversity in Ranking (Invited
Talk)} ,
booktitle = {24th International Conference on Database Theory, {ICDT} 2021, March
23-26, 2021, Nicosia, Cyprus} ,
series = {LIPIcs} ,
volume = {186} ,
pages = {2:1--2:1} ,
publisher = {Schloss Dagstuhl - Leibniz-Zentrum f{\"{u}}r Informatik} ,
year = {2021} ,
doi = {10.4230/LIPIcs.ICDT.2021.2} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {invited,fairness,ranking} ,
author+an = {1=self} ,
}
Responsible Data Management
Julia Stoyanovich, Serge Abiteboul, Bill Howe, H. V. Jagadish, and Sebastian Schelter
Communications of the ACM Jul 2022
@article { DBLP:journals/cacm/StoyanovichAHJS22 ,
author = {Stoyanovich, Julia and Abiteboul, Serge and Howe, Bill and Jagadish, H. V. and Schelter, Sebastian} ,
title = {Responsible Data Management} ,
journal = {Communications of the {ACM}} ,
volume = {65} ,
number = {6} ,
pages = {64--74} ,
year = {2022} ,
doi = {10.1145/3488717} ,
timestamp = {Wed, 25 May 2022 10:40:29 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {data} ,
author+an = {1=self} ,
}
Teaching Responsible Data Science
Julia Stoyanovich
In Proceedings of the 1st ACM SIGMOD International Workshop on Data Systems Education: Bridging Education Practice with Education Research, DataEd@SIGMOD 2022, 17 June 2022, Philadelphia, PA, USA Jul 2022
@inproceedings { DBLP:conf/dataed/Stoyanovich22 ,
author = {Stoyanovich, Julia} ,
editor = {Aivaloglou, Efthimia and Fletcher, George and Miedema, Daphne} ,
title = {Teaching Responsible Data Science} ,
booktitle = {Proceedings of the 1st {ACM} {SIGMOD} International Workshop on Data
Systems Education: Bridging Education Practice with Education Research,
DataEd@SIGMOD 2022, 17 June 2022, Philadelphia, PA, {USA}} ,
pages = {4--9} ,
publisher = {{ACM}} ,
year = {2022} ,
doi = {10.1145/3531072.3535318} ,
timestamp = {Wed, 29 Jun 2022 12:08:29 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {invited,education} ,
}
Teaching Responsible Data Science
Armanda Lewis, and Julia Stoyanovich
International Journal of Artificial Intelligence in Education (IJAIED) Jul 2022
@article { LewisStoyanovich21 ,
author = {Lewis, Armanda and Stoyanovich, Julia} ,
title = {Teaching Responsible Data Science} ,
journal = {International Journal of Artificial Intelligence in Education (IJAIED)} ,
volume = {32} ,
number = {3} ,
pages = {783--807} ,
year = {2022} ,
keywords = {journal,education,rds} ,
addendum = {Special Issue: The FATE of AI in Education: Fairness, Accountability, Transparency, and Ethics} ,
doi = {https://doi.org/10.1007/s40593-021-00241-7} ,
site = {https://dataresponsibly.github.io/rds/} ,
}
It’s Just Not That Simple: An Empirical Study of the Accuracy-Explainability Trade-off in Machine Learning for Public Policy
Andrew Bell, Ian Solano-Kamaiko, Oded Nov, and Julia Stoyanovich
In Proceedings of the 5th Annual ACM Conference on Fairness, Accountability, and Transparency, FAccT Jul 2022
@inproceedings { DBLP:conf/fat/BellSNS22 ,
author = {Bell, Andrew and Solano{-}Kamaiko, Ian and Nov, Oded and Stoyanovich, Julia} ,
title = {It's Just Not That Simple: An Empirical Study of the Accuracy-Explainability
Trade-off in Machine Learning for Public Policy} ,
booktitle = {Proceedings of the 5th Annual {ACM} Conference on Fairness, Accountability, and
Transparency, {FAccT}} ,
pages = {248--266} ,
publisher = {{ACM}} ,
year = {2022} ,
doi = {10.1145/3531146.3533090} ,
timestamp = {Wed, 22 Jun 2022 10:20:30 +0200} ,
bibsource = {dblp computer science bibliography, https://dblp.org} ,
keywords = {explainability, transparency, policy,governance} ,
}
Developing data capability with non-profit organisations using participatory methods
Anthony McCosker, Xiaofang Yao, Kath Albury, Alexia Maddox, Jane Farmer, and Julia Stoyanovich
Big Data & Society Jul 2022
@article { doi:10.1177/20539517221099882 ,
author = {McCosker, Anthony and Yao, Xiaofang and Albury, Kath and Maddox, Alexia and Farmer, Jane and Stoyanovich, Julia} ,
title = {Developing data capability with non-profit organisations using participatory methods} ,
journal = {Big Data \& Society} ,
volume = {9} ,
number = {1} ,
pages = {20539517221099882} ,
year = {2022} ,
doi = {10.1177/20539517221099882} ,
eprint = {https://doi.org/10.1177/20539517221099882} ,
keywords = {journal,data,policy,governance} ,
}
Counterfactuals for the Future
Lucius E. J. Bynum, Joshua R. Loftus, and Julia Stoyanovich
In Proceedings of the AAAI Conference on Artificial Intelligence Jul 2023
@inproceedings { bynum2023counterfactuals ,
author = {Bynum, Lucius E. J. and Loftus, Joshua R. and Stoyanovich, Julia} ,
title = {Counterfactuals for the Future} ,
url = {https://ojs.aaai.org/index.php/AAAI/article/view/26655} ,
doi = {10.1609/aaai.v37i12.26655} ,
number = {12} ,
booktitle = {Proceedings of the AAAI Conference on Artificial Intelligence} ,
year = {2023} ,
pages = {14144-14152} ,
keywords = {journal,fairness,causal,counterfactuals} ,
}
Towards Substantive Conceptions of Algorithmic Fairness: Normative Guidance from Equal Opportunity Doctrines
Falaah Arif Khan, Eleni Manis, and Julia Stoyanovich
In Equity and Access in Algorithms, Mechanisms, and Optimization, EAAMO 2022, Arlington, VA, USA, October 6-9, 2022 Jul 2022
@inproceedings { DBLP:conf/eaamo/ArifKhanMS22 ,
author = {{Arif Khan}, Falaah and Manis, Eleni and Stoyanovich, Julia} ,
title = {Towards Substantive Conceptions of Algorithmic Fairness: Normative
Guidance from Equal Opportunity Doctrines} ,
booktitle = {Equity and Access in Algorithms, Mechanisms, and Optimization, {EAAMO}
2022, Arlington, VA, USA, October 6-9, 2022} ,
pages = {18:1--18:10} ,
publisher = {{ACM}} ,
year = {2022} ,
url = {https://doi.org/10.1145/3551624.3555303} ,
doi = {10.1145/3551624.3555303} ,
keywords = {conference, fairness} ,
}
We are AI: Taking Control of Technology
Julia Stoyanovich, and Eric Corbett
Center for Responsible AI, New York University Jul 2021
A Simple and Practical Method for Reducing the Disparate Impact of Differential Privacy
Lucas Rosenblatt, Julia Stoyanovich, and Christopher Musco
In Thirty-Eighth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada Jul 2024
@inproceedings { DBLP:conf/aaai/RosenblattSM24 ,
author = {Rosenblatt, Lucas and Stoyanovich, Julia and Musco, Christopher} ,
editor = {Wooldridge, Michael J. and Dy, Jennifer G. and Natarajan, Sriraam} ,
title = {A Simple and Practical Method for Reducing the Disparate Impact of
Differential Privacy} ,
booktitle = {Thirty-Eighth {AAAI} Conference on Artificial Intelligence, {AAAI}
2024, Thirty-Sixth Conference on Innovative Applications of Artificial
Intelligence, {IAAI} 2024, Fourteenth Symposium on Educational Advances
in Artificial Intelligence, {EAAI} 2014, February 20-27, 2024, Vancouver,
Canada} ,
pages = {21554--21562} ,
publisher = {{AAAI} Press} ,
year = {2024} ,
url = {https://doi.org/10.1609/aaai.v38i19.30153} ,
doi = {10.1609/AAAI.V38I19.30153} ,
keywords = {fairness,privacy,conference} ,
author+an = {1=self;2=self}
}
The Game Of Recourse: Simulating Algorithmic Recourse over Time to Improve Its Reliability and Fairness
Andrew Bell, João Fonseca, and Julia Stoyanovich
In Companion of the 2024 International Conference on Management of Data, SIGMOD/PODS 2024, Santiago AA, Chile, June 9-15, 2024 Jul 2024
@inproceedings { DBLP:conf/sigmod/BellFS24 ,
author = {Bell, Andrew and Fonseca, Jo{\~{a}}o and Stoyanovich, Julia} ,
editor = {Barcel{\'{o}}, Pablo and Pi, Nayat S{\'{a}}nchez and Meliou, Alexandra and Sudarshan, S.} ,
title = {The Game Of Recourse: Simulating Algorithmic Recourse over Time to
Improve Its Reliability and Fairness} ,
booktitle = {Companion of the 2024 International Conference on Management of Data,
{SIGMOD/PODS} 2024, Santiago AA, Chile, June 9-15, 2024} ,
pages = {464--467} ,
publisher = {{ACM}} ,
year = {2024} ,
url = {https://doi.org/10.1145/3626246.3654742} ,
doi = {10.1145/3626246.3654742} ,
keywords = {fairness,conference,demo} ,
author+an = {1=self;2=self;3=self} ,
}
On Fairness and Stability: Is Estimator Variance a Friend or a Foe?
Falaah Arif Khan, Denys Herasymuk, and Julia Stoyanovich
CoRR Jul 2023
@article { DBLP:journals/corr/abs-2302-04525 ,
author = {Khan, Falaah Arif and Herasymuk, Denys and Stoyanovich, Julia} ,
title = {On Fairness and Stability: Is Estimator Variance a Friend or a Foe?} ,
journal = {CoRR} ,
volume = {abs/2302.04525} ,
year = {2023} ,
doi = {10.48550/arXiv.2302.04525} ,
eprinttype = {arXiv} ,
eprint = {2302.04525} ,
keywords = {working,fairness,stability,RAIforUkraine} ,
}