Abstraction and Prediction Algorithms: A Harm-Reduction Framework

Date
2020
Authors
Desilvestro, Adrian
Supervisor
Ryan, Matthew
Skov, Peer
Item type
Dissertation
Degree name
Master of Business
Journal Title
Journal ISSN
Volume Title
Publisher
Auckland University of Technology
Abstract

ProPublica’s allegations, that an algorithmic tool used to predict re-offenders is “biased against blacks”, met a wave of criticism from the wider community. Researchers have since shown a trade-off between accuracy and fairness, concluding that the risk tool, COMPAS, was not inherently discriminatory. However, in light of ProPublica’s objections, a growing body of literature on assessing fairness in machine learning systems has taken flight. Performance criteria combine quantitative and qualitative elements, so users ‘preferences’ are hard to specify objectively. This study explores a Pareto frontier framework to illustrate the relative model (in)efficiencies that arise in Risk Prediction Instruments (RPIs). The research follows a logistic framework for estimating recidivism risk, and the design parameters include the choice of fairness constraints and the choice of a bin scoring system (the “bin number”). This dissertation presents three experiments where decision-makers can improve performance in their RPIs: (1) improving efficiency through a relaxed version of the constraint, (2) improving efficiency through ‘cost-free’ constraint implementation, and (3) improving efficiency through a revised scoring system.

Description
Keywords
Algorithmic fairness , Accuracy-fairness tradeoffs , Risk prediction instruments , Pareto-frontier framework
Source
DOI
Publisher's version
Rights statement