aisecurity.ninja

BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain

Tianyu Gu (New York University), Brendan Dolan-Gavitt (New York University), Siddharth Garg (New York University)

Published Aug 22, 2017 ยท arXiv:1708.06733

cs.CRcs.LG

Abstract

This paper demonstrates that outsourced training of machine learning models introduces new security risks, as an adversary can create a maliciously trained network (BadNet) that performs well on most inputs but behaves badly on specific attacker-chosen inputs.