via https://twitter.com/bearstech/status/782112364833411073
In a paper they released earlier this month titled “Stealing Machine Learning Models via Prediction APIs,” a team of computer scientists at Cornell Tech, the Swiss institute EPFL in Lausanne, and the University of North Carolina detail how they were able to reverse engineer machine learning-trained AIs based only on sending them queries and analyzing the responses.
Paper here: https://www.usenix.org/conference/usenixsecurity16/technical-sessions/presentation/tramer