flâneur

[2109.13916] Unsolved Problems in ML Safety

arxiv.org · 668 words · saved by 1 readers

Machine learning (ML) systems are rapidly increasing in size, are acquiring new capabilities, and are increasingly deployed in high-stakes settings. As with other powerful technologies, safety for ML should be a leading research priority. In response to emerging safety challenges in ML, such as those introduced by recent large-scale models, we provide a new roadmap for ML Safety and refine the technical problems that the field needs to address. We present four problems ready for research, namely withstanding hazards ("Robustness"), identifying hazards ("Monitoring"), reducing inherent model hazards ("Alignment"), and reducing systemic hazards ("Systemic Safety"). Throughout, we clarify each problem's motivation and provide concrete research directions.

[2109.13916] Unsolved Problems in ML Safety Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:2109.13916 (cs) [Submitted on 28 Sep 2021 ( v1 ), last revised 16 Jun 2022 (this version, v5)] Title: Unsolved Problems in ML Safety Authors: Dan Hendrycks , Nicholas Carlini , John Schulman , Jacob Steinhardt View a PDF of the paper titled Unsolved Problems in ML Safety, by Dan Hendrycks and Nicholas Carlini and John Schulman and Jacob Steinhardt View PDF Abstract: Ma

related reading