Skip to main content
BackLoss of human control and oversight, with an autonomous model then taking harmful actions
Home/Risks/Government Office for Science (2023)/Loss of human control and oversight, with an autonomous model then taking harmful actions

Loss of human control and oversight, with an autonomous model then taking harmful actions

Future Risks of Frontier AI

Government Office for Science (2023)

Category
Risk Domain

AI systems acting in conflict with human goals or values, especially the goals of designers or users, or ethical standards. These misaligned behaviors may be introduced by humans during design and development, such as through reward hacking and goal misgeneralisation, or may result from AI using dangerous capabilities such as manipulation, deception, situational awareness to seek power, self-proliferate, or achieve other goals.

Other risks from Government Office for Science (2023) (19)