Yoshua Bengio discusses his significant career shift in 2022-2023 from focusing on AI capabilities to prioritizing reliability and safety. He notes that while many students understand the risks, they often prioritize career prospects and higher salaries in capabilities research over safety work. Bengio suggests that established researchers might find it easier to switch focus, referencing Geoffrey Hinton's similar move, but acknowledges that the financial incentives are still lower in safety roles, despite being good by normal standards. He attributes this to psychological factors like status-seeking and the normalization of extremely high salaries in ML.
Impact: Medium. This highlights a critical bottleneck in AI safety: the human element. It suggests that even with awareness of risks, career and financial pressures can divert talent away from crucial safety research, potentially slowing progress on mitigating existential threats.
In the source video, this keypoint occurs from 02:29:15 to 02:31:18.
Sources in support: Rob Wiblin (Host)

