Skim Logo
80,000 Hours14 hours ago
Godfather of AI: How To Make Safe Superintelligent AI – Yoshua Bengio
2:35:26
8H

Godfather of AI: How To Make Safe Superintelligent AI – Yoshua Bengio

The Career Dilemma: Safety vs. Capabilities — 80,000 Hours

From Godfather of AI: How To Make Safe Superintelligent AI – Yoshua Bengio. Category: Tech. Format: Interview. This is a single keypoint from the analysis.

Yoshua Bengio discusses his significant career shift in 2022-2023 from focusing on AI capabilities to prioritizing reliability and safety. He notes that while many students understand the risks, they often prioritize career prospects and higher salaries in capabilities research over safety work. Bengio suggests that established researchers might find it easier to switch focus, referencing Geoffrey Hinton's similar move, but acknowledges that the financial incentives are still lower in safety roles, despite being good by normal standards. He attributes this to psychological factors like status-seeking and the normalization of extremely high salaries in ML.

Impact: Medium. This highlights a critical bottleneck in AI safety: the human element. It suggests that even with awareness of risks, career and financial pressures can divert talent away from crucial safety research, potentially slowing progress on mitigating existential threats.

In the source video, this keypoint occurs from 02:29:15 to 02:31:18.

Sources in support: Rob Wiblin (Host)

For the full credibility analysis, key takeaways, and other keypoints from this video, see the full analysis on skim.

This keypoint analysis was generated by skim (skim.plus), an AI-powered content analysis platform by Credible AI.