Open main menu
HomeBookingsMediaTalksProfileBlogNewsletterDonatePatrons
Preorder

AGI safety

Chapter 18: Planning for retirement — This generation of AIs will be the last to be raised by humans. The next generations of AIs will be raised by AIs. We have one shot to get this right.

Course companion
•
Table of Contents
AGI safety
Do not index
Do not index

Chapter 18: Planning for retirement

This generation of AIs will be the last to be raised by humans. The next generations of AIs will be raised by AIs. We have one shot to get this right.
Is the future of humans extinction, to be zoo or pets, to upload, or to merge with AIs? (IEEE future technology concern of safety and beneficence of artificial general intelligence (AGI) and artificial superintelligence; IEEE future technology concern of mixed reality) CILO-1, 7, 8
 
Provocation:
     
    Required reading:
    • EAD p198-281, "Policy", "Law"
    The AI Summit Where Everyone Agreed on Bad News
    Exclusive: At a summit attended by staff from OpenAI and DeepMind, the economic risks posed by AI came into focus.
    The AI Summit Where Everyone Agreed on Bad News
    https://time.com/7313344/openai-google-deepmind-summit-social-contract-inequality/
    The AI Summit Where Everyone Agreed on Bad News
    Goodbye, $165,000 Tech Jobs. Student Coders Seek Work at Chipotle.
    As companies like Amazon and Microsoft lay off workers and embrace A.I. coding tools, computer science graduates say they’re struggling to land tech jobs.
    Goodbye, $165,000 Tech Jobs. Student Coders Seek Work at Chipotle.
    https://www.nytimes.com/2025/08/10/technology/coding-ai-jobs-students.html
    Goodbye, $165,000 Tech Jobs. Student Coders Seek Work at Chipotle.
    Opinion | How AI is impacting 700 professions — and might impact yours
    Will AI help you work or replace you? Check yourself.
    Opinion | How AI is impacting 700 professions — and might impact yours
    https://www.washingtonpost.com/opinions/interactive/2025/ai-jobs-layoffs-tech/
    Opinion | How AI is impacting 700 professions — and might impact yours
    OSF
    OSF
    https://osf.io/preprints/psyarxiv/3xye5_v2
    Taking a responsible path to AGI
    We’re exploring the frontiers of AGI, prioritizing technical safety, proactive risk assessment, and collaboration with the AI community.
    Taking a responsible path to AGI
    https://deepmind.google/discover/blog/taking-a-responsible-path-to-agi/
    Taking a responsible path to AGI
    Pitfalls of Evidence-Based AI Policy
    Nations across the world are working to govern AI. However, from a technical perspective, there is uncertainty and disagreement on the best way to do this. Meanwhile, recent debates over AI...
    Pitfalls of Evidence-Based AI Policy
    https://arxiv.org/abs/2502.09618
    Pitfalls of Evidence-Based AI Policy
    www.mckinsey.com
    https://www.mckinsey.com/~/media/mckinsey/featured%20insights/Digital%20Disruption/Harnessing%20automation%20for%20a%20future%20that%20works/MGI-A-future-that-works-Executive-summary.ashx

    Stay engaged on what we can't overlook in the AI age!

    Ready to help raise AI?

    Subscribe

    Written by

    De Kai

    AI Professor @ HKUST CSE / Berkeley ICSI / The Future Society