Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
  1. Home
  2. Search

Refine search

Refine search

Access:
Content type:
Publication date:
Apply   From and To filters
Subject: Show more
Journals Show more
Publishers: Show more
Societies Show more
Series: Show more
Collections: Show more

Actions for selected content:

Select all | Deselect all
  • View selected items
  • Export citations
  • Download PDF (zip)
  • Save to Kindle
  • Save to Dropbox
  • Save to Google Drive

Save Search

You can save your searches here and later view and run them again in "My saved searches".

Please provide a title, maximum of 40 characters.
Cancel
×

1 results

  • 8 - Controlling Things Versus Controlling Agents: The Challenge of High-Level AI

  • from Part II - Strategies and Obstacles: The Solutions We Need, and What’s Preventing Them from Being Realized
  • Michael D. Bess, Vanderbilt University, Tennessee
  • Book:
    Planet in Peril
    Published online:
    13 October 2022
    Print publication:
    13 October 2022, pp 106-114

  • Summary

    Whereas today’s “narrow” AI machines can be easily controlled, the probable advent over the coming decades of machines endowed with Artificial General Intelligence (AGI) will pose a far more difficult control challenge – for such machines will function as agents endowed with many human-like capabilities. The AI expert Stuart Russell has proposed a radical new design for the motivational architecture of AI machines, which he calls “humble AI.” Rather than programming AI machines to pursue specific goals, he argues, it would be much safer to give them a single broad goal, namely, maximizing the realization of human preferences. The key innovation here lies in programming the machines so that they can never be 100 percent certain about what those human preferences are – a gambit that restores ultimate control over the machines’ behavior to their human overseers. Russell argues persuasively that fundamental safety research in the field of AI needs to be pursued as a much higher priority than it currently receives today.