Instrumental divergence.
The thesis of instrumental convergence holds that a wide range of ends have common means: for instance, self preservation, desire preservation, self improvement, and resource acquisition. Bostrom contends that instrumental convergence gives us reason to think that "the default outcome of the creatio...
| Publicado en: | Philosophical Studies Vol. 182; no. 7; pp. 1581 - 1608 |
|---|---|
| Autor principal: | |
| Formato: | Artículo |
| Publicado: |
Springer Nature
Jul2025
|
| Materias: | |
| Acceso en línea: | Ver este registro en EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=hlh&AN=186909895&site=ehost-live header: @attributes: shortDbName: hlh uiTerm: 186909895 longDbName: Humanities International Complete uiTag: AN controlInfo: bkinfo: jinfo: jid: 00318116 4L8 jtl: Philosophical Studies issn: 00318116 maglogo: N pubinfo: dt: Jul2025 vid: 182 iid: 7 pid: 237 pub: Springer Nature artinfo: ui: 186909895 10.1007/s11098-024-02129-3 ppf: 1581 ppct: 27 formats: fmt: – @attributes: type: T – @attributes: type: P size: 1.3MB tig: atl: Instrumental divergence. aug: au: Gallow, J. Dmitri affil: https://ror.org/01tgyzw49 Department of Philosophy, National University of Singapore, Singapore, Singapore The Center for AI Safety, San Francisco, California, USA su: Artificial intelligence Machine learning Logical prediction Digital technology Decision theory sug: subj: Artificial intelligence Machine learning Logical prediction Digital technology Decision theory keyword: AI safety Existential risk Instrumental convergence ab: The thesis of instrumental convergence holds that a wide range of ends have common means: for instance, self preservation, desire preservation, self improvement, and resource acquisition. Bostrom contends that instrumental convergence gives us reason to think that "the default outcome of the creation of machine superintelligensome of the 'convergence is existential catastrophe". I use the tools of decision theory to investigate whether this thesis is true. I find that, even if intrinsic desires are randomly selected, instrumental rationality induces biases towards certain kinds of choices. Firstly, a bias towards choices which leave less up to chance. Secondly, a bias towards desire preservation, in line with Bostrom's conjecture. And thirdly, a bias towards choices which afford more choices later on. I do not find biases towards any other of the convergent instrumental means on Bostrom's list. I conclude that the biases induced by instrumental rationality at best weakly support Bostrom's conclusion that machine superintelligence is likely to lead to existential catastrophe. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: Y custom: Philosophical Studies is a copyright of Springer, 2025. All Rights Reserved. item: Philosophical Studies holder: Springer Nature dt: @attributes: year: 2025 holdings: @attributes: islocal: N |
|---|