Invention Grant
- Patent Title: Automated action-selection system and method, and application thereof to training prediction machines and driving the development of self-developing devices
- Patent Title (中): 自动动作选择系统及方法及其应用于训练预测机器,推动自主研发设备的发展
-
Application No.: US11658683Application Date: 2005-07-26
-
Publication No.: US07672913B2Publication Date: 2010-03-02
- Inventor: Frederic Kaplan , Pierre-Yves Oudeyer
- Applicant: Frederic Kaplan , Pierre-Yves Oudeyer
- Applicant Address: FR Clichy la Garenne
- Assignee: Sony France S.A.
- Current Assignee: Sony France S.A.
- Current Assignee Address: FR Clichy la Garenne
- Agency: Oblon, Spivak, McClelland, Maier & Neustadt, L.L.P.
- Priority: EP04291912 20040727
- International Application: PCT/EP2005/008724 WO 20050726
- International Announcement: WO2006/010645 WO 20060202
- Main IPC: G06N5/00
- IPC: G06N5/00

Abstract:
In order to promote efficient learning of relationships inherent in a system or setup S described by system-state and context parameters, the next action to take, affecting the setup, is determined based on the knowledge gain expected to result from this action. Knowledge-gain is assessed “locally” by comparing the value of a knowledge-indicator parameter after the action with the value of this indicator on one or more previous occasions when the system-state/context parameter(s) and action variable(s) had similar values to the current ones. Preferably the “level of knowledge” is assessed based on the accuracy of predictions made by a prediction module. This technique can be applied to train a prediction machine by causing it to participate in the selection of a sequence of actions. This technique can also be applied for managing development of a self-developing device or system, the self-developing device or system performing a sequence of actions selected according to the action-selection technique.
Public/Granted literature
Information query
IPC分类:
G | 物理 |
G06 | 计算;推算或计数 |
G06N | 基于特定计算模型的计算机系统 |
G06N5/00 | 利用基于知识的模式的计算机系统 |