Invention Grant
US07672913B2 Automated action-selection system and method, and application thereof to training prediction machines and driving the development of self-developing devices 有权
自动动作选择系统及方法及其应用于训练预测机器,推动自主研发设备的发展

  • Patent Title: Automated action-selection system and method, and application thereof to training prediction machines and driving the development of self-developing devices
  • Patent Title (中): 自动动作选择系统及方法及其应用于训练预测机器,推动自主研发设备的发展
  • Application No.: US11658683
    Application Date: 2005-07-26
  • Publication No.: US07672913B2
    Publication Date: 2010-03-02
  • Inventor: Frederic KaplanPierre-Yves Oudeyer
  • Applicant: Frederic KaplanPierre-Yves Oudeyer
  • Applicant Address: FR Clichy la Garenne
  • Assignee: Sony France S.A.
  • Current Assignee: Sony France S.A.
  • Current Assignee Address: FR Clichy la Garenne
  • Agency: Oblon, Spivak, McClelland, Maier & Neustadt, L.L.P.
  • Priority: EP04291912 20040727
  • International Application: PCT/EP2005/008724 WO 20050726
  • International Announcement: WO2006/010645 WO 20060202
  • Main IPC: G06N5/00
  • IPC: G06N5/00
Automated action-selection system and method, and application thereof to training prediction machines and driving the development of self-developing devices
Abstract:
In order to promote efficient learning of relationships inherent in a system or setup S described by system-state and context parameters, the next action to take, affecting the setup, is determined based on the knowledge gain expected to result from this action. Knowledge-gain is assessed “locally” by comparing the value of a knowledge-indicator parameter after the action with the value of this indicator on one or more previous occasions when the system-state/context parameter(s) and action variable(s) had similar values to the current ones. Preferably the “level of knowledge” is assessed based on the accuracy of predictions made by a prediction module. This technique can be applied to train a prediction machine by causing it to participate in the selection of a sequence of actions. This technique can also be applied for managing development of a self-developing device or system, the self-developing device or system performing a sequence of actions selected according to the action-selection technique.
Information query
Patent Agency Ranking
0/0