Invention Grant
- Patent Title: System and method for pipelet processing of data sets
- Patent Title (中): 数据集的管道处理系统和方法
-
Application No.: US11406069Application Date: 2006-04-17
-
Publication No.: US08151282B2Publication Date: 2012-04-03
- Inventor: John M. Carnahan
- Applicant: John M. Carnahan
- Applicant Address: US CA Sunnyvale
- Assignee: Yahoo! Inc.
- Current Assignee: Yahoo! Inc.
- Current Assignee Address: US CA Sunnyvale
- Agency: Ostrow Kaufman LLP
- Agent Seth H. Ostrow
- Main IPC: G06F3/00
- IPC: G06F3/00 ; G06F9/44 ; G06F9/46 ; G06F13/00

Abstract:
The present invention is directed towards systems and methods for decomposing a complex problem or task into one or more constituent components, operating in parallel over a plurality of computing devices in communication over a network. A system according to the present invention comprises one or more pipelets. A given pipelet comprises a read data interface operative to receive incoming data, one or more functions for processing the incoming data, and a write data interface operative to make the processed incoming data available as output data to be further processed. The system according to the present embodiment further comprises a controller operative to receive a pipeline specification that identifies the one or more pipelets as belonging to a pipeline, generate a dependency map that identifies an order in which to execute the one or more pipelets and execute the pipelets according to the dependency map to generate a result.
Public/Granted literature
- US20070011437A1 System and method for pipelet processing of data sets Public/Granted day:2007-01-11
Information query