Invention Grant
- Patent Title: Neuron smearing for accelerated deep learning
-
Application No.: US16500357Application Date: 2018-04-15
-
Publication No.: US11488004B2Publication Date: 2022-11-01
- Inventor: Sean Lie , Michael Morrison , Srikanth Arekapudi , Michael Edwin James , Gary R. Lauterbach
- Applicant: Cerebras Systems Inc.
- Applicant Address: US CA Los Altos
- Assignee: Cerebras Systems Inc.
- Current Assignee: Cerebras Systems Inc.
- Current Assignee Address: US CA Los Altos
- Agency: PatentVentures
- Agent Bennett Smith
- International Application: PCT/IB2018/052607 WO 20180415
- International Announcement: WO2018/193353 WO 20181025
- Main IPC: G06N3/06
- IPC: G06N3/06 ; G06N3/063 ; G06N3/08 ; G06N3/04

Abstract:
Techniques in advanced deep learning provide improvements in one or more of accuracy, performance, and energy efficiency. An array of processing elements performs flow-based computations on wavelets of data. Each processing element has a respective compute element and a respective routing element. Each compute element has memory. At least a first single neuron is implemented using resources of a plurality of the array of processing elements. At least a portion of a second neuron is implemented using resources of one or more of the plurality of processing elements. In some usage scenarios, the foregoing neuron implementation enables greater performance by enabling a single neuron to use the computational resources of multiple processing elements and/or computational load balancing across the processing elements while maintaining locality of incoming activations for the processing elements.
Public/Granted literature
- US20200380344A1 NEURON SMEARING FOR ACCELERATED DEEP LEARNING Public/Granted day:2020-12-03
Information query