Invention Grant
- Patent Title: Asynchronous accumulator using logarithmic-based arithmetic
-
Application No.: US16750917Application Date: 2020-01-23
-
Publication No.: US12033060B2Publication Date: 2024-07-09
- Inventor: William James Dally , Rangharajan Venkatesan , Brucek Kurdo Khailany , Stephen G. Tell
- Applicant: NVIDIA Corporation
- Applicant Address: US CA Santa Clara
- Assignee: NVIDIA Corporation
- Current Assignee: NVIDIA Corporation
- Current Assignee Address: US CA Santa Clara
- Agency: Leydig, Voit & Mayer, Ltd.
- Main IPC: G06N3/063
- IPC: G06N3/063 ; G06F7/544 ; G06F7/575 ; G06F17/16 ; G06N3/02 ; G06N3/045

Abstract:
Neural networks, in many cases, include convolution layers that are configured to perform many convolution operations that require multiplication and addition operations. Compared with performing multiplication on integer, fixed-point, or floating-point format values, performing multiplication on logarithmic format values is straightforward and energy efficient as the exponents are simply added. However, performing addition on logarithmic format values is more complex. Conventionally, addition is performed by converting the logarithmic format values to integers, computing the sum, and then converting the sum back into the logarithmic format. Instead, logarithmic format values may be added by decomposing the exponents into separate quotient and remainder components, sorting the quotient components based on the remainder components, summing the sorted quotient components using an asynchronous accumulator to produce partial sums, and multiplying the partial sums by the remainder components to produce a sum. The sum may then be converted back into the logarithmic format.
Public/Granted literature
- US20210056399A1 ASYNCHRONOUS ACCUMULATOR USING LOGARITHMIC-BASED ARITHMETIC Public/Granted day:2021-02-25
Information query