DYNAMIC GRADIENT CALIBRATION METHOD FOR COMPUTING-IN-MEMORY NEURAL NETWORK AND SYSTEM THEREOF

專利類型

發明

專利國別 (專利申請國家)

美國

專利申請案號

16/902,282

專利證號

US 11,763,162

專利獲證名稱

DYNAMIC GRADIENT CALIBRATION METHOD FOR COMPUTING-IN-MEMORY NEURAL NETWORK AND SYSTEM THEREOF

專利所屬機關 (申請機關)

國立清華大學

獲證日期

2023/09/19

技術說明

A dynamic gradient calibration method for a computing-in-memory neural network is performed to update a plurality of weights in a computing-in-memory circuit according to a plurality of inputs corresponding to a correct answer. A forward operating step includes performing a bit wise multiply-accumulate operation on a plurality of divided inputs and a plurality of divided weights to generate a plurality of multiply-accumulate values, and performing a clamping function on the multiply-accumulate values to generate a plurality of clamped multiply-accumulate values according to a predetermined upper bound value, and comparing the clamped multiply-accumulate values with the correct answer to generate a plurality of loss values. A backward operating step includes performing a partial differential operation on the loss values relative to the weights to generate a weight-based gradient. The weights are updated according to the weight-based gradient.

備註

連絡單位 (專責單位/部門名稱)

智財技轉組

連絡電話

03-5715131-62219

網址