Low-Power Stochastic Computing for Convolutional Neural Networks Implementation

With the recent advance of wearable devices and Internet of Things (IoTs), it becomes attractive to implement the Deep Convolutional Neural Networks (DCNNs) in embedded and portable systems. Currently, executing the software-based DCNNs requires high-performance and high-power servers.

Stochastic Computing (SC), which uses a bit-stream to represent a number within [-1, 1] by counting the number of ones in the bit-stream, has high potential for implementing CNNs with ultra-low hardware footprint. Since multiplications and additions can be calculated using AND gates and multiplexers in SC, significant reductions in power (energy) and hardware footprint can be achieved compared to the conventional binary arithmetic implementations.

In this project we will implement the basic elements of CNN using Stochastic computing concepts. The implementation of the elements will be at circuit level, followed by application to a small network example for validation and power/performance analysis.

The work will be performed using Cadence design tools based on latest process technology models. The students will gain exposure to CNN implementation field, knowledge of advanced computing techniques, as well as low-power logical circuit design.

 

Recommended: Introduction to VLSI course (prior or in parallel)

Example reference:

https://arxiv.org/pdf/1611.05939.pdf

An additional goal is to implement the logic using GDI for further power reduction (can also be a separate project for future).