Deploying Deep Learning (DL) models on edge devices presents several challenges due to the limited set of processing and memory resources, and the bandwidth constraints while ensuring performance and energy requirements. In-memory computing (IMC) represents an efficient way to accelerate the inference of data-intensive DL tasks on the edge. Recently, several analog, digital, and mixed digital-analog memory technologies emerged as promising solutions for IMC. Among them, digital SRAM IMC exhibits a deterministic behavior and compatibility with advanced technology scaling rules making it a viable path for integration with hardware accelerators. This work focuses on discussing the potentially powerful aspects of digital IMC (DIMC) on edge System-on-Chip (SoC) devices. The limitations and ()pen challenges of DIMC are also discussed.

Digital In-Memory Computing to Accelerate Deep Learning Inference on the Edge

Zambelli, Cristian;Silvano, Cristina
Ultimo
2024

Abstract

Deploying Deep Learning (DL) models on edge devices presents several challenges due to the limited set of processing and memory resources, and the bandwidth constraints while ensuring performance and energy requirements. In-memory computing (IMC) represents an efficient way to accelerate the inference of data-intensive DL tasks on the edge. Recently, several analog, digital, and mixed digital-analog memory technologies emerged as promising solutions for IMC. Among them, digital SRAM IMC exhibits a deterministic behavior and compatibility with advanced technology scaling rules making it a viable path for integration with hardware accelerators. This work focuses on discussing the potentially powerful aspects of digital IMC (DIMC) on edge System-on-Chip (SoC) devices. The limitations and ()pen challenges of DIMC are also discussed.
2024
9798350364606
Deep Learnig; Hardware accelerators; In-memory computing; System-on-chip devices
File in questo prodotto:
File Dimensione Formato  
RAW2024_IRIS.pdf

solo gestori archivio

Tipologia: Full text (versione editoriale)
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 893.2 kB
Formato Adobe PDF
893.2 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in SFERA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11392/2569650
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? 1
social impact