The application of compression techniques, such as quantization and pruning, to reduce neural network weight size and complexity is gaining momentum due to the significant savings they provide in both hardware and software resources, particularly important for edge devices with limited capabilities. To fully leverage the advantages of these techniques, their design should account for the amplitude dynamics and the probability distribution of the parameters to be compressed. Therefore, it is essential to analyze the statistical characteristics of these parameters prior to compression. Although this type of analysis has been extensively conducted in the context of Artificial Neural Networks (ANNs), it has received limited attention in the case of Spiking Neural Networks (SNNs). Motivated by this gap, this paper examines the statistical properties of the weights of an SNN trained on the DVS128 Gesture dataset. The results of this analysis are valuable not only for enabling a well-founded selection and effective design of appropriate quantization models, but also for supporting the efficient application of pruning techniques, which could benefit from using synaptic weight histograms as valuable guiding information.

Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset

Bertozzi, Davide;Zese, Riccardo
Penultimo
;
2025

Abstract

The application of compression techniques, such as quantization and pruning, to reduce neural network weight size and complexity is gaining momentum due to the significant savings they provide in both hardware and software resources, particularly important for edge devices with limited capabilities. To fully leverage the advantages of these techniques, their design should account for the amplitude dynamics and the probability distribution of the parameters to be compressed. Therefore, it is essential to analyze the statistical characteristics of these parameters prior to compression. Although this type of analysis has been extensively conducted in the context of Artificial Neural Networks (ANNs), it has received limited attention in the case of Spiking Neural Networks (SNNs). Motivated by this gap, this paper examines the statistical properties of the weights of an SNN trained on the DVS128 Gesture dataset. The results of this analysis are valuable not only for enabling a well-founded selection and effective design of appropriate quantization models, but also for supporting the efficient application of pruning techniques, which could benefit from using synaptic weight histograms as valuable guiding information.
2025
9798331514181
DVS128 gesture dataset, Spiking Neural Network, synaptic weights, statistical analysis
File in questo prodotto:
File Dimensione Formato  
Statistical_Analysis_of_Synaptic_Weights_in_Spiking_Neural_Network_Trained_on_the_DVS128_Gesture_Dataset.pdf

solo gestori archivio

Descrizione: Full text editoriale
Tipologia: Full text (versione editoriale)
Licenza: Copyright dell'editore
Dimensione 687.53 kB
Formato Adobe PDF
687.53 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Final_Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset.pdf

solo gestori archivio

Descrizione: Post-print
Tipologia: Post-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 831.37 kB
Formato Adobe PDF
831.37 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
Final_Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset_preprint.pdf

solo gestori archivio

Descrizione: Pre-print
Tipologia: Pre-print
Licenza: NON PUBBLICO - Accesso privato/ristretto
Dimensione 834.77 kB
Formato Adobe PDF
834.77 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in SFERA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11392/2614930
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact