The application of compression techniques, such as quantization and pruning, to reduce neural network weight size and complexity is gaining momentum due to the significant savings they provide in both hardware and software resources, particularly important for edge devices with limited capabilities. To fully leverage the advantages of these techniques, their design should account for the amplitude dynamics and the probability distribution of the parameters to be compressed. Therefore, it is essential to analyze the statistical characteristics of these parameters prior to compression. Although this type of analysis has been extensively conducted in the context of Artificial Neural Networks (ANNs), it has received limited attention in the case of Spiking Neural Networks (SNNs). Motivated by this gap, this paper examines the statistical properties of the weights of an SNN trained on the DVS128 Gesture dataset. The results of this analysis are valuable not only for enabling a well-founded selection and effective design of appropriate quantization models, but also for supporting the efficient application of pruning techniques, which could benefit from using synaptic weight histograms as valuable guiding information.
Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset
Bertozzi, Davide;Zese, RiccardoPenultimo
;
2025
Abstract
The application of compression techniques, such as quantization and pruning, to reduce neural network weight size and complexity is gaining momentum due to the significant savings they provide in both hardware and software resources, particularly important for edge devices with limited capabilities. To fully leverage the advantages of these techniques, their design should account for the amplitude dynamics and the probability distribution of the parameters to be compressed. Therefore, it is essential to analyze the statistical characteristics of these parameters prior to compression. Although this type of analysis has been extensively conducted in the context of Artificial Neural Networks (ANNs), it has received limited attention in the case of Spiking Neural Networks (SNNs). Motivated by this gap, this paper examines the statistical properties of the weights of an SNN trained on the DVS128 Gesture dataset. The results of this analysis are valuable not only for enabling a well-founded selection and effective design of appropriate quantization models, but also for supporting the efficient application of pruning techniques, which could benefit from using synaptic weight histograms as valuable guiding information.| File | Dimensione | Formato | |
|---|---|---|---|
|
Statistical_Analysis_of_Synaptic_Weights_in_Spiking_Neural_Network_Trained_on_the_DVS128_Gesture_Dataset.pdf
solo gestori archivio
Descrizione: Full text editoriale
Tipologia:
Full text (versione editoriale)
Licenza:
Copyright dell'editore
Dimensione
687.53 kB
Formato
Adobe PDF
|
687.53 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
|
Final_Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset.pdf
solo gestori archivio
Descrizione: Post-print
Tipologia:
Post-print
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
831.37 kB
Formato
Adobe PDF
|
831.37 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
|
Final_Statistical Analysis of Synaptic Weights in Spiking Neural Network Trained on the DVS128 Gesture Dataset_preprint.pdf
solo gestori archivio
Descrizione: Pre-print
Tipologia:
Pre-print
Licenza:
NON PUBBLICO - Accesso privato/ristretto
Dimensione
834.77 kB
Formato
Adobe PDF
|
834.77 kB | Adobe PDF | Visualizza/Apri Richiedi una copia |
I documenti in SFERA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


