D^2-MoE: Delta Decompression for MoE-based LLMs Compression
-
Updated
Mar 25, 2025 - Python
D^2-MoE: Delta Decompression for MoE-based LLMs Compression
Decentralized personalized federated learning based on a conditional sparse-to-sparser scheme (TNNLS)
[AICCSA 2025] Official Implementation of the paper "Z-Pruner: Post-Training Pruning of Large Language Models for Efficiency without Retraining".
[EMNLP 26] Code for Frequency Matters: Fast Model-Agnostic Data Curation for Pruning and Quantization
A custom PyTorch neural network that implements parameter pruning through an $L_1$-regularized, learnable gating mechanism. By wrapping standard linear weights in a trainable gate, the model actively learns to balance classification accuracy and network sparsity, demonstrating the trade-off through evaluated metrics on the CIFAR-10 dataset.
To associate your repository with the pruning-sparsity topic, visit your repo's landing page and select "manage topics."