Pruning
Removing unnecessary weights/neurons to reduce model size and computational cost.
In italiano: PruningIdentifies and removes weights with small magnitudes. Can be structured (neurons/filters) or unstructured (individual weights). Often combined with fine-tuning.
Examples
- Weight pruning by magnitude
- Structured filter pruning
- Lottery ticket hypothesis