What Are Elastic Weights? EWC vs. LoRA in Continual Learning
Elastic Weight Consolidation (EWC) explained: how Fisher weight springs prevent catastrophic forgetting, why they struggle at LLM scale, and tools to try.
All
AI 16
Continuous Learning 15
LoRA 13
Fine-Tuning 11
Self-Training 8
SFT 7
Catastrophic Forgetting 6
Continual Learning 6
AI Agents 5
Data Selection 3
Elastic Weight Consolidation