What Are Elastic Weights? EWC vs. LoRA in Continual Learning
An approachable guide to Elastic Weight Consolidation (EWC), how Fisher weight springs prevent catastrophic forgetting, why they struggle at LLM scale, and open-source tools to try.
All
AI 15
Continuous Learning 14
LoRA 13
Fine-Tuning 11
Self-Training 8
SFT 7
Catastrophic Forgetting 6
AI Agents 5
Continual Learning 5
Data Selection 3
Elastic Weight Consolidation