WHY LARGE AI MODELS LEARN BETTER THAN SMALL ONES

Researchers have identified why larger language models master rare tasks that smaller ones struggle with: frequent training data overwrites less common skills in small models. A study spanning models from 4 million to 4 billion parameters reveals a practical alternative to scaling.