Are LLM learning skills rather than being Stochastic Parrots?
A Theory for Emergence of Complex Skills in Language Models
Skill-Mix: a Flexible and Expandable Family of Evaluations for AI models
www.quantamagazine.org/new-theor…
related to the authors
Arora, S
Was that Sarcasm?: A Literature Survey on Sarcasm Detection
Can Models Learn Skill Composition from Examples?
Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuning
Goyal, A
Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs
Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving
Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning