BabyLM Challenge
Sample-efficient pretraining on a developmentally plausible corpus

BabyLM 4 at EMNLP 2026 - Workshop Schedule

October 29, 2026 | Room F4-5, HungExpo Budapest, Hungary. All times are in Budapest local time (CET, UTC+1).

Time Session
- Opening Remarks
- BabyLM Orals pt 1
  • 09:30 - 09:45 BabySteps at BabyLM 2026: Stronger Optimization and Causal Baselines for Data-Constrained Pretraining
  • 09:45 - 10:00 Qwenfant: Train Big Character-level BabyLMs on Concise Parallel Text
  • 10:00 - 10:15 Recursive Transformers for BabyLM 2026
  • 10:15 - 10:30 Miss Universal Grammar: Pretraining BabyLMs with Linguistic and Non-Linguistic Sources
- Break
- Invited Talk 1
Mitja Nikolaus (CNRS, Toulouse)
Communicative Feedback: Language Acquisition Within and Through Social Interaction
- BabyLM Orals pt 2
  • 12:00 - 12:15 Relational Attention for Data-Efficient Language Modeling
  • 12:15 - 12:30 TinyLibrary: Do Age-Graded Curricula Help Small Vision-Language Models?
- Lunch
- Poster Session
- Break
- Invited Talk 2
Pontus Stenetorp (University College London)
UK-LLM, Sofair, and a path towards frontier-level Open Source Artificial Intelligence
- Town Hall
- Awards and Closing Remarks