Original explanatory diagram
Granite 3.1 put 128K context on the release record
IBM released Granite 3.1 on December 18, 2024 with a 128K context window across dense, MoE, and Guardian models, changing the test boundary for long inputs.
Read analysis