Fragments for llm

Simon Willison added “fragments” to his llm program. See the announcement and documentation. This radically extends the facility for generating request context.

Fragments extend and modularize the notion of templates. At the same time they admit the plugin model, so that a fragment can programatically generate context. This is a very exciting extension to llm capability.